-- Logs begin at Tue 2022-09-27 04:23:42 UTC, end at Tue 2022-09-27 05:25:50 UTC. -- Sep 27 04:51:12.406012 dv-cinder-858463-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 27 04:51:12.414482 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 27 04:51:12.416513 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 27 04:51:12 2022] *** Sep 27 04:51:12.416513 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 27 04:51:12.416513 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 27 04:51:12.416513 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: nodename: dv-cinder-858463-2-iscsi Sep 27 04:51:12.416513 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: machine: x86_64 Sep 27 04:51:12.416513 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: clock source: unix Sep 27 04:51:12.416513 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: pcre jit disabled Sep 27 04:51:12.416513 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: detected number of CPU cores: 4 Sep 27 04:51:12.416513 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: current working directory: / Sep 27 04:51:12.417137 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: detected binary path: /usr/bin/uwsgi-core Sep 27 04:51:12.417137 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: your processes number limit is 47680 Sep 27 04:51:12.417137 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: your memory page size is 4096 bytes Sep 27 04:51:12.417137 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: detected max file descriptor number: 2048 Sep 27 04:51:12.417137 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: lock engine: pthread robust mutexes Sep 27 04:51:12.417137 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: thunder lock: enabled Sep 27 04:51:12.419241 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 27 04:51:12.419241 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 27 04:51:12.469065 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: Python main interpreter initialized at 0x55827b2639c0 Sep 27 04:51:12.469065 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: python threads support enabled Sep 27 04:51:12.469065 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: your server socket listen backlog is limited to 100 connections Sep 27 04:51:12.469065 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: your mercy for graceful operations on workers is 90 seconds Sep 27 04:51:12.469459 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: mapped 403077 bytes (393 KB) for 2 cores Sep 27 04:51:12.469536 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: *** Operational MODE: preforking *** Sep 27 04:51:12.469798 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: *** uWSGI is running in multiple interpreter mode *** Sep 27 04:51:12.469798 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: spawned uWSGI master process (pid: 80007) Sep 27 04:51:12.470013 dv-cinder-858463-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 27 04:51:12.472291 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: spawned uWSGI worker 1 (pid: 80021, cores: 1) Sep 27 04:51:12.472291 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: spawned uWSGI worker 2 (pid: 80022, cores: 1) Sep 27 04:51:12.472291 dv-cinder-858463-2-iscsi devstack@keystone.service[80007]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 27 04:51:18.353483 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 04:51:18.353483 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: from cryptography.utils import int_from_bytes Sep 27 04:51:18.354219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 04:51:18.354219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: from cryptography.utils import int_from_bytes Sep 27 04:51:18.354643 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 04:51:18.354643 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: from cryptography.utils import int_from_bytes Sep 27 04:51:18.355088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 04:51:18.355088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: from cryptography.utils import int_from_bytes Sep 27 04:51:18.401581 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 04:51:18.401757 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 04:51:18.401950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] command line args: [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 04:51:18.402216 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 04:51:18.402377 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 04:51:18.402469 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ================================================================================ {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 04:51:18.402531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 04:51:18.402678 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] admin_token = **** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.402765 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] command line args: [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 04:51:18.402902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] config_dir = [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.402987 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 04:51:18.403053 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.403111 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ================================================================================ {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 04:51:18.403256 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] config_source = [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.403389 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] admin_token = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.403476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] debug = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.403621 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.405986 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] config_dir = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.405986 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.405986 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] config_source = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.406179 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.406246 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] debug = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.406317 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.406381 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.406473 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.406535 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.406591 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.406645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.406706 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] list_limit = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.406763 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.406826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] log_config_append = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.407220 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.407425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.407425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] log_dir = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.407783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.407972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] log_file = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.408205 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_config_append = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.408205 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.408577 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.408768 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_dir = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.409014 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.409218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_file = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.409424 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.409589 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.409785 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.409981 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.410175 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.410375 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.410603 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.410812 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.410981 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.411769 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.412117 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.412323 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.412502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.412673 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.412858 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.413002 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.413133 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.413305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.413445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.413574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.413708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.413844 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.414035 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.414185 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.414322 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.414460 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.414460 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.414709 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.414850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.414983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] publish_errors = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.414983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.415230 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.415399 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.415540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] publish_errors = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.415675 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.415815 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.415949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.416088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.416217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.416376 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.416508 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] standard_threads = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.416636 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.416881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.417027 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.417158 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.417287 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] standard_threads = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.417421 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.417557 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.417698 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] use_journal = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.417698 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] use_json = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.417698 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] use_stderr = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.418154 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.418299 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] use_syslog = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.418430 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.418566 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.418695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] use_journal = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.418695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] use_json = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.418943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.419071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] use_stderr = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.419206 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.419344 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] use_syslog = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.419473 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.419606 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 04:51:18.419746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.419881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.420024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.420164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.420294 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.420421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.420556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.420692 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.420912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.421056 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.421242 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.421386 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.421517 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.421655 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.421655 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.421908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.421908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.422156 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.422284 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.422419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.422556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.422693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.422693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.422935 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.423063 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.423227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.423442 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.423584 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.423713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.423848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.423978 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.424107 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.424244 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.424373 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.424516 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.424645 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.424772 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.424934 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.425076 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.425212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.425350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.425479 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.425606 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.425733 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.425870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.425999 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.426085 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.426214 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.426214 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.426348 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.426348 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.426489 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.426560 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.426630 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.426699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.426768 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.426846 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.427488 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.427570 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.427641 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.427745 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.427865 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.427960 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.428039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.428116 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.428193 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.428264 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.428339 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.428421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.428494 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.428570 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.428641 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.428710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.428890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.429012 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.429127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.429241 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.429354 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.429467 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.429589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.429705 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.429818 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.429932 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.430045 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.430158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.430279 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.430395 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.430507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.430620 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.430734 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.430847 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.430971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.431086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.431199 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.431349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.432625 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.432777 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.433036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.433189 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.433538 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.433700 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.433873 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.434112 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.434296 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.434450 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.434623 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.434801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.434801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.434801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.434801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.434801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.434801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.434801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.434801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.434801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.436175 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.436365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.436518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.436518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.436858 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.437034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.437034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.437332 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.437488 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.437488 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.437743 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.437885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.437885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.438115 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.438264 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.438264 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.438481 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.438595 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.438708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.438830 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.438988 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.439115 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.439240 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.439356 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.439470 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.439583 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.439704 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.439820 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.439820 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.440033 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.440148 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.440148 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.440401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.440517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.440631 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.440745 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.440895 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.441013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.441013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.441238 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.441392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.441392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.441615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.441731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.441853 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.441975 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.441975 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.442197 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.442311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.442311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.443050 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.443198 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.443328 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.443519 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.443519 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.443904 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.444062 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.444183 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.444306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.444306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.444523 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.444646 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.444646 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.444908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.445027 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.445141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.445255 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.445255 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.445471 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.445593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.external = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.445593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.445817 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.445931 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.445931 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.446146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.446273 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.password = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.446390 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.446505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.token = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.446505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.446718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.446831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.446831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.447055 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.447170 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.447170 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.447390 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.447506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.447506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.447730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.447845 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.447959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.448073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.448073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.448299 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.448415 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.448415 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.448666 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.448666 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.448947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.449063 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.449181 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.449309 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.449427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.449427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.449843 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.449963 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.449963 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.450190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.450308 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.450422 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.450536 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.450536 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.450751 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.450877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.450877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.451101 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.451216 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.451216 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.451496 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.451616 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.451616 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.451846 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.451963 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.452084 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.452209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.452209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.452427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] auth.external = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.452541 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.452541 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.452757 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.452958 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.452958 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.453179 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.453294 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.453294 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.453516 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.453640 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.453640 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.453954 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] auth.password = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.454072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.454187 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] auth.token = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.454302 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.454302 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.454533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.454650 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.454650 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.454866 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.454980 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.454980 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.455205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.455320 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.455434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.455547 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.455547 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.455780 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.455898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.455898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.456122 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.456241 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.456241 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.456476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.456592 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.456714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] credential.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.456868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.456868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.457087 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.457216 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.457216 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.457432 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.457548 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.457548 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.457774 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.457965 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.458148 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.458813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.458813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.459119 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.459252 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.459252 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.459481 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.459597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.459597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.459811 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.459926 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.459926 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.460152 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.460267 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.460267 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.460490 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.460605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.460729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.460871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.460871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.460871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.461191 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.461306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.461430 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.461582 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.461700 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.461815 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.461931 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.462055 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.462055 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.462273 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.462388 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.462388 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.462603 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] federation.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.462726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.462843 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.462957 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.462957 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.463172 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.463296 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.463296 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.463523 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.463639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.463639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.463854 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.463968 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.463968 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.464194 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.464311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.464426 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.464541 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.464541 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.464764 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.464896 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.464896 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.465113 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.465238 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.465238 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.465466 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.465589 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.465589 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.465805 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.465919 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.465919 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.466156 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.466278 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.466278 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.466496 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.466611 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.466611 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.466841 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.466958 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.467073 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.467187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.467187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.467409 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.467573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.467573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.467792 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.467908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.467908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.468123 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.468247 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.468409 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.468533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.468533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.468750 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.469037 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.469037 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.469275 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.469391 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.469391 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.469615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.469730 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.469852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.469968 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.469968 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.470183 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.470297 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.470297 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.470520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.470643 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.470643 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.470859 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.470974 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.471094 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.471220 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.471337 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.471518 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.471674 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.471792 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.471933 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.472071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.472224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.472344 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.472461 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] role.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.472694 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] role.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.472833 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.472965 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.473141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.473261 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.473432 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.473550 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.473704 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.473901 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.474064 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.474257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.474539 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.474666 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.474797 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.474936 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.475055 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.475292 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.475415 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.475532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.475685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.475807 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.476011 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.476129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.476245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.476416 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.476546 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.476774 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.477006 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.477165 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.477285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.477400 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.477571 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.477692 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.477900 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.478022 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.478138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.478343 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.478471 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.478588 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.478727 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.478846 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.479055 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.479173 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.479297 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.479461 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.479579 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.479720 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.479837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.479953 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.480190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.480311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.480426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.480589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.480708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.480909 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.481065 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.481187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.481366 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.481484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.481599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.481832 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.481963 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.482081 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.482247 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.482367 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.482534 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.482653 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.482777 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.482955 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.483074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.483234 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.483374 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.483494 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.483704 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.483825 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.483941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.484111 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.484232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.484391 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.484517 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.484634 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.484856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.484981 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.485097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.485256 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.485389 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.485608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.485728 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.connection = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.485853 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.486024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.486145 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.486312 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.486439 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.486556 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.486751 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.486871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.486985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.487167 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.487296 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.487414 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.487572 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.487691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.487881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.487999 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.488126 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.488284 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.488408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.488574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.488692 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.488822 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.489047 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.489168 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.489776 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.489960 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.490080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.490304 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.490479 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.490679 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.490895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 04:51:18.491012 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.491287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.491597 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.491903 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.492189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.492512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.492829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.493132 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.493432 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.493734 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.494039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.494343 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.494896 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.495215 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.495507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.496078 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.496391 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.496692 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.497015 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.497334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.497637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.497932 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.498231 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.498536 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] resource.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.498848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.499158 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.499466 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.499774 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.500100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.500399 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.500707 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.501032 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.501348 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.501650 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] role.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.501960 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] role.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.502253 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.502565 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.502887 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.503202 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.503514 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.503824 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.504133 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.504444 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.504756 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.505116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.505423 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.505749 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.506061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.506373 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.506897 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.507193 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.507506 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.507819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.508130 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.508441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.508742 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.509081 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.509405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.509707 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.510016 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.510311 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.510604 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.510915 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.511233 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.511544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.511845 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.512141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.512434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.512735 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] token.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.513053 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.513361 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.513660 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.513991 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.514302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.514604 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.514912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.515217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.515525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.515826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.516127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.516425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.516732 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.517079 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.517371 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.517677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.518033 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.518410 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.connection = **** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.518710 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.519018 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.519329 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.519631 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.519931 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.520232 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.521085 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.521362 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.521943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.521943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.522248 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.522547 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.522858 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.523170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.523326 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.523478 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.523600 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.523717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.523898 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.524201 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.524498 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 04:51:18.524733 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 04:51:18.532240 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.551017 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.551339 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.551568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.560773 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.561800 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.562034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.579731 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.579956 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.618062 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.620050 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.668637 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.668963 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.670575 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.670814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.735202 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.735490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.735658 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.735801 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.735942 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.736076 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.736210 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.736354 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.736503 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.736637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.736637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.736932 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.763418 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.763694 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.763844 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.764030 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.764167 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.764301 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.764453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.764604 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.764738 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.764909 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.765045 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.765201 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.765340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.765473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.776621 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.776918 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.789635 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.789954 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.790132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.790280 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.790490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.790613 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.790751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.790872 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.790991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.791108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.791226 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.791426 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.791637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.791847 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80022) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 27 04:51:18.809124 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.809331 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 04:51:18.809473 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.809667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.809790 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 04:51:18.809907 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 04:51:18.810024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.810141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.810267 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 27 04:51:18.810387 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.810503 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.810620 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.810736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.810861 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.810979 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.811145 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.821742 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.821883 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.822003 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.822136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.822257 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.822374 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.822529 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.822654 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.830607 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.830739 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.834437 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.834712 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.834836 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.834971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.835091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.835252 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.835380 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.835529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.835653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.835780 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.835898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.836040 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.836164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.836307 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.836437 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.836558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.836673 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.836840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.836966 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.837096 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.837215 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.837364 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.863404 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.864010 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.865042 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.865321 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.865985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.866263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.870895 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.871120 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.871395 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.871772 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.872045 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.872319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.878503 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.878781 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.879442 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.879722 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.883730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.884022 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.884300 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.884577 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.884868 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.884995 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.885140 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.885263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.885393 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.885512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.885765 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.885887 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.886013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.886278 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.886540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.886913 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.905042 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.905321 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.906174 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.906450 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.909784 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.910918 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.913610 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.913901 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.914916 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.915207 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.918888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.920132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.922432 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.923660 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.926011 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.926303 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.926584 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.926981 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.927290 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.927557 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.927736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.927859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.928140 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.928440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.928717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.929087 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.948574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.948881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.949146 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.949403 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.949699 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.950057 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.950476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.950721 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.957079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.959152 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.959857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.960130 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.961193 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.961533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.963128 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.963420 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.963699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.963985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.964257 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.964917 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.965291 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.965663 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.966010 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.966351 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.978964 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.979250 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.979526 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.979801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.980077 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.980368 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.980638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.981640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:18.982001 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.982349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.982696 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.983044 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.983405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.983754 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:18.998831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:19.001967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:19.002110 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:19.005908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:19.110335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.111923 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.112821 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.113549 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:19.113825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.114102 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.114993 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.116608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:19.116915 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.117196 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.122561 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.124086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:19.124687 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.126319 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:19.129326 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.129625 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.129723 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.129955 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.130050 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.130288 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.130373 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.130561 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.139437 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:19.139535 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:19.139729 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.139815 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.140013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.140099 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.147941 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80022) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:19.148034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 27 04:51:19.148223 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.148310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.148504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.148605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.148778 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.148889 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.149079 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.149165 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.149351 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.149450 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.149641 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.149738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.149908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.150042 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.150181 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.150263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.150435 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.150520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.150707 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.150791 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.150971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.151132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.151297 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.151443 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.151524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80022) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.151699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 27 04:51:19.194327 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55827b2639c0 pid: 80022 (default app) Sep 27 04:51:19.194574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55827b2639c0 pid: 80021 (default app) Sep 27 04:51:19.194679 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cb564-2875-458f-ba87-a6a538485ca4 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:19.194679 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cb564-2875-458f-ba87-a6a538485ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:19.194679 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cb564-2875-458f-ba87-a6a538485ca4 None None] PATH_INFO: `/v3` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:19.199621 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Tue Sep 27 04:51:19 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:27.596595 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b86f1-24cb-4067-b951-6cea93f9a15e None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:27.597526 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b86f1-24cb-4067-b951-6cea93f9a15e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:27.597526 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b86f1-24cb-4067-b951-6cea93f9a15e None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:27.604543 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:27 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:51:27.610423 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fff59b-4482-42e2-bc14-2efefba93b4b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:27.610874 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fff59b-4482-42e2-bc14-2efefba93b4b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:27.610965 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fff59b-4482-42e2-bc14-2efefba93b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:27.646854 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG oslo_db.sqlalchemy.engines [None req-19fff59b-4482-42e2-bc14-2efefba93b4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 04:51:27.840086 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG passlib.handlers.bcrypt [None req-19fff59b-4482-42e2-bc14-2efefba93b4b None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80022) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 27 04:51:27.840500 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG passlib.handlers.bcrypt [None req-19fff59b-4482-42e2-bc14-2efefba93b4b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80022) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 27 04:51:27.898168 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-19fff59b-4482-42e2-bc14-2efefba93b4b None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:27.899779 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-19fff59b-4482-42e2-bc14-2efefba93b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:28.029394 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 27 04:51:28.184320 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b86f1-24cb-4067-b951-6cea93f9a15e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:28.218765 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG oslo_db.sqlalchemy.engines [None req-625b86f1-24cb-4067-b951-6cea93f9a15e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 04:51:28.348383 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b86f1-24cb-4067-b951-6cea93f9a15e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:28.352929 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ed491-8c4b-44e6-b7cf-9f4d61b20165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:28.353590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ed491-8c4b-44e6-b7cf-9f4d61b20165 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:28.353870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ed491-8c4b-44e6-b7cf-9f4d61b20165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:28.354143 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ed491-8c4b-44e6-b7cf-9f4d61b20165 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:28.362942 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ed491-8c4b-44e6-b7cf-9f4d61b20165 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:28.414760 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.common.rbac_enforcer.enforcer [None req-378ed491-8c4b-44e6-b7cf-9f4d61b20165 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 27 04:51:28.415104 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ed491-8c4b-44e6-b7cf-9f4d61b20165 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:28.426121 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Tue Sep 27 04:51:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 27 04:51:28.432969 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fff59b-4482-42e2-bc14-2efefba93b4b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:28.447827 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fff59b-4482-42e2-bc14-2efefba93b4b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:28.452146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae82ffd-ad5f-4351-9934-1b056f6602e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:28.453285 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae82ffd-ad5f-4351-9934-1b056f6602e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:28.453566 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae82ffd-ad5f-4351-9934-1b056f6602e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:28.453836 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae82ffd-ad5f-4351-9934-1b056f6602e2 admin admin] PATH_INFO: `/v3/projects/c063435f154b48b086fd2d4eed2a41ea` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:28.455357 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae82ffd-ad5f-4351-9934-1b056f6602e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=c063435f154b48b086fd2d4eed2a41ea)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:28.509406 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.common.rbac_enforcer.enforcer [None req-eae82ffd-ad5f-4351-9934-1b056f6602e2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 27 04:51:28.509747 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae82ffd-ad5f-4351-9934-1b056f6602e2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:28.514824 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Tue Sep 27 04:51:28 2022] GET /identity/v3/projects/c063435f154b48b086fd2d4eed2a41ea => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:51:30.901858 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53e7fa-99d0-4198-8d4d-24a821f89fa0 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:30.902409 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53e7fa-99d0-4198-8d4d-24a821f89fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:30.902409 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53e7fa-99d0-4198-8d4d-24a821f89fa0 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:30.907035 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:51:30.913825 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdb147-0e79-4123-a152-d164443d67d9 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:30.914360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdb147-0e79-4123-a152-d164443d67d9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:30.914360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdb147-0e79-4123-a152-d164443d67d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:30.935008 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7afdb147-0e79-4123-a152-d164443d67d9 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:30.936564 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7afdb147-0e79-4123-a152-d164443d67d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:30.944673 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 27 04:51:30.967692 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53e7fa-99d0-4198-8d4d-24a821f89fa0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:30.981793 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53e7fa-99d0-4198-8d4d-24a821f89fa0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:30.986046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d403f04-9d2c-48f7-b872-fe7bd5422365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:30.986743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d403f04-9d2c-48f7-b872-fe7bd5422365 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:30.987032 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d403f04-9d2c-48f7-b872-fe7bd5422365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:30.987313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d403f04-9d2c-48f7-b872-fe7bd5422365 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:30.996675 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d403f04-9d2c-48f7-b872-fe7bd5422365 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:30.998522 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d403f04-9d2c-48f7-b872-fe7bd5422365 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:31.007567 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Tue Sep 27 04:51:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:51:31.014093 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdb147-0e79-4123-a152-d164443d67d9 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:31.023882 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdb147-0e79-4123-a152-d164443d67d9 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:31.028604 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55302ef4-f110-4d72-abb8-c15e8fbee1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:31.029538 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55302ef4-f110-4d72-abb8-c15e8fbee1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:31.029825 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55302ef4-f110-4d72-abb8-c15e8fbee1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:31.030103 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55302ef4-f110-4d72-abb8-c15e8fbee1a9 admin admin] PATH_INFO: `/v3/users/5a0a331b12764488a1a2fd987b375820` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:31.031528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55302ef4-f110-4d72-abb8-c15e8fbee1a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=5a0a331b12764488a1a2fd987b375820)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:31.033443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55302ef4-f110-4d72-abb8-c15e8fbee1a9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:31.035038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Tue Sep 27 04:51:31 2022] GET /identity/v3/users/5a0a331b12764488a1a2fd987b375820 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:33.420427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c07f0c-25f5-4bcb-8bc5-cf61794df2d0 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:33.420958 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c07f0c-25f5-4bcb-8bc5-cf61794df2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:33.421059 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c07f0c-25f5-4bcb-8bc5-cf61794df2d0 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:33.422785 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:33.428663 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34956ddf-e254-454a-8b51-8baf89e0376d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:33.429078 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34956ddf-e254-454a-8b51-8baf89e0376d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:33.429458 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34956ddf-e254-454a-8b51-8baf89e0376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:33.446137 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-34956ddf-e254-454a-8b51-8baf89e0376d None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:33.447315 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-34956ddf-e254-454a-8b51-8baf89e0376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:33.449726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e918-b559-451c-97c8-2c98950d031a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:33.450023 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e918-b559-451c-97c8-2c98950d031a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:33.450304 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e918-b559-451c-97c8-2c98950d031a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:33.452026 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:51:33.457071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f5f6b-3ab2-49db-8830-c5017bb99699 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:33.457364 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f5f6b-3ab2-49db-8830-c5017bb99699 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:33.458270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f5f6b-3ab2-49db-8830-c5017bb99699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:33.499360 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG passlib.handlers.bcrypt [None req-838f5f6b-3ab2-49db-8830-c5017bb99699 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80021) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 27 04:51:33.499790 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG passlib.handlers.bcrypt [None req-838f5f6b-3ab2-49db-8830-c5017bb99699 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80021) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 27 04:51:33.526069 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:33.546708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-838f5f6b-3ab2-49db-8830-c5017bb99699 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:33.548304 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-838f5f6b-3ab2-49db-8830-c5017bb99699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:33.549437 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34956ddf-e254-454a-8b51-8baf89e0376d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:33.644484 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:51:33.646204 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34956ddf-e254-454a-8b51-8baf89e0376d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:33.667634 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f5f6b-3ab2-49db-8830-c5017bb99699 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:33.679342 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61eaad-4d6a-4694-8db0-62af76b85cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:33.680068 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61eaad-4d6a-4694-8db0-62af76b85cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:33.680346 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61eaad-4d6a-4694-8db0-62af76b85cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:33.680617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61eaad-4d6a-4694-8db0-62af76b85cf0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:33.691295 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61eaad-4d6a-4694-8db0-62af76b85cf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:51:33.698502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-1f61eaad-4d6a-4694-8db0-62af76b85cf0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:51:33.699906 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:51:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:51:33.705363 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61eaad-4d6a-4694-8db0-62af76b85cf0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:33.763063 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f5f6b-3ab2-49db-8830-c5017bb99699 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:33.795404 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3dfbb-98a9-406d-90aa-47de35452a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:33.796300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3dfbb-98a9-406d-90aa-47de35452a50 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:33.796590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3dfbb-98a9-406d-90aa-47de35452a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:33.796896 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3dfbb-98a9-406d-90aa-47de35452a50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:33.799837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61eaad-4d6a-4694-8db0-62af76b85cf0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:33.834335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c728d2-ad2a-4e31-99dc-0103838eeb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:33.834991 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c728d2-ad2a-4e31-99dc-0103838eeb35 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:33.835269 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c728d2-ad2a-4e31-99dc-0103838eeb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:33.835544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c728d2-ad2a-4e31-99dc-0103838eeb35 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:33.836281 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c728d2-ad2a-4e31-99dc-0103838eeb35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:33.836584 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c728d2-ad2a-4e31-99dc-0103838eeb35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:33.837992 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c728d2-ad2a-4e31-99dc-0103838eeb35 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:33.850050 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:51:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:51:33.855456 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c728d2-ad2a-4e31-99dc-0103838eeb35 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:33.863596 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3dfbb-98a9-406d-90aa-47de35452a50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:33.865447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3dfbb-98a9-406d-90aa-47de35452a50 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:33.949467 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c728d2-ad2a-4e31-99dc-0103838eeb35 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:33.958863 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:51:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 04:51:33.965182 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3dfbb-98a9-406d-90aa-47de35452a50 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:33.981816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a47270-2914-4587-9dd8-a666cc3806b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:33.982690 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a47270-2914-4587-9dd8-a666cc3806b3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:33.982971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a47270-2914-4587-9dd8-a666cc3806b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:33.983240 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a47270-2914-4587-9dd8-a666cc3806b3 None admin] PATH_INFO: `/v3/users/5a0a331b12764488a1a2fd987b375820` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:33.984448 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a47270-2914-4587-9dd8-a666cc3806b3 None admin] RBAC: Authorizing `identity:get_user(user_id=5a0a331b12764488a1a2fd987b375820)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:33.985957 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a47270-2914-4587-9dd8-a666cc3806b3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:33.987707 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:51:33 2022] GET /identity/v3/users/5a0a331b12764488a1a2fd987b375820 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:51:33.993662 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a47270-2914-4587-9dd8-a666cc3806b3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:34.059418 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3dfbb-98a9-406d-90aa-47de35452a50 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:34.086305 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a47270-2914-4587-9dd8-a666cc3806b3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:34.090998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0a06a-2dcc-4f24-8078-a06e24a4bfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:34.091816 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0a06a-2dcc-4f24-8078-a06e24a4bfac None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:34.092093 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0a06a-2dcc-4f24-8078-a06e24a4bfac None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:34.092360 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0a06a-2dcc-4f24-8078-a06e24a4bfac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:34.110834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0a06a-2dcc-4f24-8078-a06e24a4bfac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:34.112301 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0a06a-2dcc-4f24-8078-a06e24a4bfac None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:34.119304 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09587800-8c39-4d60-9f55-e578babba68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:34.120351 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09587800-8c39-4d60-9f55-e578babba68c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:34.120632 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09587800-8c39-4d60-9f55-e578babba68c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:34.120942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09587800-8c39-4d60-9f55-e578babba68c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:34.122127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09587800-8c39-4d60-9f55-e578babba68c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:34.123652 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09587800-8c39-4d60-9f55-e578babba68c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:34.125298 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:51:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:51:34.130667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-eca0a06a-2dcc-4f24-8078-a06e24a4bfac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:51:34.130991 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09587800-8c39-4d60-9f55-e578babba68c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:34.131868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:51:34.137375 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0a06a-2dcc-4f24-8078-a06e24a4bfac None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:34.225658 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09587800-8c39-4d60-9f55-e578babba68c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:34.233891 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0a06a-2dcc-4f24-8078-a06e24a4bfac None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:34.257944 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b29559-00fd-4022-bfeb-939fb5beae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:34.258587 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b29559-00fd-4022-bfeb-939fb5beae67 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:34.258868 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b29559-00fd-4022-bfeb-939fb5beae67 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:34.259144 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b29559-00fd-4022-bfeb-939fb5beae67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:34.259967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b29559-00fd-4022-bfeb-939fb5beae67 None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.domain.id=default, user.id=5a0a331b12764488a1a2fd987b375820) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:34.260276 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b29559-00fd-4022-bfeb-939fb5beae67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:34.261785 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b29559-00fd-4022-bfeb-939fb5beae67 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:34.266066 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418dab0a-b459-4da6-b45e-3c86f9fbcd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:34.266717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dab0a-b459-4da6-b45e-3c86f9fbcd51 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:34.266999 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dab0a-b459-4da6-b45e-3c86f9fbcd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:34.267271 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dab0a-b459-4da6-b45e-3c86f9fbcd51 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:34.267985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dab0a-b459-4da6-b45e-3c86f9fbcd51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:34.268235 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Tue Sep 27 04:51:34 2022] GET /identity/v3/role_assignments?user.id=5a0a331b12764488a1a2fd987b375820&scope.domain.id=default&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 233 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:51:34.268356 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dab0a-b459-4da6-b45e-3c86f9fbcd51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:34.269825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dab0a-b459-4da6-b45e-3c86f9fbcd51 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:34.289939 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:51:37.217926 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a339eb1-de57-4b4a-be68-9b9c1430b38a None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:37.217926 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a339eb1-de57-4b4a-be68-9b9c1430b38a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:37.217926 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a339eb1-de57-4b4a-be68-9b9c1430b38a None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:37.217926 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:37.223178 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb60c9-622d-412d-ae64-72c3aa299053 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:37.224009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb60c9-622d-412d-ae64-72c3aa299053 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:37.224481 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb60c9-622d-412d-ae64-72c3aa299053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:37.249882 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3dcb60c9-622d-412d-ae64-72c3aa299053 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:37.251372 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3dcb60c9-622d-412d-ae64-72c3aa299053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:37.333734 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 11/23] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:37.367891 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a339eb1-de57-4b4a-be68-9b9c1430b38a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:37.478743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8bc0d-d392-4fff-b034-03672e9c9dbe None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:37.479367 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8bc0d-d392-4fff-b034-03672e9c9dbe None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:37.479868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8bc0d-d392-4fff-b034-03672e9c9dbe None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:37.481848 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:37.487172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982a297-ce40-42e7-90f4-a961661f1e67 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:37.487691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982a297-ce40-42e7-90f4-a961661f1e67 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:37.488161 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982a297-ce40-42e7-90f4-a961661f1e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:37.507899 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a339eb1-de57-4b4a-be68-9b9c1430b38a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:37.521506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5982a297-ce40-42e7-90f4-a961661f1e67 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:37.527011 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5982a297-ce40-42e7-90f4-a961661f1e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:37.575342 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938ad5b-3aa3-4f30-a077-613783307cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:37.576522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938ad5b-3aa3-4f30-a077-613783307cba None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:37.577070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938ad5b-3aa3-4f30-a077-613783307cba None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:37.577542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938ad5b-3aa3-4f30-a077-613783307cba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:37.597619 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938ad5b-3aa3-4f30-a077-613783307cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:51:37.613426 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-9938ad5b-3aa3-4f30-a077-613783307cba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:51:37.615097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 13/25] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:51:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:51:37.622210 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938ad5b-3aa3-4f30-a077-613783307cba None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:37.662554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 13/26] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:51:37.663907 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c328cf5-8b96-44dd-b01f-45ca1f819204 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:37.664200 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c328cf5-8b96-44dd-b01f-45ca1f819204 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:37.664484 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c328cf5-8b96-44dd-b01f-45ca1f819204 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:37.666537 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 14/27] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:37.674193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d10a5-6d06-4e63-bbb1-e101a305fd9e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:37.674667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d10a5-6d06-4e63-bbb1-e101a305fd9e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:37.675118 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d10a5-6d06-4e63-bbb1-e101a305fd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:37.702942 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-200d10a5-6d06-4e63-bbb1-e101a305fd9e None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:37.704430 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-200d10a5-6d06-4e63-bbb1-e101a305fd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:37.737097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938ad5b-3aa3-4f30-a077-613783307cba None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:37.781615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce49e24-e23b-4d26-b75c-357a185d6bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:37.782218 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce49e24-e23b-4d26-b75c-357a185d6bbb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:37.782505 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce49e24-e23b-4d26-b75c-357a185d6bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:37.782788 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce49e24-e23b-4d26-b75c-357a185d6bbb None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:37.783549 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce49e24-e23b-4d26-b75c-357a185d6bbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:37.783859 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce49e24-e23b-4d26-b75c-357a185d6bbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:37.785298 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce49e24-e23b-4d26-b75c-357a185d6bbb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:37.800576 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 14/28] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:51:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:51:37.801219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce49e24-e23b-4d26-b75c-357a185d6bbb None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:37.809091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 15/29] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:37.809940 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d10a5-6d06-4e63-bbb1-e101a305fd9e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:37.939646 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce49e24-e23b-4d26-b75c-357a185d6bbb None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:37.994522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191ea5b-5124-4885-8dfd-2824e0f604d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:37.995477 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191ea5b-5124-4885-8dfd-2824e0f604d9 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:37.995761 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191ea5b-5124-4885-8dfd-2824e0f604d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:37.996038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191ea5b-5124-4885-8dfd-2824e0f604d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:37.996820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191ea5b-5124-4885-8dfd-2824e0f604d9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:37.998221 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191ea5b-5124-4885-8dfd-2824e0f604d9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:38.023499 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d10a5-6d06-4e63-bbb1-e101a305fd9e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:38.088352 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c5d12-5cc8-434e-955f-3362103a4196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:38.089182 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c5d12-5cc8-434e-955f-3362103a4196 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:38.089464 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c5d12-5cc8-434e-955f-3362103a4196 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:38.089737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c5d12-5cc8-434e-955f-3362103a4196 None admin] PATH_INFO: `/v3/users/5a0a331b12764488a1a2fd987b375820` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:38.091319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c5d12-5cc8-434e-955f-3362103a4196 None admin] RBAC: Authorizing `identity:get_user(user_id=5a0a331b12764488a1a2fd987b375820)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:38.092781 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c5d12-5cc8-434e-955f-3362103a4196 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:38.094612 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 16/30] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:51:37 2022] GET /identity/v3/users/5a0a331b12764488a1a2fd987b375820 => generated 247 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:38.097308 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c5d12-5cc8-434e-955f-3362103a4196 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:38.187479 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 15/31] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Sep 27 04:51:37 2022] POST /identity/v3/roles => generated 219 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:51:38.188510 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191ea5b-5124-4885-8dfd-2824e0f604d9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:38.223803 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c5d12-5cc8-434e-955f-3362103a4196 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:38.265152 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2f12a-eb55-42bf-a335-8104ca9e5ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:38.266327 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2f12a-eb55-42bf-a335-8104ca9e5ecb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:38.266818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2f12a-eb55-42bf-a335-8104ca9e5ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:38.267289 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2f12a-eb55-42bf-a335-8104ca9e5ecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:38.280730 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2f12a-eb55-42bf-a335-8104ca9e5ecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:38.282654 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2f12a-eb55-42bf-a335-8104ca9e5ecb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:38.304927 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-88b2f12a-eb55-42bf-a335-8104ca9e5ecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:51:38.307040 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 17/32] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:51:38.309017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5a20-363c-4254-a5f3-83cc817ceb91 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:38.309587 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5a20-363c-4254-a5f3-83cc817ceb91 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:38.310083 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5a20-363c-4254-a5f3-83cc817ceb91 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:38.312590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 18/33] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:38.314317 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddcc50-1661-452c-af61-f6bf0d6f48b9 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:38.314837 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddcc50-1661-452c-af61-f6bf0d6f48b9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:38.315314 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddcc50-1661-452c-af61-f6bf0d6f48b9 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:38.318293 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 19/34] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:38.319279 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddcc50-1661-452c-af61-f6bf0d6f48b9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:38.337885 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191ea5b-5124-4885-8dfd-2824e0f604d9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:38.374653 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972e528-77d8-4cd3-a7a1-831a4b613375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:38.375474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972e528-77d8-4cd3-a7a1-831a4b613375 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:38.375758 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972e528-77d8-4cd3-a7a1-831a4b613375 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:38.376036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972e528-77d8-4cd3-a7a1-831a4b613375 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:38.377414 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972e528-77d8-4cd3-a7a1-831a4b613375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:38.379024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972e528-77d8-4cd3-a7a1-831a4b613375 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:38.381504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 16/35] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:51:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:38.382847 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9b391-cb1d-45b2-a6a3-42c89d5091c5 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:38.383446 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9b391-cb1d-45b2-a6a3-42c89d5091c5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:38.383446 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9b391-cb1d-45b2-a6a3-42c89d5091c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:38.404552 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7ef9b391-cb1d-45b2-a6a3-42c89d5091c5 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:38.405056 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7ef9b391-cb1d-45b2-a6a3-42c89d5091c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:38.445405 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddcc50-1661-452c-af61-f6bf0d6f48b9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:38.491660 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135685e2-dc8d-4e22-bff1-c1af58513bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:38.492429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135685e2-dc8d-4e22-bff1-c1af58513bed None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:38.492720 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135685e2-dc8d-4e22-bff1-c1af58513bed None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:38.493054 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135685e2-dc8d-4e22-bff1-c1af58513bed None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:38.493807 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135685e2-dc8d-4e22-bff1-c1af58513bed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:38.494116 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135685e2-dc8d-4e22-bff1-c1af58513bed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:38.494949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 17/36] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:38.495783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135685e2-dc8d-4e22-bff1-c1af58513bed None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:38.496592 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c63bfc-00ba-444c-8f2b-0579dcbec6ed None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:38.497090 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c63bfc-00ba-444c-8f2b-0579dcbec6ed None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:38.497711 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c63bfc-00ba-444c-8f2b-0579dcbec6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:38.511944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 20/37] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:38.513160 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135685e2-dc8d-4e22-bff1-c1af58513bed None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:38.516551 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d6c63bfc-00ba-444c-8f2b-0579dcbec6ed None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:38.517795 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d6c63bfc-00ba-444c-8f2b-0579dcbec6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:38.586676 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 18/38] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:38.593701 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c63bfc-00ba-444c-8f2b-0579dcbec6ed None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:38.622165 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135685e2-dc8d-4e22-bff1-c1af58513bed None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:38.658639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16527b2a-8b60-40f4-a496-5638def7bb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:38.659440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16527b2a-8b60-40f4-a496-5638def7bb79 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:38.659724 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16527b2a-8b60-40f4-a496-5638def7bb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:38.660008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16527b2a-8b60-40f4-a496-5638def7bb79 None admin] PATH_INFO: `/v3/domains/default/users/5a0a331b12764488a1a2fd987b375820/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:38.662600 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16527b2a-8b60-40f4-a496-5638def7bb79 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5a0a331b12764488a1a2fd987b375820, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:38.664059 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16527b2a-8b60-40f4-a496-5638def7bb79 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:38.701428 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c63bfc-00ba-444c-8f2b-0579dcbec6ed None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:38.735069 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab840454-3f71-4faf-8e38-4d320a3ea7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:38.735736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab840454-3f71-4faf-8e38-4d320a3ea7ab None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:38.736020 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab840454-3f71-4faf-8e38-4d320a3ea7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:38.736299 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab840454-3f71-4faf-8e38-4d320a3ea7ab None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:38.737033 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab840454-3f71-4faf-8e38-4d320a3ea7ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:38.738505 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab840454-3f71-4faf-8e38-4d320a3ea7ab None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:38.765754 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 27 04:51:38 2022] POST /identity/v3/projects => generated 301 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:51:38.766559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab840454-3f71-4faf-8e38-4d320a3ea7ab None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:38.804385 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 21/40] 10.222.0.27 () {58 vars in 1361 bytes} [Tue Sep 27 04:51:38 2022] PUT /identity/v3/domains/default/users/5a0a331b12764488a1a2fd987b375820/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:51:38.807198 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16527b2a-8b60-40f4-a496-5638def7bb79 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:38.884247 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab840454-3f71-4faf-8e38-4d320a3ea7ab None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:38.938599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471f999-0e89-448c-bf08-223709ded7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:38.939259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471f999-0e89-448c-bf08-223709ded7d0 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:38.939550 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471f999-0e89-448c-bf08-223709ded7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:38.939831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471f999-0e89-448c-bf08-223709ded7d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:38.940599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471f999-0e89-448c-bf08-223709ded7d0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:38.942427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471f999-0e89-448c-bf08-223709ded7d0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:38.944287 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16527b2a-8b60-40f4-a496-5638def7bb79 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:38.962964 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Sep 27 04:51:38 2022] POST /identity/v3/roles => generated 225 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:51:38.986094 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebe689-a9f8-4114-a699-8a528219f30b None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:38.986533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebe689-a9f8-4114-a699-8a528219f30b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:38.986940 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebe689-a9f8-4114-a699-8a528219f30b None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:38.991161 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 21/42] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:51:38.995916 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b168e0-37af-4f15-b495-fe5bcdb9f75d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:38.996352 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b168e0-37af-4f15-b495-fe5bcdb9f75d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:38.996776 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b168e0-37af-4f15-b495-fe5bcdb9f75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:39.008683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c4624-0279-43b7-9d4d-29f10b9ba1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:39.009739 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c4624-0279-43b7-9d4d-29f10b9ba1c4 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:39.010167 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c4624-0279-43b7-9d4d-29f10b9ba1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:39.010593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c4624-0279-43b7-9d4d-29f10b9ba1c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:39.011524 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c4624-0279-43b7-9d4d-29f10b9ba1c4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:39.013524 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c4624-0279-43b7-9d4d-29f10b9ba1c4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:39.017543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-93b168e0-37af-4f15-b495-fe5bcdb9f75d None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:39.018892 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-93b168e0-37af-4f15-b495-fe5bcdb9f75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:39.038313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 22/43] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Sep 27 04:51:38 2022] POST /identity/v3/roles => generated 223 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:51:39.116631 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 22/44] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:51:39.143480 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c4624-0279-43b7-9d4d-29f10b9ba1c4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:39.266743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c4624-0279-43b7-9d4d-29f10b9ba1c4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:39.301239 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7782d4d-0de8-4c59-b1ce-e2f3affa7288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:39.302096 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7782d4d-0de8-4c59-b1ce-e2f3affa7288 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:39.302380 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7782d4d-0de8-4c59-b1ce-e2f3affa7288 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:39.302657 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7782d4d-0de8-4c59-b1ce-e2f3affa7288 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:39.303944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7782d4d-0de8-4c59-b1ce-e2f3affa7288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:39.305449 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7782d4d-0de8-4c59-b1ce-e2f3affa7288 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:39.307287 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 23/45] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:51:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:39.312669 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b168e0-37af-4f15-b495-fe5bcdb9f75d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:39.408892 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b168e0-37af-4f15-b495-fe5bcdb9f75d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:39.441775 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9a248-bda9-4e8f-8a22-15c5dc37220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:39.442459 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9a248-bda9-4e8f-8a22-15c5dc37220e None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:39.442884 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9a248-bda9-4e8f-8a22-15c5dc37220e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:39.443163 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9a248-bda9-4e8f-8a22-15c5dc37220e None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:39.443883 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9a248-bda9-4e8f-8a22-15c5dc37220e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:39.445415 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9a248-bda9-4e8f-8a22-15c5dc37220e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:39.469600 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 23/46] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 27 04:51:39 2022] POST /identity/v3/projects => generated 312 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:51:41.352094 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d54d03-8883-4cbd-bb6e-f6c69f8bd958 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:41.352577 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d54d03-8883-4cbd-bb6e-f6c69f8bd958 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:41.352577 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d54d03-8883-4cbd-bb6e-f6c69f8bd958 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:41.354408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 24/47] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:41.359809 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11172-2489-4551-86ed-bf2bf66a5504 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:41.360218 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11172-2489-4551-86ed-bf2bf66a5504 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:41.360369 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11172-2489-4551-86ed-bf2bf66a5504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:41.377889 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-18e11172-2489-4551-86ed-bf2bf66a5504 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:41.379060 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-18e11172-2489-4551-86ed-bf2bf66a5504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:41.442520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 24/48] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:41.466278 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d54d03-8883-4cbd-bb6e-f6c69f8bd958 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:41.566093 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d54d03-8883-4cbd-bb6e-f6c69f8bd958 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:41.597411 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c927048-bc47-4cab-94d3-ad749cda639f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:41.598840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c927048-bc47-4cab-94d3-ad749cda639f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:41.599132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c927048-bc47-4cab-94d3-ad749cda639f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:41.599408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c927048-bc47-4cab-94d3-ad749cda639f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:41.610636 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c927048-bc47-4cab-94d3-ad749cda639f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:51:41.618146 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-4c927048-bc47-4cab-94d3-ad749cda639f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:51:41.619344 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 25/49] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:51:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:51:41.625481 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e11172-2489-4551-86ed-bf2bf66a5504 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:41.719474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e11172-2489-4551-86ed-bf2bf66a5504 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:41.752837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c56f1-2558-4343-9ffc-1f62aa824299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:41.753502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c56f1-2558-4343-9ffc-1f62aa824299 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:41.753786 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c56f1-2558-4343-9ffc-1f62aa824299 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:41.754066 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c56f1-2558-4343-9ffc-1f62aa824299 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:41.755441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c56f1-2558-4343-9ffc-1f62aa824299 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:41.755748 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c56f1-2558-4343-9ffc-1f62aa824299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:41.757151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c56f1-2558-4343-9ffc-1f62aa824299 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:41.765228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 25/50] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:51:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:41.770802 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c927048-bc47-4cab-94d3-ad749cda639f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:41.819507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664ef32-f3d8-48f0-9913-101e176f22c3 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:41.819794 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664ef32-f3d8-48f0-9913-101e176f22c3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:41.820079 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664ef32-f3d8-48f0-9913-101e176f22c3 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:41.822089 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 26/51] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:41.826667 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890c494-7fb7-4248-a4d6-cd67f3b181ce None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:41.826955 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890c494-7fb7-4248-a4d6-cd67f3b181ce None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:41.827236 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890c494-7fb7-4248-a4d6-cd67f3b181ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:41.844094 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8890c494-7fb7-4248-a4d6-cd67f3b181ce None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:41.845303 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8890c494-7fb7-4248-a4d6-cd67f3b181ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:41.867197 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c927048-bc47-4cab-94d3-ad749cda639f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:41.899034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54f88f-4512-49cc-b2c8-c37c230e1329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:41.899900 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54f88f-4512-49cc-b2c8-c37c230e1329 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:41.900185 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54f88f-4512-49cc-b2c8-c37c230e1329 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:41.900471 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54f88f-4512-49cc-b2c8-c37c230e1329 None admin] PATH_INFO: `/v3/users/5a0a331b12764488a1a2fd987b375820` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:41.901686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54f88f-4512-49cc-b2c8-c37c230e1329 None admin] RBAC: Authorizing `identity:get_user(user_id=5a0a331b12764488a1a2fd987b375820)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:41.903153 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54f88f-4512-49cc-b2c8-c37c230e1329 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:41.904763 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 26/52] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:51:41 2022] GET /identity/v3/users/5a0a331b12764488a1a2fd987b375820 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:41.909257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 27/53] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:51:41.910145 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54f88f-4512-49cc-b2c8-c37c230e1329 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:41.932568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890c494-7fb7-4248-a4d6-cd67f3b181ce None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:42.007112 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54f88f-4512-49cc-b2c8-c37c230e1329 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:42.028841 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890c494-7fb7-4248-a4d6-cd67f3b181ce None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:42.039668 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751dbf5-ab9b-4265-be63-c40051ddab07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:42.040459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751dbf5-ab9b-4265-be63-c40051ddab07 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:42.040737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751dbf5-ab9b-4265-be63-c40051ddab07 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:42.041037 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751dbf5-ab9b-4265-be63-c40051ddab07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:42.042209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751dbf5-ab9b-4265-be63-c40051ddab07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:42.043661 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751dbf5-ab9b-4265-be63-c40051ddab07 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:42.045276 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 27/54] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:51:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:51:42.050879 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751dbf5-ab9b-4265-be63-c40051ddab07 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:42.061422 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e1985-aabd-4bef-812c-d44759d873ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:42.062212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e1985-aabd-4bef-812c-d44759d873ff None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:42.062499 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e1985-aabd-4bef-812c-d44759d873ff None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:42.062772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e1985-aabd-4bef-812c-d44759d873ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:42.063948 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e1985-aabd-4bef-812c-d44759d873ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:42.065430 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e1985-aabd-4bef-812c-d44759d873ff None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:42.067373 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 28/55] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:51:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:51:42.072628 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e1985-aabd-4bef-812c-d44759d873ff None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:42.144571 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751dbf5-ab9b-4265-be63-c40051ddab07 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:42.165282 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e1985-aabd-4bef-812c-d44759d873ff None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:42.177715 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e169b5-02e3-4450-99b6-04714b81f187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:42.178378 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e169b5-02e3-4450-99b6-04714b81f187 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:42.178660 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e169b5-02e3-4450-99b6-04714b81f187 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:42.178934 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e169b5-02e3-4450-99b6-04714b81f187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:42.179758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e169b5-02e3-4450-99b6-04714b81f187 None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.domain.id=default, user.id=5a0a331b12764488a1a2fd987b375820) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:42.180067 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e169b5-02e3-4450-99b6-04714b81f187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:42.181546 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e169b5-02e3-4450-99b6-04714b81f187 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:42.189418 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 28/56] 10.222.0.27 () {56 vars in 1322 bytes} [Tue Sep 27 04:51:42 2022] GET /identity/v3/role_assignments?user.id=5a0a331b12764488a1a2fd987b375820&scope.domain.id=default&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:51:42.198533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9c2cf-f5c4-48a5-9bfa-ef77bd23de1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:42.199211 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9c2cf-f5c4-48a5-9bfa-ef77bd23de1f None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:42.199491 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9c2cf-f5c4-48a5-9bfa-ef77bd23de1f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:42.199763 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9c2cf-f5c4-48a5-9bfa-ef77bd23de1f None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:42.200487 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9c2cf-f5c4-48a5-9bfa-ef77bd23de1f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:42.202175 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9c2cf-f5c4-48a5-9bfa-ef77bd23de1f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:42.231564 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 29/57] 10.222.0.27 () {60 vars in 1140 bytes} [Tue Sep 27 04:51:42 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:51:44.583876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e5b13-5f51-41e3-8e26-3196f54d36b2 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:44.584382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e5b13-5f51-41e3-8e26-3196f54d36b2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:44.584464 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e5b13-5f51-41e3-8e26-3196f54d36b2 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:44.586267 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 29/58] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:44.591299 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64213589-8b12-462b-b3de-689c2b6bfde0 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:44.591659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64213589-8b12-462b-b3de-689c2b6bfde0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:44.591858 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64213589-8b12-462b-b3de-689c2b6bfde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:44.608196 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-64213589-8b12-462b-b3de-689c2b6bfde0 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:44.609389 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-64213589-8b12-462b-b3de-689c2b6bfde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:44.671643 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 30/59] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:44.696210 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e5b13-5f51-41e3-8e26-3196f54d36b2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:44.794350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e5b13-5f51-41e3-8e26-3196f54d36b2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:44.832026 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b64bf-7f9a-4277-b3cb-a8efe5326e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:44.832871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b64bf-7f9a-4277-b3cb-a8efe5326e8b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:44.833154 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b64bf-7f9a-4277-b3cb-a8efe5326e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:44.833433 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b64bf-7f9a-4277-b3cb-a8efe5326e8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:44.834658 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b64bf-7f9a-4277-b3cb-a8efe5326e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:44.836079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b64bf-7f9a-4277-b3cb-a8efe5326e8b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:44.837710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 30/60] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:51:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:44.843239 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64213589-8b12-462b-b3de-689c2b6bfde0 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:44.937040 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64213589-8b12-462b-b3de-689c2b6bfde0 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:44.969672 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5456b0-c01d-4167-8253-65ebeaf824b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:44.970328 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5456b0-c01d-4167-8253-65ebeaf824b9 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:44.970614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5456b0-c01d-4167-8253-65ebeaf824b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:44.970891 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5456b0-c01d-4167-8253-65ebeaf824b9 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:44.971601 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5456b0-c01d-4167-8253-65ebeaf824b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:44.973126 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5456b0-c01d-4167-8253-65ebeaf824b9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:45.000621 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 31/61] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:51:44 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:51:48.381755 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf44b9-4c2b-4375-8cb4-05529aa548b2 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:48.382261 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf44b9-4c2b-4375-8cb4-05529aa548b2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:48.382361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf44b9-4c2b-4375-8cb4-05529aa548b2 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:48.384097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 31/62] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:48.389584 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0a773-e632-4122-af21-0723ce89c6ae None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:48.389992 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0a773-e632-4122-af21-0723ce89c6ae None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:48.390155 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0a773-e632-4122-af21-0723ce89c6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:48.417837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a8e0a773-e632-4122-af21-0723ce89c6ae None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:48.419073 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a8e0a773-e632-4122-af21-0723ce89c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:48.502869 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 32/63] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:48.535456 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e338a-9ec8-4f39-9a8c-9bb07167d78b None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:48.535746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e338a-9ec8-4f39-9a8c-9bb07167d78b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:48.536016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e338a-9ec8-4f39-9a8c-9bb07167d78b None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:48.538370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 32/64] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:48.539405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0a773-e632-4122-af21-0723ce89c6ae None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:48.543739 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89800d-ee85-4a5e-975d-892e22cdae7c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:48.544032 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89800d-ee85-4a5e-975d-892e22cdae7c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:48.544315 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89800d-ee85-4a5e-975d-892e22cdae7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:48.573837 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-af89800d-ee85-4a5e-975d-892e22cdae7c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:48.575393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-af89800d-ee85-4a5e-975d-892e22cdae7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:48.642853 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0a773-e632-4122-af21-0723ce89c6ae None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:48.677468 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd060de-f7f3-4daf-b303-5b3e4d970dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:48.678276 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd060de-f7f3-4daf-b303-5b3e4d970dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:48.678559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd060de-f7f3-4daf-b303-5b3e4d970dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:48.678839 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd060de-f7f3-4daf-b303-5b3e4d970dd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:48.689297 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd060de-f7f3-4daf-b303-5b3e4d970dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:51:48.697510 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-cdd060de-f7f3-4daf-b303-5b3e4d970dd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:51:48.699055 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 33/65] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:51:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:51:48.700589 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 33/66] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:51:48.706633 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd060de-f7f3-4daf-b303-5b3e4d970dd0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:48.769179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89800d-ee85-4a5e-975d-892e22cdae7c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:48.835381 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd060de-f7f3-4daf-b303-5b3e4d970dd0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:48.872143 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61e870-73d4-4782-a5b2-51ad49f9f3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:48.873102 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61e870-73d4-4782-a5b2-51ad49f9f3eb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:48.873513 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61e870-73d4-4782-a5b2-51ad49f9f3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:48.873915 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61e870-73d4-4782-a5b2-51ad49f9f3eb None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:48.874788 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61e870-73d4-4782-a5b2-51ad49f9f3eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:48.875242 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61e870-73d4-4782-a5b2-51ad49f9f3eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:48.876769 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61e870-73d4-4782-a5b2-51ad49f9f3eb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:48.885881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 34/67] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:51:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:48.893790 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61e870-73d4-4782-a5b2-51ad49f9f3eb None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:48.977877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89800d-ee85-4a5e-975d-892e22cdae7c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:49.009181 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61e870-73d4-4782-a5b2-51ad49f9f3eb None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:49.013379 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe7767-3f87-4b43-86ba-12fbb3d279c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:49.014184 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe7767-3f87-4b43-86ba-12fbb3d279c6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:49.014470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe7767-3f87-4b43-86ba-12fbb3d279c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:49.014749 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe7767-3f87-4b43-86ba-12fbb3d279c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:49.025774 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe7767-3f87-4b43-86ba-12fbb3d279c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:51:49.032732 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-d5fe7767-3f87-4b43-86ba-12fbb3d279c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:51:49.034109 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 34/68] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:51:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:51:49.035325 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183807e7-eeb2-4202-8d03-dc317a6f4f3a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:49.035612 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183807e7-eeb2-4202-8d03-dc317a6f4f3a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:49.035892 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183807e7-eeb2-4202-8d03-dc317a6f4f3a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:49.043326 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 35/69] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:49.044320 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183807e7-eeb2-4202-8d03-dc317a6f4f3a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:49.046398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbcd9f-7aa8-4118-a83a-77e6ffe29eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:49.047503 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbcd9f-7aa8-4118-a83a-77e6ffe29eba None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:49.048012 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbcd9f-7aa8-4118-a83a-77e6ffe29eba None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:49.048489 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbcd9f-7aa8-4118-a83a-77e6ffe29eba None admin] PATH_INFO: `/v3/users/c4274e0f0eb24597b73957609b982ef4` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:49.063223 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbcd9f-7aa8-4118-a83a-77e6ffe29eba None admin] RBAC: Authorizing `identity:get_user(user_id=c4274e0f0eb24597b73957609b982ef4)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:49.065036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbcd9f-7aa8-4118-a83a-77e6ffe29eba None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:49.066974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 35/70] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:51:48 2022] GET /identity/v3/users/c4274e0f0eb24597b73957609b982ef4 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:49.073393 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833fcc1-f423-4031-9390-282c088225ba None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:49.073932 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833fcc1-f423-4031-9390-282c088225ba None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:49.074416 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833fcc1-f423-4031-9390-282c088225ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:49.092527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e833fcc1-f423-4031-9390-282c088225ba None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:49.094141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e833fcc1-f423-4031-9390-282c088225ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:49.149390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183807e7-eeb2-4202-8d03-dc317a6f4f3a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:49.162905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 36/71] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:49.168875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833fcc1-f423-4031-9390-282c088225ba None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:49.194697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12454dc8-b7c8-4036-8766-19f118ae2d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:49.195471 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12454dc8-b7c8-4036-8766-19f118ae2d84 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:49.195758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12454dc8-b7c8-4036-8766-19f118ae2d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:49.196043 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12454dc8-b7c8-4036-8766-19f118ae2d84 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:49.196893 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12454dc8-b7c8-4036-8766-19f118ae2d84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:49.197192 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12454dc8-b7c8-4036-8766-19f118ae2d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:49.198753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12454dc8-b7c8-4036-8766-19f118ae2d84 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:49.211748 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 36/72] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:51:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:49.213083 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cbdd0-e762-49dd-830e-edd3b457df21 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:49.213382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cbdd0-e762-49dd-830e-edd3b457df21 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:49.213665 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cbdd0-e762-49dd-830e-edd3b457df21 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:49.215321 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 37/73] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:49.216027 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cbdd0-e762-49dd-830e-edd3b457df21 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:49.263162 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833fcc1-f423-4031-9390-282c088225ba None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:49.295695 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85d59b-39e5-4a67-960a-edca0fd368db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:49.296335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85d59b-39e5-4a67-960a-edca0fd368db None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:49.296614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85d59b-39e5-4a67-960a-edca0fd368db None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:49.296941 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85d59b-39e5-4a67-960a-edca0fd368db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:49.316004 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cbdd0-e762-49dd-830e-edd3b457df21 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:49.348053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8c3cc-481f-44b3-903d-dd83721b368e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:49.349506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8c3cc-481f-44b3-903d-dd83721b368e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:49.349800 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8c3cc-481f-44b3-903d-dd83721b368e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:49.350083 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8c3cc-481f-44b3-903d-dd83721b368e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:49.359438 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85d59b-39e5-4a67-960a-edca0fd368db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:49.359786 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8c3cc-481f-44b3-903d-dd83721b368e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:51:49.360945 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85d59b-39e5-4a67-960a-edca0fd368db None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:49.367360 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-14b8c3cc-481f-44b3-903d-dd83721b368e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:51:49.368721 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 38/74] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:51:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:51:49.370044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f50fa2-c8a1-4b16-a82e-7ce6ab08b3c3 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:49.370337 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f50fa2-c8a1-4b16-a82e-7ce6ab08b3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:49.370616 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f50fa2-c8a1-4b16-a82e-7ce6ab08b3c3 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:49.372302 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 39/75] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:49.373035 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f50fa2-c8a1-4b16-a82e-7ce6ab08b3c3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:49.453312 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 37/76] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:51:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:51:49.454517 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7edac-614a-4093-a9e3-9aa654ec930f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:49.454813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7edac-614a-4093-a9e3-9aa654ec930f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:49.455093 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7edac-614a-4093-a9e3-9aa654ec930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:49.470492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f50fa2-c8a1-4b16-a82e-7ce6ab08b3c3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:49.471350 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a8a7edac-614a-4093-a9e3-9aa654ec930f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:49.472551 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a8a7edac-614a-4093-a9e3-9aa654ec930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:49.503230 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3e570-52e6-4c54-b20a-5b5d32e85370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:49.504090 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3e570-52e6-4c54-b20a-5b5d32e85370 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:49.504370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3e570-52e6-4c54-b20a-5b5d32e85370 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:49.504667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3e570-52e6-4c54-b20a-5b5d32e85370 None admin] PATH_INFO: `/v3/users/5a0a331b12764488a1a2fd987b375820` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:49.505866 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3e570-52e6-4c54-b20a-5b5d32e85370 None admin] RBAC: Authorizing `identity:get_user(user_id=5a0a331b12764488a1a2fd987b375820)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:49.507336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3e570-52e6-4c54-b20a-5b5d32e85370 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:49.508963 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 40/77] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:51:49 2022] GET /identity/v3/users/5a0a331b12764488a1a2fd987b375820 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:49.509719 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3e570-52e6-4c54-b20a-5b5d32e85370 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:49.537394 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 38/78] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:49.538670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00837031-b087-4c3b-a6f9-578bbdb77266 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:49.538958 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00837031-b087-4c3b-a6f9-578bbdb77266 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:49.539242 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00837031-b087-4c3b-a6f9-578bbdb77266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:49.554976 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-00837031-b087-4c3b-a6f9-578bbdb77266 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:49.556157 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-00837031-b087-4c3b-a6f9-578bbdb77266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:49.611630 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3e570-52e6-4c54-b20a-5b5d32e85370 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:49.620021 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 39/79] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:49.620893 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00837031-b087-4c3b-a6f9-578bbdb77266 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:49.644441 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359ba95-8f33-46f6-8667-a8d9a19fcdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:49.645149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ba95-8f33-46f6-8667-a8d9a19fcdd0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:49.645436 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ba95-8f33-46f6-8667-a8d9a19fcdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:49.645877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ba95-8f33-46f6-8667-a8d9a19fcdd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:49.646662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359ba95-8f33-46f6-8667-a8d9a19fcdd0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:49.646972 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359ba95-8f33-46f6-8667-a8d9a19fcdd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:49.648369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359ba95-8f33-46f6-8667-a8d9a19fcdd0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:49.656249 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 41/80] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:51:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:49.657071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359ba95-8f33-46f6-8667-a8d9a19fcdd0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:49.726755 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00837031-b087-4c3b-a6f9-578bbdb77266 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:49.752145 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359ba95-8f33-46f6-8667-a8d9a19fcdd0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:49.758872 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b1683-a6eb-40c4-bb12-723a1a7330f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:49.759730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b1683-a6eb-40c4-bb12-723a1a7330f5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:49.760013 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b1683-a6eb-40c4-bb12-723a1a7330f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:49.760291 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b1683-a6eb-40c4-bb12-723a1a7330f5 None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:49.761486 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b1683-a6eb-40c4-bb12-723a1a7330f5 None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:49.762933 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b1683-a6eb-40c4-bb12-723a1a7330f5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:49.764603 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 40/81] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:51:49 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:49.765387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b1683-a6eb-40c4-bb12-723a1a7330f5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:49.784996 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7753c0-14b6-4142-8302-ca855c27c407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:49.785648 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7753c0-14b6-4142-8302-ca855c27c407 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:49.785930 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7753c0-14b6-4142-8302-ca855c27c407 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:49.786910 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7753c0-14b6-4142-8302-ca855c27c407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:49.850002 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7753c0-14b6-4142-8302-ca855c27c407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:49.851478 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7753c0-14b6-4142-8302-ca855c27c407 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:49.864228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b1683-a6eb-40c4-bb12-723a1a7330f5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:49.896532 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06045d-e533-4806-bef8-198ef99fa7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:49.897338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06045d-e533-4806-bef8-198ef99fa7ae None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:49.897623 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06045d-e533-4806-bef8-198ef99fa7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:49.897902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06045d-e533-4806-bef8-198ef99fa7ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:49.908202 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06045d-e533-4806-bef8-198ef99fa7ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:51:49.915793 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-ae06045d-e533-4806-bef8-198ef99fa7ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:51:49.917036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 41/82] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:51:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:51:49.917820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06045d-e533-4806-bef8-198ef99fa7ae None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:49.957877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 42/83] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:51:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:51:49.959305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7753c0-14b6-4142-8302-ca855c27c407 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:50.030013 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06045d-e533-4806-bef8-198ef99fa7ae None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:50.056496 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7753c0-14b6-4142-8302-ca855c27c407 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:50.061648 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4ae40-ba89-43c9-9c02-d30efd0dd881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:50.062431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4ae40-ba89-43c9-9c02-d30efd0dd881 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:50.062711 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4ae40-ba89-43c9-9c02-d30efd0dd881 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:50.062984 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4ae40-ba89-43c9-9c02-d30efd0dd881 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:50.064235 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4ae40-ba89-43c9-9c02-d30efd0dd881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:50.065860 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4ae40-ba89-43c9-9c02-d30efd0dd881 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:50.067554 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 42/84] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:51:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:50.069000 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4ae40-ba89-43c9-9c02-d30efd0dd881 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:50.090703 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32665006-8e77-43a0-b2db-f1c9237b8669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:50.091588 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32665006-8e77-43a0-b2db-f1c9237b8669 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:50.091874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32665006-8e77-43a0-b2db-f1c9237b8669 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:50.092160 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32665006-8e77-43a0-b2db-f1c9237b8669 None admin] PATH_INFO: `/v3/users/c4274e0f0eb24597b73957609b982ef4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:50.093375 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32665006-8e77-43a0-b2db-f1c9237b8669 None admin] RBAC: Authorizing `identity:get_user(user_id=c4274e0f0eb24597b73957609b982ef4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:50.094822 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32665006-8e77-43a0-b2db-f1c9237b8669 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:50.096444 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 43/85] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:51:49 2022] GET /identity/v3/users/c4274e0f0eb24597b73957609b982ef4 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:50.098304 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32665006-8e77-43a0-b2db-f1c9237b8669 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:50.164064 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4ae40-ba89-43c9-9c02-d30efd0dd881 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:50.191490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32665006-8e77-43a0-b2db-f1c9237b8669 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:50.197260 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e1305-e059-49f8-a9b9-53aede07603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:50.197914 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e1305-e059-49f8-a9b9-53aede07603b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:50.198200 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e1305-e059-49f8-a9b9-53aede07603b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:50.198480 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e1305-e059-49f8-a9b9-53aede07603b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:50.199340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e1305-e059-49f8-a9b9-53aede07603b None admin] RBAC: Adding query filter params (role.id=76a348ab64cc49e0b464e3578474c8d6, scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4, user.id=c4274e0f0eb24597b73957609b982ef4) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:50.199653 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e1305-e059-49f8-a9b9-53aede07603b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:50.201136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e1305-e059-49f8-a9b9-53aede07603b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:50.206596 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 43/86] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:51:50 2022] GET /identity/v3/role_assignments?user.id=c4274e0f0eb24597b73957609b982ef4&scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4&role.id=76a348ab64cc49e0b464e3578474c8d6 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:50.207133 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e1305-e059-49f8-a9b9-53aede07603b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:50.242533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77864b38-4eb3-4307-a75c-6af6bf6456c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:50.243149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77864b38-4eb3-4307-a75c-6af6bf6456c0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:50.243434 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77864b38-4eb3-4307-a75c-6af6bf6456c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:50.243713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77864b38-4eb3-4307-a75c-6af6bf6456c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:50.244490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77864b38-4eb3-4307-a75c-6af6bf6456c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:50.245086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77864b38-4eb3-4307-a75c-6af6bf6456c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:50.246525 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77864b38-4eb3-4307-a75c-6af6bf6456c0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:50.256407 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 44/87] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:51:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:50.257727 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77864b38-4eb3-4307-a75c-6af6bf6456c0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:50.320720 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e1305-e059-49f8-a9b9-53aede07603b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:50.360318 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf7d54-a435-4c1e-ae0b-b2bd715b5b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:50.360925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77864b38-4eb3-4307-a75c-6af6bf6456c0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:50.361233 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf7d54-a435-4c1e-ae0b-b2bd715b5b69 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:50.361522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf7d54-a435-4c1e-ae0b-b2bd715b5b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:50.361805 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf7d54-a435-4c1e-ae0b-b2bd715b5b69 None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:50.363053 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf7d54-a435-4c1e-ae0b-b2bd715b5b69 None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:50.365235 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf7d54-a435-4c1e-ae0b-b2bd715b5b69 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:50.367208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 44/88] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:51:50 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:50.367826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf7d54-a435-4c1e-ae0b-b2bd715b5b69 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:50.401791 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a5824-52c9-46e8-9774-390be73106e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:50.402472 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a5824-52c9-46e8-9774-390be73106e2 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:50.402752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a5824-52c9-46e8-9774-390be73106e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:50.403027 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a5824-52c9-46e8-9774-390be73106e2 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:50.403744 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a5824-52c9-46e8-9774-390be73106e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:50.405276 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a5824-52c9-46e8-9774-390be73106e2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:50.434746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 45/89] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:51:50 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:51:50.435362 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a5824-52c9-46e8-9774-390be73106e2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:50.481465 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf7d54-a435-4c1e-ae0b-b2bd715b5b69 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:50.519582 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312186e5-364c-44fa-92f6-968139dbb93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:50.520219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312186e5-364c-44fa-92f6-968139dbb93b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:50.520513 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312186e5-364c-44fa-92f6-968139dbb93b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:50.520952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312186e5-364c-44fa-92f6-968139dbb93b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:50.543485 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a5824-52c9-46e8-9774-390be73106e2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:50.582353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e3baa-fd06-44b9-9a0c-3664918e7bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:50.583281 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e3baa-fd06-44b9-9a0c-3664918e7bfc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:50.583564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e3baa-fd06-44b9-9a0c-3664918e7bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:50.583826 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e3baa-fd06-44b9-9a0c-3664918e7bfc None admin] PATH_INFO: `/v3/users/c4274e0f0eb24597b73957609b982ef4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:50.585140 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e3baa-fd06-44b9-9a0c-3664918e7bfc None admin] RBAC: Authorizing `identity:get_user(user_id=c4274e0f0eb24597b73957609b982ef4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:50.586639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e3baa-fd06-44b9-9a0c-3664918e7bfc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:50.588350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 46/90] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:51:50 2022] GET /identity/v3/users/c4274e0f0eb24597b73957609b982ef4 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:50.589160 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e3baa-fd06-44b9-9a0c-3664918e7bfc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:50.595789 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312186e5-364c-44fa-92f6-968139dbb93b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:50.597429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312186e5-364c-44fa-92f6-968139dbb93b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:50.703054 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e3baa-fd06-44b9-9a0c-3664918e7bfc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:50.715272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 45/91] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:51:50.716126 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312186e5-364c-44fa-92f6-968139dbb93b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:50.755014 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31512b-d7b9-4b4a-a4dc-8efa5f84a4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:50.755718 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31512b-d7b9-4b4a-a4dc-8efa5f84a4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:50.756000 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31512b-d7b9-4b4a-a4dc-8efa5f84a4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:50.756272 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31512b-d7b9-4b4a-a4dc-8efa5f84a4f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:50.757224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31512b-d7b9-4b4a-a4dc-8efa5f84a4f1 None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4, user.id=5a0a331b12764488a1a2fd987b375820) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:50.757534 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31512b-d7b9-4b4a-a4dc-8efa5f84a4f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:50.758992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31512b-d7b9-4b4a-a4dc-8efa5f84a4f1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:50.766961 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 47/92] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:51:50 2022] GET /identity/v3/role_assignments?user.id=5a0a331b12764488a1a2fd987b375820&scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:50.767582 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31512b-d7b9-4b4a-a4dc-8efa5f84a4f1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:50.855161 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312186e5-364c-44fa-92f6-968139dbb93b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:50.909340 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31512b-d7b9-4b4a-a4dc-8efa5f84a4f1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:50.912521 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e561a8-0eff-479e-bc87-5c50c3fe78e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:50.913216 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e561a8-0eff-479e-bc87-5c50c3fe78e9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:50.913506 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e561a8-0eff-479e-bc87-5c50c3fe78e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:50.913785 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e561a8-0eff-479e-bc87-5c50c3fe78e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:50.952832 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a07990-7bad-4910-8be4-82dee17ead90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:50.954284 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a07990-7bad-4910-8be4-82dee17ead90 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:50.954770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a07990-7bad-4910-8be4-82dee17ead90 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:50.955231 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a07990-7bad-4910-8be4-82dee17ead90 None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:50.958016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a07990-7bad-4910-8be4-82dee17ead90 None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:50.961616 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a07990-7bad-4910-8be4-82dee17ead90 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:50.964743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 48/93] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:51:50 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:50.973127 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a07990-7bad-4910-8be4-82dee17ead90 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:51.000818 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e561a8-0eff-479e-bc87-5c50c3fe78e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:51.000818 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e561a8-0eff-479e-bc87-5c50c3fe78e9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:51.104512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a07990-7bad-4910-8be4-82dee17ead90 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:51.114997 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 46/94] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:51:51.121067 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e561a8-0eff-479e-bc87-5c50c3fe78e9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:51.143103 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2ccf5-3506-41ea-b1c0-24be1f760b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:51.144082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2ccf5-3506-41ea-b1c0-24be1f760b46 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:51.144370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2ccf5-3506-41ea-b1c0-24be1f760b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:51.144650 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2ccf5-3506-41ea-b1c0-24be1f760b46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:51.145539 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2ccf5-3506-41ea-b1c0-24be1f760b46 None admin] RBAC: Adding query filter params (role.id=20b1a2451e0a42628e0126aa881cac6b, scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4, user.id=c4274e0f0eb24597b73957609b982ef4) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:51.146417 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2ccf5-3506-41ea-b1c0-24be1f760b46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:51.147874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2ccf5-3506-41ea-b1c0-24be1f760b46 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:51.154718 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 49/95] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:51:50 2022] GET /identity/v3/role_assignments?user.id=c4274e0f0eb24597b73957609b982ef4&scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4&role.id=20b1a2451e0a42628e0126aa881cac6b => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:51.288341 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e561a8-0eff-479e-bc87-5c50c3fe78e9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:51.336529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52c0c2-455c-4744-a08d-2068b56f2165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:51.337428 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52c0c2-455c-4744-a08d-2068b56f2165 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:51.337711 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52c0c2-455c-4744-a08d-2068b56f2165 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:51.337994 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52c0c2-455c-4744-a08d-2068b56f2165 None admin] PATH_INFO: `/v3/projects/d3f7e623fd474baabc4de824f5fb3f57` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:51.339210 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52c0c2-455c-4744-a08d-2068b56f2165 None admin] RBAC: Authorizing `identity:get_project(project_id=d3f7e623fd474baabc4de824f5fb3f57)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:51.340670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52c0c2-455c-4744-a08d-2068b56f2165 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:51.342602 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 47/96] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:51:51 2022] GET /identity/v3/projects/d3f7e623fd474baabc4de824f5fb3f57 => generated 312 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:51:51.348561 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2ccf5-3506-41ea-b1c0-24be1f760b46 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:51.455584 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2ccf5-3506-41ea-b1c0-24be1f760b46 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:51.492608 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07378a76-bd7c-4c57-b751-de16494577e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:51.493323 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07378a76-bd7c-4c57-b751-de16494577e7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:51.493660 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07378a76-bd7c-4c57-b751-de16494577e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:51.493950 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07378a76-bd7c-4c57-b751-de16494577e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:51.495073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07378a76-bd7c-4c57-b751-de16494577e7 None admin] RBAC: Adding query filter params (role.id=76a348ab64cc49e0b464e3578474c8d6, scope.project.id=d3f7e623fd474baabc4de824f5fb3f57, user.id=c4274e0f0eb24597b73957609b982ef4) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:51.495452 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07378a76-bd7c-4c57-b751-de16494577e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:51.496958 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07378a76-bd7c-4c57-b751-de16494577e7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:51.503310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 50/97] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:51:51 2022] GET /identity/v3/role_assignments?user.id=c4274e0f0eb24597b73957609b982ef4&scope.project.id=d3f7e623fd474baabc4de824f5fb3f57&role.id=76a348ab64cc49e0b464e3578474c8d6 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:52.965918 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdf673-7806-4d9f-8269-0c64ca63e281 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:52.966453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdf673-7806-4d9f-8269-0c64ca63e281 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:52.966453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdf673-7806-4d9f-8269-0c64ca63e281 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:52.968275 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 48/98] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:52.974811 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4a9f6-c6a2-4d00-89ec-b1e65efad679 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:52.974811 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4a9f6-c6a2-4d00-89ec-b1e65efad679 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:52.974811 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4a9f6-c6a2-4d00-89ec-b1e65efad679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:52.997231 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d7d4a9f6-c6a2-4d00-89ec-b1e65efad679 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:52.998446 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d7d4a9f6-c6a2-4d00-89ec-b1e65efad679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:53.076784 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 51/99] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:53.110738 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdf673-7806-4d9f-8269-0c64ca63e281 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:53.228456 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdf673-7806-4d9f-8269-0c64ca63e281 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:53.273764 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ec385-9abe-4ab6-9a5b-65d80dff639d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:53.274564 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ec385-9abe-4ab6-9a5b-65d80dff639d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:53.274846 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ec385-9abe-4ab6-9a5b-65d80dff639d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:53.275119 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ec385-9abe-4ab6-9a5b-65d80dff639d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:53.297756 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ec385-9abe-4ab6-9a5b-65d80dff639d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:51:53.305755 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-748ec385-9abe-4ab6-9a5b-65d80dff639d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:51:53.307183 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 49/100] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:51:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:51:53.312906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4a9f6-c6a2-4d00-89ec-b1e65efad679 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:53.453105 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4a9f6-c6a2-4d00-89ec-b1e65efad679 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:53.496613 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e897413-265c-431a-9a49-3ff7ed9a03c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:53.497669 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e897413-265c-431a-9a49-3ff7ed9a03c9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:53.498174 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e897413-265c-431a-9a49-3ff7ed9a03c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:53.498645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e897413-265c-431a-9a49-3ff7ed9a03c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:53.499599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e897413-265c-431a-9a49-3ff7ed9a03c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:53.500105 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e897413-265c-431a-9a49-3ff7ed9a03c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:53.501732 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e897413-265c-431a-9a49-3ff7ed9a03c9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:53.511425 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 52/101] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:51:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:53.522228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ec385-9abe-4ab6-9a5b-65d80dff639d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:53.659772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ec385-9abe-4ab6-9a5b-65d80dff639d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:53.698699 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de0a07-e7a5-4011-8cdf-92c34853b583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:53.699984 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de0a07-e7a5-4011-8cdf-92c34853b583 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:53.700490 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de0a07-e7a5-4011-8cdf-92c34853b583 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:53.700992 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de0a07-e7a5-4011-8cdf-92c34853b583 None admin] PATH_INFO: `/v3/users/c4274e0f0eb24597b73957609b982ef4` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:53.705495 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de0a07-e7a5-4011-8cdf-92c34853b583 None admin] RBAC: Authorizing `identity:get_user(user_id=c4274e0f0eb24597b73957609b982ef4)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:53.707164 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de0a07-e7a5-4011-8cdf-92c34853b583 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:53.710110 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 50/102] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:51:53 2022] GET /identity/v3/users/c4274e0f0eb24597b73957609b982ef4 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:53.715871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e897413-265c-431a-9a49-3ff7ed9a03c9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:53.846541 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e897413-265c-431a-9a49-3ff7ed9a03c9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:53.888258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae66a1d-f5a0-4c1d-a522-5ddbfc153e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:53.889505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae66a1d-f5a0-4c1d-a522-5ddbfc153e00 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:53.890006 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae66a1d-f5a0-4c1d-a522-5ddbfc153e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:53.890502 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae66a1d-f5a0-4c1d-a522-5ddbfc153e00 None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:53.891920 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae66a1d-f5a0-4c1d-a522-5ddbfc153e00 None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:53.893595 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae66a1d-f5a0-4c1d-a522-5ddbfc153e00 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:53.896260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 53/103] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:51:53 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:53.902044 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de0a07-e7a5-4011-8cdf-92c34853b583 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:54.025158 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de0a07-e7a5-4011-8cdf-92c34853b583 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:54.068775 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99481c-aac3-45c4-bcbb-61f785b52c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:54.070133 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99481c-aac3-45c4-bcbb-61f785b52c0f None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:54.070617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99481c-aac3-45c4-bcbb-61f785b52c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:54.071110 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99481c-aac3-45c4-bcbb-61f785b52c0f None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4/users/c4274e0f0eb24597b73957609b982ef4/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:54.073401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99481c-aac3-45c4-bcbb-61f785b52c0f None admin] RBAC: Authorizing `identity:create_grant(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4, user_id=c4274e0f0eb24597b73957609b982ef4, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:54.075064 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99481c-aac3-45c4-bcbb-61f785b52c0f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:54.100206 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 51/104] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:51:53 2022] PUT /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4/users/c4274e0f0eb24597b73957609b982ef4/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:51:54.341639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76332c48-94e1-4eb0-b2ca-319ab80aefde None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:54.342714 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76332c48-94e1-4eb0-b2ca-319ab80aefde None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:54.343217 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76332c48-94e1-4eb0-b2ca-319ab80aefde None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:54.345402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 54/105] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:54.352463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4830067-8d64-4a88-ac8f-6dba0f3bef29 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:54.353121 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4830067-8d64-4a88-ac8f-6dba0f3bef29 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:54.353634 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4830067-8d64-4a88-ac8f-6dba0f3bef29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:54.382013 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f4830067-8d64-4a88-ac8f-6dba0f3bef29 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:54.383607 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f4830067-8d64-4a88-ac8f-6dba0f3bef29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:54.463883 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 52/106] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:54.486959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76332c48-94e1-4eb0-b2ca-319ab80aefde None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:54.558831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf1e56-d73f-45db-b81c-8b24b39d55f9 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:54.559473 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf1e56-d73f-45db-b81c-8b24b39d55f9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:54.559938 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf1e56-d73f-45db-b81c-8b24b39d55f9 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:54.561971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 53/107] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:51:54.568550 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc3fbc-dc2d-405a-b692-64507a0097eb None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:54.569207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc3fbc-dc2d-405a-b692-64507a0097eb None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:54.569692 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc3fbc-dc2d-405a-b692-64507a0097eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:54.594585 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-69dc3fbc-dc2d-405a-b692-64507a0097eb None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:54.596142 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-69dc3fbc-dc2d-405a-b692-64507a0097eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:54.622668 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76332c48-94e1-4eb0-b2ca-319ab80aefde None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:54.667974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 54/108] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:51:54.680011 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a268e5-b75d-4ffd-8992-e601c117b9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:54.680875 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a268e5-b75d-4ffd-8992-e601c117b9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:54.681163 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a268e5-b75d-4ffd-8992-e601c117b9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:54.681464 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a268e5-b75d-4ffd-8992-e601c117b9b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:54.697205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc3fbc-dc2d-405a-b692-64507a0097eb None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:54.701404 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a268e5-b75d-4ffd-8992-e601c117b9b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:51:54.709378 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-d2a268e5-b75d-4ffd-8992-e601c117b9b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:51:54.709378 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 55/109] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:51:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:51:54.716059 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a268e5-b75d-4ffd-8992-e601c117b9b9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:54.810207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc3fbc-dc2d-405a-b692-64507a0097eb None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:54.845246 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22e0c8-8b15-4127-ae08-d4db1ed5a840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:54.846391 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22e0c8-8b15-4127-ae08-d4db1ed5a840 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:54.846863 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22e0c8-8b15-4127-ae08-d4db1ed5a840 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:54.847367 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22e0c8-8b15-4127-ae08-d4db1ed5a840 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:54.859410 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22e0c8-8b15-4127-ae08-d4db1ed5a840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:51:54.867484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-0a22e0c8-8b15-4127-ae08-d4db1ed5a840 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:51:54.868980 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 55/110] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:51:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:51:54.875390 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22e0c8-8b15-4127-ae08-d4db1ed5a840 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:54.890363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a268e5-b75d-4ffd-8992-e601c117b9b9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:54.949924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d313dc-330c-40e8-8c35-cb484c592e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:54.950614 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d313dc-330c-40e8-8c35-cb484c592e8b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:54.950894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d313dc-330c-40e8-8c35-cb484c592e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:54.951173 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d313dc-330c-40e8-8c35-cb484c592e8b None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:54.951961 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d313dc-330c-40e8-8c35-cb484c592e8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:54.952246 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d313dc-330c-40e8-8c35-cb484c592e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:54.953671 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d313dc-330c-40e8-8c35-cb484c592e8b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:54.969800 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 56/111] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:51:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:51:54.971190 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e580b2-f3a5-41aa-b0f1-78b589dac3f9 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:54.971403 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e580b2-f3a5-41aa-b0f1-78b589dac3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:54.971689 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e580b2-f3a5-41aa-b0f1-78b589dac3f9 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:54.978543 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 57/112] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:54.979331 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e580b2-f3a5-41aa-b0f1-78b589dac3f9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:55.032510 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22e0c8-8b15-4127-ae08-d4db1ed5a840 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:55.068390 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d66810-791f-4b78-ac45-6aad8f06c8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:55.069089 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d66810-791f-4b78-ac45-6aad8f06c8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:55.069476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d66810-791f-4b78-ac45-6aad8f06c8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:55.069758 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d66810-791f-4b78-ac45-6aad8f06c8b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:55.070511 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d66810-791f-4b78-ac45-6aad8f06c8b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:55.070820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d66810-791f-4b78-ac45-6aad8f06c8b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:55.072222 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d66810-791f-4b78-ac45-6aad8f06c8b9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:55.080635 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 56/113] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:51:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:51:55.084884 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48877039-cead-4210-8772-8458fbcad18a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:55.084884 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48877039-cead-4210-8772-8458fbcad18a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:55.084884 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48877039-cead-4210-8772-8458fbcad18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:55.101070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-48877039-cead-4210-8772-8458fbcad18a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:55.102478 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-48877039-cead-4210-8772-8458fbcad18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:55.155538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e580b2-f3a5-41aa-b0f1-78b589dac3f9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:55.171603 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 57/114] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:55.173177 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160b2f4-b19f-4e5b-9885-74ac9e123bcc None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:55.173737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160b2f4-b19f-4e5b-9885-74ac9e123bcc None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:55.174222 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160b2f4-b19f-4e5b-9885-74ac9e123bcc None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:55.176338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 58/115] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:55.178140 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160b2f4-b19f-4e5b-9885-74ac9e123bcc None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:55.210778 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11105cf5-f918-40f7-9dbb-91035aa37111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:55.211678 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11105cf5-f918-40f7-9dbb-91035aa37111 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:55.212016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11105cf5-f918-40f7-9dbb-91035aa37111 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:55.212288 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11105cf5-f918-40f7-9dbb-91035aa37111 None admin] PATH_INFO: `/v3/users/5a0a331b12764488a1a2fd987b375820` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:55.218221 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11105cf5-f918-40f7-9dbb-91035aa37111 None admin] RBAC: Authorizing `identity:get_user(user_id=5a0a331b12764488a1a2fd987b375820)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:55.219795 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11105cf5-f918-40f7-9dbb-91035aa37111 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:55.221684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 58/116] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:51:54 2022] GET /identity/v3/users/5a0a331b12764488a1a2fd987b375820 => generated 247 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:55.226109 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d59ca-8e21-4e59-bc11-d330fe232e13 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:55.226395 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d59ca-8e21-4e59-bc11-d330fe232e13 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:55.226672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d59ca-8e21-4e59-bc11-d330fe232e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:55.246098 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3b0d59ca-8e21-4e59-bc11-d330fe232e13 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:55.247300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3b0d59ca-8e21-4e59-bc11-d330fe232e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:55.291901 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160b2f4-b19f-4e5b-9885-74ac9e123bcc None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:55.311791 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 59/117] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:55.312547 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d59ca-8e21-4e59-bc11-d330fe232e13 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:55.337172 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969212a8-ca24-40c2-9d58-3aa49f68c16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:55.338057 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969212a8-ca24-40c2-9d58-3aa49f68c16d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:55.338340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969212a8-ca24-40c2-9d58-3aa49f68c16d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:55.338623 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969212a8-ca24-40c2-9d58-3aa49f68c16d None admin] PATH_INFO: `/v3/users/749b4c712abc46cbbe4074b7d1ca8347` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:55.353413 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969212a8-ca24-40c2-9d58-3aa49f68c16d None admin] RBAC: Authorizing `identity:get_user(user_id=749b4c712abc46cbbe4074b7d1ca8347)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:55.354902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969212a8-ca24-40c2-9d58-3aa49f68c16d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:55.356606 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 59/118] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:51:55 2022] GET /identity/v3/users/749b4c712abc46cbbe4074b7d1ca8347 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:55.357898 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b13d4-adb4-4c28-83c6-ced0d6206c85 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:55.358183 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b13d4-adb4-4c28-83c6-ced0d6206c85 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:55.358462 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b13d4-adb4-4c28-83c6-ced0d6206c85 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:55.360270 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 60/119] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:55.360817 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b13d4-adb4-4c28-83c6-ced0d6206c85 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:55.426686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d59ca-8e21-4e59-bc11-d330fe232e13 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:55.460684 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b13d4-adb4-4c28-83c6-ced0d6206c85 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:55.464339 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6de4b-f762-4908-9cca-afa00be8c9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:55.465215 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6de4b-f762-4908-9cca-afa00be8c9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:55.465505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6de4b-f762-4908-9cca-afa00be8c9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:55.465779 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6de4b-f762-4908-9cca-afa00be8c9e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:55.476076 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6de4b-f762-4908-9cca-afa00be8c9e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:51:55.483339 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-e9a6de4b-f762-4908-9cca-afa00be8c9e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:51:55.484694 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 60/120] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:51:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:51:55.485326 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6de4b-f762-4908-9cca-afa00be8c9e7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:55.499665 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3388099-b62a-40f4-9a09-b5653851ea5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:55.500522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3388099-b62a-40f4-9a09-b5653851ea5b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:55.500815 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3388099-b62a-40f4-9a09-b5653851ea5b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:55.501106 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3388099-b62a-40f4-9a09-b5653851ea5b None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:55.502300 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3388099-b62a-40f4-9a09-b5653851ea5b None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:55.503757 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3388099-b62a-40f4-9a09-b5653851ea5b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:55.506516 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 61/121] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:51:55 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:55.507135 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3388099-b62a-40f4-9a09-b5653851ea5b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:55.586461 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6de4b-f762-4908-9cca-afa00be8c9e7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:55.601662 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3388099-b62a-40f4-9a09-b5653851ea5b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:55.620156 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117d5c4-1e0a-4ba3-ae84-adf55c4110a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:55.620995 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117d5c4-1e0a-4ba3-ae84-adf55c4110a5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:55.621278 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117d5c4-1e0a-4ba3-ae84-adf55c4110a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:55.621555 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117d5c4-1e0a-4ba3-ae84-adf55c4110a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:55.622722 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117d5c4-1e0a-4ba3-ae84-adf55c4110a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:55.624216 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117d5c4-1e0a-4ba3-ae84-adf55c4110a5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:55.628731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 61/122] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:51:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:55.628731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4154fb6-88b1-48a2-b942-8e3385688034 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:55.628731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4154fb6-88b1-48a2-b942-8e3385688034 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:55.628731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4154fb6-88b1-48a2-b942-8e3385688034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:55.640808 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cecc799-bf07-4a10-b3eb-4328438a0b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:55.641463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecc799-bf07-4a10-b3eb-4328438a0b77 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:55.641747 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecc799-bf07-4a10-b3eb-4328438a0b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:55.642020 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecc799-bf07-4a10-b3eb-4328438a0b77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:55.647588 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f4154fb6-88b1-48a2-b942-8e3385688034 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:55.648985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f4154fb6-88b1-48a2-b942-8e3385688034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:55.710646 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cecc799-bf07-4a10-b3eb-4328438a0b77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:55.712053 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cecc799-bf07-4a10-b3eb-4328438a0b77 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:55.719869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 62/123] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:55.720545 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4154fb6-88b1-48a2-b942-8e3385688034 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:55.814895 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 62/124] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:51:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:51:55.815996 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cecc799-bf07-4a10-b3eb-4328438a0b77 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:55.824072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4154fb6-88b1-48a2-b942-8e3385688034 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:55.856382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bcc73-e29d-45f9-a299-83e4ee02edfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:55.857082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bcc73-e29d-45f9-a299-83e4ee02edfb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:55.857366 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bcc73-e29d-45f9-a299-83e4ee02edfb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:55.857642 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bcc73-e29d-45f9-a299-83e4ee02edfb None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:55.858380 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bcc73-e29d-45f9-a299-83e4ee02edfb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:55.858690 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bcc73-e29d-45f9-a299-83e4ee02edfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:55.860065 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bcc73-e29d-45f9-a299-83e4ee02edfb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:55.872982 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 63/125] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:51:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:55.872982 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bcc73-e29d-45f9-a299-83e4ee02edfb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:55.920394 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cecc799-bf07-4a10-b3eb-4328438a0b77 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:55.953285 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d8557-8c31-4e15-b846-5e357c35185c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:55.954167 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d8557-8c31-4e15-b846-5e357c35185c None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:55.954449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d8557-8c31-4e15-b846-5e357c35185c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:55.954858 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d8557-8c31-4e15-b846-5e357c35185c None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4/users/5a0a331b12764488a1a2fd987b375820/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:55.956704 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d8557-8c31-4e15-b846-5e357c35185c None admin] RBAC: Authorizing `identity:create_grant(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4, user_id=5a0a331b12764488a1a2fd987b375820, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:55.958708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d8557-8c31-4e15-b846-5e357c35185c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:55.971303 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bcc73-e29d-45f9-a299-83e4ee02edfb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:55.973760 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 63/126] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:51:55 2022] PUT /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4/users/5a0a331b12764488a1a2fd987b375820/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:51:55.974845 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d8557-8c31-4e15-b846-5e357c35185c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:56.018328 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0e7ea-dd9a-4452-9a95-88b7795f0bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:56.019017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0e7ea-dd9a-4452-9a95-88b7795f0bdc None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:56.019300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0e7ea-dd9a-4452-9a95-88b7795f0bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:56.019576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0e7ea-dd9a-4452-9a95-88b7795f0bdc None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:56.020298 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0e7ea-dd9a-4452-9a95-88b7795f0bdc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:56.022256 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0e7ea-dd9a-4452-9a95-88b7795f0bdc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:56.055356 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 64/127] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 27 04:51:55 2022] POST /identity/v3/projects => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:51:56.061824 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0e7ea-dd9a-4452-9a95-88b7795f0bdc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:56.091390 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d8557-8c31-4e15-b846-5e357c35185c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:56.131927 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0a941-6123-46c0-934b-fca34936f3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:56.132766 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0a941-6123-46c0-934b-fca34936f3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:56.133086 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0a941-6123-46c0-934b-fca34936f3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:56.133428 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0a941-6123-46c0-934b-fca34936f3c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:56.146428 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0a941-6123-46c0-934b-fca34936f3c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:51:56.153947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-9ee0a941-6123-46c0-934b-fca34936f3c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:51:56.155306 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 64/128] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:51:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:51:56.156116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0a941-6123-46c0-934b-fca34936f3c4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:56.251773 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0e7ea-dd9a-4452-9a95-88b7795f0bdc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:56.268352 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0a941-6123-46c0-934b-fca34936f3c4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:56.289579 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dd492-0c1d-4fd9-ac33-d0ad3cbfcb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:56.290734 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dd492-0c1d-4fd9-ac33-d0ad3cbfcb43 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:56.291176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dd492-0c1d-4fd9-ac33-d0ad3cbfcb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:56.291595 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61dd492-0c1d-4fd9-ac33-d0ad3cbfcb43 None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:56.293081 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61dd492-0c1d-4fd9-ac33-d0ad3cbfcb43 None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:56.294722 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61dd492-0c1d-4fd9-ac33-d0ad3cbfcb43 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:56.296726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 65/129] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:51:56 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:56.300015 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dd492-0c1d-4fd9-ac33-d0ad3cbfcb43 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:56.306037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa14fa-4788-432f-8df5-77b040a6abd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:56.306940 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa14fa-4788-432f-8df5-77b040a6abd8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:56.307590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa14fa-4788-432f-8df5-77b040a6abd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:56.307590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa14fa-4788-432f-8df5-77b040a6abd8 None admin] PATH_INFO: `/v3/users/c4274e0f0eb24597b73957609b982ef4` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:56.308761 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa14fa-4788-432f-8df5-77b040a6abd8 None admin] RBAC: Authorizing `identity:get_user(user_id=c4274e0f0eb24597b73957609b982ef4)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:56.310297 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa14fa-4788-432f-8df5-77b040a6abd8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:56.311979 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 65/130] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:51:56 2022] GET /identity/v3/users/c4274e0f0eb24597b73957609b982ef4 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:56.312759 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa14fa-4788-432f-8df5-77b040a6abd8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:56.413800 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61dd492-0c1d-4fd9-ac33-d0ad3cbfcb43 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:56.413993 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa14fa-4788-432f-8df5-77b040a6abd8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:56.449599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb625f5a-0ebb-4117-89eb-ea4ba222a1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:56.449803 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af144e-32ee-4d63-86d7-577f8078431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:56.450324 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb625f5a-0ebb-4117-89eb-ea4ba222a1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:56.450426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af144e-32ee-4d63-86d7-577f8078431d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:56.450606 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb625f5a-0ebb-4117-89eb-ea4ba222a1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:56.450712 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af144e-32ee-4d63-86d7-577f8078431d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:56.450927 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb625f5a-0ebb-4117-89eb-ea4ba222a1f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:56.451040 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af144e-32ee-4d63-86d7-577f8078431d None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:56.451701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af144e-32ee-4d63-86d7-577f8078431d None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:56.451802 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb625f5a-0ebb-4117-89eb-ea4ba222a1f3 None admin] RBAC: Adding query filter params (role.id=3f29e38dee7541f59eebc4b335c9237f, scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4, user.id=749b4c712abc46cbbe4074b7d1ca8347) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:56.452010 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af144e-32ee-4d63-86d7-577f8078431d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:56.452106 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb625f5a-0ebb-4117-89eb-ea4ba222a1f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:56.453431 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af144e-32ee-4d63-86d7-577f8078431d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:56.453598 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb625f5a-0ebb-4117-89eb-ea4ba222a1f3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:56.459551 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 66/131] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:51:56 2022] GET /identity/v3/role_assignments?user.id=749b4c712abc46cbbe4074b7d1ca8347&scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4&role.id=3f29e38dee7541f59eebc4b335c9237f => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:56.460405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb625f5a-0ebb-4117-89eb-ea4ba222a1f3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:56.463669 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 66/132] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:51:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:56.469750 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af144e-32ee-4d63-86d7-577f8078431d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:56.566844 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb625f5a-0ebb-4117-89eb-ea4ba222a1f3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:56.580602 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af144e-32ee-4d63-86d7-577f8078431d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:56.602412 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde59e3-6391-48ef-9604-e034309ac05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:56.603311 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde59e3-6391-48ef-9604-e034309ac05b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:56.603592 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde59e3-6391-48ef-9604-e034309ac05b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:56.603873 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde59e3-6391-48ef-9604-e034309ac05b None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:56.605228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde59e3-6391-48ef-9604-e034309ac05b None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:56.606706 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde59e3-6391-48ef-9604-e034309ac05b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:56.608714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 67/133] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:51:56 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:56.614994 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde59e3-6391-48ef-9604-e034309ac05b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:56.616456 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66990113-83fb-43b2-8dfc-9bc024dcc4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:56.617414 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66990113-83fb-43b2-8dfc-9bc024dcc4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:56.617701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66990113-83fb-43b2-8dfc-9bc024dcc4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:56.617979 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66990113-83fb-43b2-8dfc-9bc024dcc4a9 None admin] PATH_INFO: `/v3/users/c4274e0f0eb24597b73957609b982ef4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:56.619299 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66990113-83fb-43b2-8dfc-9bc024dcc4a9 None admin] RBAC: Authorizing `identity:get_user(user_id=c4274e0f0eb24597b73957609b982ef4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:56.621209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66990113-83fb-43b2-8dfc-9bc024dcc4a9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:56.623255 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 67/134] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:51:56 2022] GET /identity/v3/users/c4274e0f0eb24597b73957609b982ef4 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:56.628363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66990113-83fb-43b2-8dfc-9bc024dcc4a9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:56.722314 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde59e3-6391-48ef-9604-e034309ac05b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:56.758835 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b61ac-128b-4d1f-8a40-a3be32e348a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:56.759745 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b61ac-128b-4d1f-8a40-a3be32e348a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:56.760023 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b61ac-128b-4d1f-8a40-a3be32e348a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:56.760297 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b61ac-128b-4d1f-8a40-a3be32e348a6 None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4/users/c4274e0f0eb24597b73957609b982ef4/roles/20b1a2451e0a42628e0126aa881cac6b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:56.760559 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66990113-83fb-43b2-8dfc-9bc024dcc4a9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:56.762824 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b61ac-128b-4d1f-8a40-a3be32e348a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4, user_id=c4274e0f0eb24597b73957609b982ef4, role_id=20b1a2451e0a42628e0126aa881cac6b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:56.764473 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b61ac-128b-4d1f-8a40-a3be32e348a6 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:56.796299 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 68/135] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:51:56 2022] PUT /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4/users/c4274e0f0eb24597b73957609b982ef4/roles/20b1a2451e0a42628e0126aa881cac6b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:51:56.805015 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d27a7b-2720-4824-a2f8-4be825ce9758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:56.805991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d27a7b-2720-4824-a2f8-4be825ce9758 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:56.806279 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d27a7b-2720-4824-a2f8-4be825ce9758 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:56.806561 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d27a7b-2720-4824-a2f8-4be825ce9758 None admin] PATH_INFO: `/v3/projects/d3f7e623fd474baabc4de824f5fb3f57` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:56.813904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d27a7b-2720-4824-a2f8-4be825ce9758 None admin] RBAC: Authorizing `identity:get_project(project_id=d3f7e623fd474baabc4de824f5fb3f57)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:56.815576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d27a7b-2720-4824-a2f8-4be825ce9758 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:56.817952 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 68/136] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:51:56 2022] GET /identity/v3/projects/d3f7e623fd474baabc4de824f5fb3f57 => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:51:56.824044 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b61ac-128b-4d1f-8a40-a3be32e348a6 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:56.968054 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b61ac-128b-4d1f-8a40-a3be32e348a6 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:57.007823 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b25a81-31da-4c4c-baa6-f8235badf060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:57.008762 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b25a81-31da-4c4c-baa6-f8235badf060 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:57.009069 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b25a81-31da-4c4c-baa6-f8235badf060 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:57.009346 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b25a81-31da-4c4c-baa6-f8235badf060 None admin] PATH_INFO: `/v3/projects/d3f7e623fd474baabc4de824f5fb3f57/users/c4274e0f0eb24597b73957609b982ef4/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:57.011333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b25a81-31da-4c4c-baa6-f8235badf060 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3f7e623fd474baabc4de824f5fb3f57, user_id=c4274e0f0eb24597b73957609b982ef4, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:57.012883 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b25a81-31da-4c4c-baa6-f8235badf060 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:57.027347 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 69/137] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:51:56 2022] PUT /identity/v3/projects/d3f7e623fd474baabc4de824f5fb3f57/users/c4274e0f0eb24597b73957609b982ef4/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:51:57.345717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03ced8-b1b7-46df-81c4-d89fbd84e459 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:57.346087 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03ced8-b1b7-46df-81c4-d89fbd84e459 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:57.346286 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03ced8-b1b7-46df-81c4-d89fbd84e459 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:57.348091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 69/138] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:57.354560 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b40124-fb57-4db9-93cc-24807c5b771f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:57.355431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b40124-fb57-4db9-93cc-24807c5b771f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:57.355903 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b40124-fb57-4db9-93cc-24807c5b771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:57.381889 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-08b40124-fb57-4db9-93cc-24807c5b771f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:57.383407 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-08b40124-fb57-4db9-93cc-24807c5b771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:57.470384 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 70/139] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:51:57.512904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03ced8-b1b7-46df-81c4-d89fbd84e459 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:57.642399 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03ced8-b1b7-46df-81c4-d89fbd84e459 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:57.685848 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a5b6c-64ef-46be-a651-8df1c9a34bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:57.686661 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a5b6c-64ef-46be-a651-8df1c9a34bae None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:57.686945 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a5b6c-64ef-46be-a651-8df1c9a34bae None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:57.687223 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a5b6c-64ef-46be-a651-8df1c9a34bae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:57.701857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a5b6c-64ef-46be-a651-8df1c9a34bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:51:57.709379 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-186a5b6c-64ef-46be-a651-8df1c9a34bae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:51:57.710614 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 70/140] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:51:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:51:57.717875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b40124-fb57-4db9-93cc-24807c5b771f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:57.852781 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b40124-fb57-4db9-93cc-24807c5b771f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:57.901561 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61997ea-f3e9-4121-9d4d-bcf31032039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:57.902552 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61997ea-f3e9-4121-9d4d-bcf31032039e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:57.903047 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61997ea-f3e9-4121-9d4d-bcf31032039e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:57.903513 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61997ea-f3e9-4121-9d4d-bcf31032039e None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:57.904450 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61997ea-f3e9-4121-9d4d-bcf31032039e None admin] RBAC: Adding query filter params (name=member) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:57.904972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61997ea-f3e9-4121-9d4d-bcf31032039e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:57.906540 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61997ea-f3e9-4121-9d4d-bcf31032039e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:57.916097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 71/141] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:51:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:57.925870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a5b6c-64ef-46be-a651-8df1c9a34bae None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:58.068424 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a5b6c-64ef-46be-a651-8df1c9a34bae None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:58.108184 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1fac9-8dab-4594-b63e-694a9ec18f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:58.109090 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1fac9-8dab-4594-b63e-694a9ec18f0f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:58.109373 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1fac9-8dab-4594-b63e-694a9ec18f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:58.109651 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1fac9-8dab-4594-b63e-694a9ec18f0f None admin] PATH_INFO: `/v3/users/c4274e0f0eb24597b73957609b982ef4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:58.110853 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1fac9-8dab-4594-b63e-694a9ec18f0f None admin] RBAC: Authorizing `identity:get_user(user_id=c4274e0f0eb24597b73957609b982ef4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:58.112320 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1fac9-8dab-4594-b63e-694a9ec18f0f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:58.113967 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 71/142] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:51:57 2022] GET /identity/v3/users/c4274e0f0eb24597b73957609b982ef4 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:58.125895 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61997ea-f3e9-4121-9d4d-bcf31032039e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:58.297447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61997ea-f3e9-4121-9d4d-bcf31032039e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:58.343421 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f9ec5-7611-4c68-bcfb-36b5053ecbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:58.344088 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f9ec5-7611-4c68-bcfb-36b5053ecbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:58.344376 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f9ec5-7611-4c68-bcfb-36b5053ecbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:58.344660 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f9ec5-7611-4c68-bcfb-36b5053ecbe5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:58.445899 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f9ec5-7611-4c68-bcfb-36b5053ecbe5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:58.447398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f9ec5-7611-4c68-bcfb-36b5053ecbe5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:58.567088 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 72/143] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:51:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:51:58.572784 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1fac9-8dab-4594-b63e-694a9ec18f0f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:58.691461 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1fac9-8dab-4594-b63e-694a9ec18f0f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:58.732426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f273b-bca9-4986-8be8-fb3599888c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:58.733567 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f273b-bca9-4986-8be8-fb3599888c13 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:58.733992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f273b-bca9-4986-8be8-fb3599888c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:58.734435 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f273b-bca9-4986-8be8-fb3599888c13 None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:58.735824 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f273b-bca9-4986-8be8-fb3599888c13 None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:58.737479 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f273b-bca9-4986-8be8-fb3599888c13 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:58.739994 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 72/144] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:51:58 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:58.746171 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f9ec5-7611-4c68-bcfb-36b5053ecbe5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:58.952583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f9ec5-7611-4c68-bcfb-36b5053ecbe5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:59.030101 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8ec57-e172-443e-b9a0-ba6ed317a4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:59.030780 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8ec57-e172-443e-b9a0-ba6ed317a4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:59.031060 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8ec57-e172-443e-b9a0-ba6ed317a4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:59.031342 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8ec57-e172-443e-b9a0-ba6ed317a4c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:59.032188 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8ec57-e172-443e-b9a0-ba6ed317a4c1 None admin] RBAC: Adding query filter params (role.id=76a348ab64cc49e0b464e3578474c8d6, scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4, user.id=c4274e0f0eb24597b73957609b982ef4) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:51:59.032500 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8ec57-e172-443e-b9a0-ba6ed317a4c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:51:59.033992 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8ec57-e172-443e-b9a0-ba6ed317a4c1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:51:59.047020 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 73/145] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:51:58 2022] GET /identity/v3/role_assignments?user.id=c4274e0f0eb24597b73957609b982ef4&scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4&role.id=76a348ab64cc49e0b464e3578474c8d6 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:51:59.568899 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5b19f-9b51-4e5d-a239-9ad47e8f55db None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:59.569594 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5b19f-9b51-4e5d-a239-9ad47e8f55db None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:59.570080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5b19f-9b51-4e5d-a239-9ad47e8f55db None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:59.572097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 73/146] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:51:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:51:59.577641 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05952ad-b7d2-4445-bacd-f9deaa9fdea7 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:59.578501 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05952ad-b7d2-4445-bacd-f9deaa9fdea7 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:59.578973 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05952ad-b7d2-4445-bacd-f9deaa9fdea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:59.598148 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c05952ad-b7d2-4445-bacd-f9deaa9fdea7 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:51:59.600192 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c05952ad-b7d2-4445-bacd-f9deaa9fdea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:51:59.686198 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 74/147] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:51:59.722016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5b19f-9b51-4e5d-a239-9ad47e8f55db None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:51:59.851259 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5b19f-9b51-4e5d-a239-9ad47e8f55db None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:51:59.897118 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643cfe5-7d86-4d53-b3ba-de5c2adc7a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:51:59.898332 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643cfe5-7d86-4d53-b3ba-de5c2adc7a68 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:51:59.898835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643cfe5-7d86-4d53-b3ba-de5c2adc7a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:51:59.899304 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643cfe5-7d86-4d53-b3ba-de5c2adc7a68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:51:59.913868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643cfe5-7d86-4d53-b3ba-de5c2adc7a68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:51:59.921174 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-c643cfe5-7d86-4d53-b3ba-de5c2adc7a68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:51:59.922633 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 74/148] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:51:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:51:59.929737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05952ad-b7d2-4445-bacd-f9deaa9fdea7 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:00.043284 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05952ad-b7d2-4445-bacd-f9deaa9fdea7 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:00.084409 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a57054-0c1d-4169-a2ca-f416356544b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:00.085112 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a57054-0c1d-4169-a2ca-f416356544b8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:00.085397 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a57054-0c1d-4169-a2ca-f416356544b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:00.085678 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a57054-0c1d-4169-a2ca-f416356544b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:00.086428 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a57054-0c1d-4169-a2ca-f416356544b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:00.086736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a57054-0c1d-4169-a2ca-f416356544b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:00.088131 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a57054-0c1d-4169-a2ca-f416356544b8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:00.096827 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 75/149] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:51:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:00.103067 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643cfe5-7d86-4d53-b3ba-de5c2adc7a68 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:00.184262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8c01-ea0b-41be-9ee5-37b57da3e42d None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:00.184588 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8c01-ea0b-41be-9ee5-37b57da3e42d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:00.184843 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8c01-ea0b-41be-9ee5-37b57da3e42d None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:00.186773 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 76/150] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:52:00.191763 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748a65f-b168-4383-b60f-c5765e892539 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:00.192049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748a65f-b168-4383-b60f-c5765e892539 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:00.192488 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748a65f-b168-4383-b60f-c5765e892539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:00.215388 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643cfe5-7d86-4d53-b3ba-de5c2adc7a68 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:00.218141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9748a65f-b168-4383-b60f-c5765e892539 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:00.219316 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9748a65f-b168-4383-b60f-c5765e892539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:00.250914 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7645a5f-1ce6-407e-9285-fa50ecd72c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:00.251791 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7645a5f-1ce6-407e-9285-fa50ecd72c12 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:00.252238 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7645a5f-1ce6-407e-9285-fa50ecd72c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:00.252686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7645a5f-1ce6-407e-9285-fa50ecd72c12 None admin] PATH_INFO: `/v3/users/5a0a331b12764488a1a2fd987b375820` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:00.254038 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7645a5f-1ce6-407e-9285-fa50ecd72c12 None admin] RBAC: Authorizing `identity:get_user(user_id=5a0a331b12764488a1a2fd987b375820)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:00.255905 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7645a5f-1ce6-407e-9285-fa50ecd72c12 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:00.257733 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 75/151] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:00 2022] GET /identity/v3/users/5a0a331b12764488a1a2fd987b375820 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:00.259243 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3f4d5-bca7-444a-a73d-2b2ababb0cb1 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:00.259701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3f4d5-bca7-444a-a73d-2b2ababb0cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:00.260122 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3f4d5-bca7-444a-a73d-2b2ababb0cb1 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:00.262189 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 76/152] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:00.263297 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3f4d5-bca7-444a-a73d-2b2ababb0cb1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:00.297527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 77/153] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:00.298957 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c667250-8c01-4938-8cbd-58e8cd7d03fa None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:00.299438 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c667250-8c01-4938-8cbd-58e8cd7d03fa None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:00.300644 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c667250-8c01-4938-8cbd-58e8cd7d03fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:00.321508 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7c667250-8c01-4938-8cbd-58e8cd7d03fa None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:00.323453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7c667250-8c01-4938-8cbd-58e8cd7d03fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:00.367652 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3f4d5-bca7-444a-a73d-2b2ababb0cb1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:00.397379 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 78/154] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:00.398221 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c667250-8c01-4938-8cbd-58e8cd7d03fa None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:00.413772 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4cd25-f017-44a8-96aa-3f7dcdb34be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:00.414461 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4cd25-f017-44a8-96aa-3f7dcdb34be2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:00.414729 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4cd25-f017-44a8-96aa-3f7dcdb34be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:00.414994 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4cd25-f017-44a8-96aa-3f7dcdb34be2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:00.485714 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4cd25-f017-44a8-96aa-3f7dcdb34be2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:00.487191 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4cd25-f017-44a8-96aa-3f7dcdb34be2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:00.498134 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c667250-8c01-4938-8cbd-58e8cd7d03fa None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:00.529987 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b0557-ac42-420a-85fe-1396e75737d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:00.530775 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b0557-ac42-420a-85fe-1396e75737d2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:00.531052 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b0557-ac42-420a-85fe-1396e75737d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:00.531323 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b0557-ac42-420a-85fe-1396e75737d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:00.541146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b0557-ac42-420a-85fe-1396e75737d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:00.548037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-884b0557-ac42-420a-85fe-1396e75737d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:52:00.549240 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 79/155] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:00.552220 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8412239-1f0c-4cfa-947e-c32d40998e43 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:00.552511 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8412239-1f0c-4cfa-947e-c32d40998e43 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:00.552812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8412239-1f0c-4cfa-947e-c32d40998e43 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:00.554889 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 80/156] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:00.555728 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f055958-7c89-4d70-b328-7db2564570f0 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:00.555967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f055958-7c89-4d70-b328-7db2564570f0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:00.556246 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f055958-7c89-4d70-b328-7db2564570f0 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:00.559244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 81/157] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:00.559244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f055958-7c89-4d70-b328-7db2564570f0 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:00.587365 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 77/158] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 04:52:00.587365 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4cd25-f017-44a8-96aa-3f7dcdb34be2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:00.658924 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f055958-7c89-4d70-b328-7db2564570f0 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:00.677936 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4cd25-f017-44a8-96aa-3f7dcdb34be2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:00.690974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f15fb8-e612-4a36-9615-853efafa0e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:00.691758 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f15fb8-e612-4a36-9615-853efafa0e63 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:00.692038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f15fb8-e612-4a36-9615-853efafa0e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:00.692857 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f15fb8-e612-4a36-9615-853efafa0e63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:00.694170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f15fb8-e612-4a36-9615-853efafa0e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:00.695621 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f15fb8-e612-4a36-9615-853efafa0e63 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:00.697262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 82/159] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:00.697262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29ee17-e4e2-4d2c-a088-ee64539186a0 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:00.697262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29ee17-e4e2-4d2c-a088-ee64539186a0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:00.697262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29ee17-e4e2-4d2c-a088-ee64539186a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:00.711725 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867984a5-4e7e-4b18-870f-930eab18a405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:00.712396 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867984a5-4e7e-4b18-870f-930eab18a405 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:00.712675 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867984a5-4e7e-4b18-870f-930eab18a405 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:00.713007 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867984a5-4e7e-4b18-870f-930eab18a405 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:00.713750 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867984a5-4e7e-4b18-870f-930eab18a405 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:00.714053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867984a5-4e7e-4b18-870f-930eab18a405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:00.714961 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1a29ee17-e4e2-4d2c-a088-ee64539186a0 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:00.715430 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867984a5-4e7e-4b18-870f-930eab18a405 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:00.716126 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1a29ee17-e4e2-4d2c-a088-ee64539186a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:00.723223 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 78/160] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:00.724447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d609f1-7960-4554-ac99-3cb4845338cc None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:00.724695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d609f1-7960-4554-ac99-3cb4845338cc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:00.725002 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d609f1-7960-4554-ac99-3cb4845338cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:00.743213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-33d609f1-7960-4554-ac99-3cb4845338cc None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:00.744402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-33d609f1-7960-4554-ac99-3cb4845338cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:00.779965 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 83/161] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:00.780813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29ee17-e4e2-4d2c-a088-ee64539186a0 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:00.808243 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 79/162] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:00.809080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d609f1-7960-4554-ac99-3cb4845338cc None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:00.875274 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29ee17-e4e2-4d2c-a088-ee64539186a0 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:00.902620 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d609f1-7960-4554-ac99-3cb4845338cc None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:00.908092 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b8521-4e4f-462c-9b35-096f13e061a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:00.909023 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b8521-4e4f-462c-9b35-096f13e061a8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:00.909250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b8521-4e4f-462c-9b35-096f13e061a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:00.909522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b8521-4e4f-462c-9b35-096f13e061a8 None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:00.910684 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b8521-4e4f-462c-9b35-096f13e061a8 None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:00.912390 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b8521-4e4f-462c-9b35-096f13e061a8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:00.914094 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 84/163] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:00 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:00.914840 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b8521-4e4f-462c-9b35-096f13e061a8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:00.934930 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19fc8c-e91a-4857-aba1-94d8e4b8babb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:00.935601 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19fc8c-e91a-4857-aba1-94d8e4b8babb None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:00.935878 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19fc8c-e91a-4857-aba1-94d8e4b8babb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:00.936151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19fc8c-e91a-4857-aba1-94d8e4b8babb None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:00.936898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19fc8c-e91a-4857-aba1-94d8e4b8babb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:00.938369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19fc8c-e91a-4857-aba1-94d8e4b8babb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:00.957768 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 80/164] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:52:00 2022] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:52:00.958780 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19fc8c-e91a-4857-aba1-94d8e4b8babb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:01.027198 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b8521-4e4f-462c-9b35-096f13e061a8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:01.063113 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9746f-5bc6-4a04-9d9d-0bb3e6b4ad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:01.064006 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9746f-5bc6-4a04-9d9d-0bb3e6b4ad83 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:01.064282 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9746f-5bc6-4a04-9d9d-0bb3e6b4ad83 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:01.064551 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9746f-5bc6-4a04-9d9d-0bb3e6b4ad83 None admin] PATH_INFO: `/v3/users/749b4c712abc46cbbe4074b7d1ca8347` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:01.065457 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19fc8c-e91a-4857-aba1-94d8e4b8babb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:01.065834 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9746f-5bc6-4a04-9d9d-0bb3e6b4ad83 None admin] RBAC: Authorizing `identity:get_user(user_id=749b4c712abc46cbbe4074b7d1ca8347)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:01.067891 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9746f-5bc6-4a04-9d9d-0bb3e6b4ad83 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:01.074227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 85/165] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:00 2022] GET /identity/v3/users/749b4c712abc46cbbe4074b7d1ca8347 => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:01.074227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9746f-5bc6-4a04-9d9d-0bb3e6b4ad83 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:01.107441 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3f1c0-f55f-4c1d-9f37-5aff82637622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:01.108247 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3f1c0-f55f-4c1d-9f37-5aff82637622 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:01.108522 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3f1c0-f55f-4c1d-9f37-5aff82637622 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:01.108815 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3f1c0-f55f-4c1d-9f37-5aff82637622 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:01.120445 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3f1c0-f55f-4c1d-9f37-5aff82637622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:01.127679 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-0ae3f1c0-f55f-4c1d-9f37-5aff82637622 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:52:01.129111 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 81/166] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:01.131815 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3f1c0-f55f-4c1d-9f37-5aff82637622 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:01.174455 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9746f-5bc6-4a04-9d9d-0bb3e6b4ad83 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:01.212538 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5be18-656c-4a58-8c48-cf23142c94a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:01.213387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5be18-656c-4a58-8c48-cf23142c94a3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:01.213664 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5be18-656c-4a58-8c48-cf23142c94a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:01.214329 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5be18-656c-4a58-8c48-cf23142c94a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:01.226159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5be18-656c-4a58-8c48-cf23142c94a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:01.234720 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-39a5be18-656c-4a58-8c48-cf23142c94a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:52:01.235908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 86/167] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:52:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:01.240985 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5be18-656c-4a58-8c48-cf23142c94a3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:01.244179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3f1c0-f55f-4c1d-9f37-5aff82637622 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:01.291791 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1436c73-e27f-45d2-baff-f15a3ef9f842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:01.292464 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1436c73-e27f-45d2-baff-f15a3ef9f842 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:01.292740 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1436c73-e27f-45d2-baff-f15a3ef9f842 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:01.293046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1436c73-e27f-45d2-baff-f15a3ef9f842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:01.293882 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1436c73-e27f-45d2-baff-f15a3ef9f842 None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4, user.id=5a0a331b12764488a1a2fd987b375820) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:01.294187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1436c73-e27f-45d2-baff-f15a3ef9f842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:01.295654 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1436c73-e27f-45d2-baff-f15a3ef9f842 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:01.303129 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 82/168] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:01 2022] GET /identity/v3/role_assignments?user.id=5a0a331b12764488a1a2fd987b375820&scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:01.304375 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1436c73-e27f-45d2-baff-f15a3ef9f842 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:01.360562 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5be18-656c-4a58-8c48-cf23142c94a3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:01.400305 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8445d8-e228-4e1c-b26e-50c51a06739a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:01.401212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8445d8-e228-4e1c-b26e-50c51a06739a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:01.401492 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8445d8-e228-4e1c-b26e-50c51a06739a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:01.401763 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8445d8-e228-4e1c-b26e-50c51a06739a None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:01.402981 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8445d8-e228-4e1c-b26e-50c51a06739a None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:01.404454 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8445d8-e228-4e1c-b26e-50c51a06739a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:01.406458 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 87/169] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:01 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:01.407276 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8445d8-e228-4e1c-b26e-50c51a06739a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:01.444962 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1436c73-e27f-45d2-baff-f15a3ef9f842 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:01.492717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4eb69c-65fc-43ab-bd86-1ec9c12b1909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:01.493543 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4eb69c-65fc-43ab-bd86-1ec9c12b1909 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:01.493823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4eb69c-65fc-43ab-bd86-1ec9c12b1909 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:01.494094 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4eb69c-65fc-43ab-bd86-1ec9c12b1909 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:01.495738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4eb69c-65fc-43ab-bd86-1ec9c12b1909 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:01.496045 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4eb69c-65fc-43ab-bd86-1ec9c12b1909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:01.499573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4eb69c-65fc-43ab-bd86-1ec9c12b1909 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:01.516386 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 83/170] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:01.517619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4eb69c-65fc-43ab-bd86-1ec9c12b1909 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:01.527506 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8445d8-e228-4e1c-b26e-50c51a06739a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:01.576528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d97cc-02ec-407b-a4be-cb5144dabb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:01.577245 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d97cc-02ec-407b-a4be-cb5144dabb27 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:01.577553 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d97cc-02ec-407b-a4be-cb5144dabb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:01.577827 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d97cc-02ec-407b-a4be-cb5144dabb27 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:01.578573 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d97cc-02ec-407b-a4be-cb5144dabb27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:01.578877 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d97cc-02ec-407b-a4be-cb5144dabb27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:01.580250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d97cc-02ec-407b-a4be-cb5144dabb27 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:01.589119 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 88/171] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:01.589950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d97cc-02ec-407b-a4be-cb5144dabb27 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:01.658438 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4eb69c-65fc-43ab-bd86-1ec9c12b1909 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:01.694478 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d97cc-02ec-407b-a4be-cb5144dabb27 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:01.696946 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc0b03-1707-4f2f-9c93-77a323079062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:01.697799 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc0b03-1707-4f2f-9c93-77a323079062 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:01.698074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc0b03-1707-4f2f-9c93-77a323079062 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:01.698340 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc0b03-1707-4f2f-9c93-77a323079062 None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4/users/749b4c712abc46cbbe4074b7d1ca8347/roles/3f29e38dee7541f59eebc4b335c9237f` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:01.700386 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc0b03-1707-4f2f-9c93-77a323079062 None admin] RBAC: Authorizing `identity:create_grant(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4, user_id=749b4c712abc46cbbe4074b7d1ca8347, role_id=3f29e38dee7541f59eebc4b335c9237f)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:01.701964 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc0b03-1707-4f2f-9c93-77a323079062 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:01.718816 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 84/172] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:52:01 2022] PUT /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4/users/749b4c712abc46cbbe4074b7d1ca8347/roles/3f29e38dee7541f59eebc4b335c9237f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:52:01.719708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc0b03-1707-4f2f-9c93-77a323079062 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:01.731606 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44e5f3-1154-4fb2-9e48-2d5280f4ca65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:01.732510 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44e5f3-1154-4fb2-9e48-2d5280f4ca65 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:01.732772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44e5f3-1154-4fb2-9e48-2d5280f4ca65 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:01.733079 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44e5f3-1154-4fb2-9e48-2d5280f4ca65 None admin] PATH_INFO: `/v3/users/c4274e0f0eb24597b73957609b982ef4` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:01.734352 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44e5f3-1154-4fb2-9e48-2d5280f4ca65 None admin] RBAC: Authorizing `identity:get_user(user_id=c4274e0f0eb24597b73957609b982ef4)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:01.735824 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec44e5f3-1154-4fb2-9e48-2d5280f4ca65 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:01.737754 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 89/173] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:01 2022] GET /identity/v3/users/c4274e0f0eb24597b73957609b982ef4 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:01.743721 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44e5f3-1154-4fb2-9e48-2d5280f4ca65 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:01.830728 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc0b03-1707-4f2f-9c93-77a323079062 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:01.852947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44e5f3-1154-4fb2-9e48-2d5280f4ca65 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:01.878895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a6a56-a8c1-4893-a8ff-4143c3cbbf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:01.879879 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a6a56-a8c1-4893-a8ff-4143c3cbbf3f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:01.880206 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a6a56-a8c1-4893-a8ff-4143c3cbbf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:01.880481 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a6a56-a8c1-4893-a8ff-4143c3cbbf3f None admin] PATH_INFO: `/v3/users/c4274e0f0eb24597b73957609b982ef4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:01.885696 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a6a56-a8c1-4893-a8ff-4143c3cbbf3f None admin] RBAC: Authorizing `identity:get_user(user_id=c4274e0f0eb24597b73957609b982ef4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:01.887171 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a6a56-a8c1-4893-a8ff-4143c3cbbf3f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:01.888910 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 85/174] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:01 2022] GET /identity/v3/users/c4274e0f0eb24597b73957609b982ef4 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:01.889408 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b814a-1a52-4e2a-945a-5ae61822b81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:01.890070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b814a-1a52-4e2a-945a-5ae61822b81d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:01.890349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b814a-1a52-4e2a-945a-5ae61822b81d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:01.890624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b814a-1a52-4e2a-945a-5ae61822b81d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:01.895839 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a6a56-a8c1-4893-a8ff-4143c3cbbf3f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:01.964071 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b814a-1a52-4e2a-945a-5ae61822b81d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:01.965533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b814a-1a52-4e2a-945a-5ae61822b81d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:02.073377 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a6a56-a8c1-4893-a8ff-4143c3cbbf3f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:02.074117 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 90/175] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 04:52:02.079780 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b814a-1a52-4e2a-945a-5ae61822b81d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:02.123382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcb0f0-9cc1-46e4-9e7a-c706c25deb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:02.124043 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcb0f0-9cc1-46e4-9e7a-c706c25deb4c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:02.124319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcb0f0-9cc1-46e4-9e7a-c706c25deb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:02.124591 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcb0f0-9cc1-46e4-9e7a-c706c25deb4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:02.186354 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b814a-1a52-4e2a-945a-5ae61822b81d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:02.194202 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcb0f0-9cc1-46e4-9e7a-c706c25deb4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:02.196063 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcb0f0-9cc1-46e4-9e7a-c706c25deb4c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:02.226090 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381102ff-9a5c-4a30-9953-568ea8042687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:02.226090 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381102ff-9a5c-4a30-9953-568ea8042687 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:02.226090 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381102ff-9a5c-4a30-9953-568ea8042687 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:02.226090 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381102ff-9a5c-4a30-9953-568ea8042687 None admin] PATH_INFO: `/v3/projects/d3f7e623fd474baabc4de824f5fb3f57` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:02.228110 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381102ff-9a5c-4a30-9953-568ea8042687 None admin] RBAC: Authorizing `identity:get_project(project_id=d3f7e623fd474baabc4de824f5fb3f57)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:02.229378 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381102ff-9a5c-4a30-9953-568ea8042687 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:02.231699 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 91/176] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:02 2022] GET /identity/v3/projects/d3f7e623fd474baabc4de824f5fb3f57 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:02.236319 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381102ff-9a5c-4a30-9953-568ea8042687 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:02.298685 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 86/177] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 04:52:02.305699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcb0f0-9cc1-46e4-9e7a-c706c25deb4c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:02.359823 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381102ff-9a5c-4a30-9953-568ea8042687 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:02.406585 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcb0f0-9cc1-46e4-9e7a-c706c25deb4c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:02.416571 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb557c-0599-440c-a6d2-bffadbf1e605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:02.417259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb557c-0599-440c-a6d2-bffadbf1e605 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:02.417529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb557c-0599-440c-a6d2-bffadbf1e605 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:02.417794 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb557c-0599-440c-a6d2-bffadbf1e605 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:02.418628 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb557c-0599-440c-a6d2-bffadbf1e605 None admin] RBAC: Adding query filter params (role.id=76a348ab64cc49e0b464e3578474c8d6, scope.project.id=d3f7e623fd474baabc4de824f5fb3f57, user.id=c4274e0f0eb24597b73957609b982ef4) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:02.418936 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb557c-0599-440c-a6d2-bffadbf1e605 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:02.420380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb557c-0599-440c-a6d2-bffadbf1e605 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:02.433215 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 92/178] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:02 2022] GET /identity/v3/role_assignments?user.id=c4274e0f0eb24597b73957609b982ef4&scope.project.id=d3f7e623fd474baabc4de824f5fb3f57&role.id=76a348ab64cc49e0b464e3578474c8d6 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:02.453688 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff7bbd-875c-47eb-a73f-8cd320b1e382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:02.454590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff7bbd-875c-47eb-a73f-8cd320b1e382 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:02.454866 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff7bbd-875c-47eb-a73f-8cd320b1e382 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:02.455133 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff7bbd-875c-47eb-a73f-8cd320b1e382 None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:02.456508 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff7bbd-875c-47eb-a73f-8cd320b1e382 None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:02.458104 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff7bbd-875c-47eb-a73f-8cd320b1e382 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:02.460152 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 87/179] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:02 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:02.466668 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb557c-0599-440c-a6d2-bffadbf1e605 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:02.589800 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb557c-0599-440c-a6d2-bffadbf1e605 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:02.628189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad47fc0-9160-4f3d-92c8-59494ee45d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:02.628884 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad47fc0-9160-4f3d-92c8-59494ee45d24 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:02.629165 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad47fc0-9160-4f3d-92c8-59494ee45d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:02.629439 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad47fc0-9160-4f3d-92c8-59494ee45d24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:02.631182 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad47fc0-9160-4f3d-92c8-59494ee45d24 None admin] RBAC: Adding query filter params (role.id=20b1a2451e0a42628e0126aa881cac6b, scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4, user.id=c4274e0f0eb24597b73957609b982ef4) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:02.631542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad47fc0-9160-4f3d-92c8-59494ee45d24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:02.633087 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad47fc0-9160-4f3d-92c8-59494ee45d24 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:02.640041 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 93/180] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:02 2022] GET /identity/v3/role_assignments?user.id=c4274e0f0eb24597b73957609b982ef4&scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4&role.id=20b1a2451e0a42628e0126aa881cac6b => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:04.170436 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a94061-1af8-4d6e-8923-8e1d83c63022 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:04.171119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a94061-1af8-4d6e-8923-8e1d83c63022 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:04.171119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a94061-1af8-4d6e-8923-8e1d83c63022 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:04.173018 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 88/181] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:04.179103 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51fdc9-1676-4d5c-a9c9-e87d08e218a8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:04.179615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51fdc9-1676-4d5c-a9c9-e87d08e218a8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:04.179767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51fdc9-1676-4d5c-a9c9-e87d08e218a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:04.197959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8c51fdc9-1676-4d5c-a9c9-e87d08e218a8 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:04.199136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8c51fdc9-1676-4d5c-a9c9-e87d08e218a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:04.268397 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 94/182] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:04.291991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a94061-1af8-4d6e-8923-8e1d83c63022 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:04.372740 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883b19-2f44-4fda-b370-a47ebefe7d37 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:04.373414 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883b19-2f44-4fda-b370-a47ebefe7d37 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:04.373915 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29883b19-2f44-4fda-b370-a47ebefe7d37 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:04.375909 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 95/183] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:52:04.381733 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565998f2-6fa6-4d6b-b44d-a8ef3c8f6cbb None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:04.382272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565998f2-6fa6-4d6b-b44d-a8ef3c8f6cbb None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:04.383128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565998f2-6fa6-4d6b-b44d-a8ef3c8f6cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:04.402207 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a94061-1af8-4d6e-8923-8e1d83c63022 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:04.403421 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-565998f2-6fa6-4d6b-b44d-a8ef3c8f6cbb None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:04.404614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-565998f2-6fa6-4d6b-b44d-a8ef3c8f6cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:04.439421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bd54a-9738-47a8-922f-901e770247f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:04.440241 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bd54a-9738-47a8-922f-901e770247f0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:04.440523 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bd54a-9738-47a8-922f-901e770247f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:04.440828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bd54a-9738-47a8-922f-901e770247f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:04.452815 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bd54a-9738-47a8-922f-901e770247f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:04.462159 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-aa7bd54a-9738-47a8-922f-901e770247f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:52:04.463408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 89/184] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:52:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:04.464693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1b471-75e8-4ee4-83b8-bb21853f3989 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:04.464998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1b471-75e8-4ee4-83b8-bb21853f3989 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:04.465272 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1b471-75e8-4ee4-83b8-bb21853f3989 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:04.467076 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 90/185] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:04.469766 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1b471-75e8-4ee4-83b8-bb21853f3989 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:04.485088 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 96/186] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:04.486424 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dcb04-9c45-46ae-9900-6fbab7da7941 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:04.486705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dcb04-9c45-46ae-9900-6fbab7da7941 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:04.486975 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dcb04-9c45-46ae-9900-6fbab7da7941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:04.514766 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ee3dcb04-9c45-46ae-9900-6fbab7da7941 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:04.515938 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ee3dcb04-9c45-46ae-9900-6fbab7da7941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:04.578169 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1b471-75e8-4ee4-83b8-bb21853f3989 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:04.588854 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 97/187] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:04.588854 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dcb04-9c45-46ae-9900-6fbab7da7941 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:04.616191 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c47961-5015-4b09-8121-e67062948a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:04.616998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c47961-5015-4b09-8121-e67062948a85 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:04.617282 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c47961-5015-4b09-8121-e67062948a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:04.617561 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c47961-5015-4b09-8121-e67062948a85 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:04.618315 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c47961-5015-4b09-8121-e67062948a85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:04.618621 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c47961-5015-4b09-8121-e67062948a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:04.620304 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c47961-5015-4b09-8121-e67062948a85 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:04.629056 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 91/188] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:04.629739 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c47961-5015-4b09-8121-e67062948a85 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:04.701187 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dcb04-9c45-46ae-9900-6fbab7da7941 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:04.727080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c47961-5015-4b09-8121-e67062948a85 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:04.734967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1cd72-babc-4fe0-8cd1-d3407f70c416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:04.735777 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1cd72-babc-4fe0-8cd1-d3407f70c416 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:04.736066 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1cd72-babc-4fe0-8cd1-d3407f70c416 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:04.736335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1cd72-babc-4fe0-8cd1-d3407f70c416 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:04.747308 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1cd72-babc-4fe0-8cd1-d3407f70c416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:04.754875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-8dc1cd72-babc-4fe0-8cd1-d3407f70c416 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:52:04.756053 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 98/189] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:52:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:04.756053 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1cd72-babc-4fe0-8cd1-d3407f70c416 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:04.765438 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25391c8-156c-49b4-bf17-1ef401ca8153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:04.766244 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25391c8-156c-49b4-bf17-1ef401ca8153 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:04.766521 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25391c8-156c-49b4-bf17-1ef401ca8153 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:04.766795 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25391c8-156c-49b4-bf17-1ef401ca8153 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:04.767958 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25391c8-156c-49b4-bf17-1ef401ca8153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:04.769461 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25391c8-156c-49b4-bf17-1ef401ca8153 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:04.775292 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 92/190] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:04.775292 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25391c8-156c-49b4-bf17-1ef401ca8153 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:04.852575 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1cd72-babc-4fe0-8cd1-d3407f70c416 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:04.869014 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25391c8-156c-49b4-bf17-1ef401ca8153 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:04.885324 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ccfbf-14e2-4691-9565-a897c5394388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:04.886194 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ccfbf-14e2-4691-9565-a897c5394388 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:04.886475 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ccfbf-14e2-4691-9565-a897c5394388 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:04.886749 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ccfbf-14e2-4691-9565-a897c5394388 None admin] PATH_INFO: `/v3/users/22b327d6eb3c4a63a4d8d54e91ac0a59` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:04.899919 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ccfbf-14e2-4691-9565-a897c5394388 None admin] RBAC: Authorizing `identity:get_user(user_id=22b327d6eb3c4a63a4d8d54e91ac0a59)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:04.901436 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ccfbf-14e2-4691-9565-a897c5394388 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:04.901759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf44905-d30a-406f-877b-d5191c709f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:04.902422 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf44905-d30a-406f-877b-d5191c709f0a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:04.902702 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf44905-d30a-406f-877b-d5191c709f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:04.902973 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf44905-d30a-406f-877b-d5191c709f0a None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:04.903100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 99/191] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:04 2022] GET /identity/v3/users/22b327d6eb3c4a63a4d8d54e91ac0a59 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:04.903822 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ccfbf-14e2-4691-9565-a897c5394388 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:04.908396 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf44905-d30a-406f-877b-d5191c709f0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:04.908716 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf44905-d30a-406f-877b-d5191c709f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:04.910117 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf44905-d30a-406f-877b-d5191c709f0a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:04.918507 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 93/192] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:04.919752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f945b04-e93c-4b28-be39-2d0f305afcba None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:04.920038 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f945b04-e93c-4b28-be39-2d0f305afcba None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:04.920326 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f945b04-e93c-4b28-be39-2d0f305afcba None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:04.922124 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 94/193] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:04.922671 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f945b04-e93c-4b28-be39-2d0f305afcba None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:04.999626 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ccfbf-14e2-4691-9565-a897c5394388 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:05.021197 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f945b04-e93c-4b28-be39-2d0f305afcba None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:05.031856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec3500-5eb9-4fb2-9977-833ce872885c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:05.032519 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec3500-5eb9-4fb2-9977-833ce872885c None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:05.032812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec3500-5eb9-4fb2-9977-833ce872885c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:05.033107 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec3500-5eb9-4fb2-9977-833ce872885c None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:05.033812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec3500-5eb9-4fb2-9977-833ce872885c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:05.035256 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec3500-5eb9-4fb2-9977-833ce872885c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:05.054411 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a536315-8b90-49f5-a1f8-c72e5a69c9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:05.054798 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 100/194] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:52:04 2022] POST /identity/v3/users => generated 297 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:52:05.069031 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a536315-8b90-49f5-a1f8-c72e5a69c9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:05.069031 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a536315-8b90-49f5-a1f8-c72e5a69c9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:05.069031 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a536315-8b90-49f5-a1f8-c72e5a69c9c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:05.069285 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec3500-5eb9-4fb2-9977-833ce872885c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:05.128401 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a536315-8b90-49f5-a1f8-c72e5a69c9c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:05.129986 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a536315-8b90-49f5-a1f8-c72e5a69c9c4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:05.161433 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec3500-5eb9-4fb2-9977-833ce872885c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:05.197659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b7aea-1cbd-47fb-83eb-461efb453671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:05.198581 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b7aea-1cbd-47fb-83eb-461efb453671 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:05.198917 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b7aea-1cbd-47fb-83eb-461efb453671 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:05.199228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b7aea-1cbd-47fb-83eb-461efb453671 None admin] PATH_INFO: `/v3/users/22b327d6eb3c4a63a4d8d54e91ac0a59` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:05.200852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b7aea-1cbd-47fb-83eb-461efb453671 None admin] RBAC: Authorizing `identity:get_user(user_id=22b327d6eb3c4a63a4d8d54e91ac0a59)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:05.202577 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b7aea-1cbd-47fb-83eb-461efb453671 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:05.204608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 101/195] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:05 2022] GET /identity/v3/users/22b327d6eb3c4a63a4d8d54e91ac0a59 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:05.206236 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38415486-2ae6-4b44-9c99-a2b3d7eb2411 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:05.206545 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38415486-2ae6-4b44-9c99-a2b3d7eb2411 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:05.206838 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38415486-2ae6-4b44-9c99-a2b3d7eb2411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:05.226930 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-38415486-2ae6-4b44-9c99-a2b3d7eb2411 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:05.228150 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-38415486-2ae6-4b44-9c99-a2b3d7eb2411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:05.243132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 95/196] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:05.243132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a536315-8b90-49f5-a1f8-c72e5a69c9c4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:05.300680 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 102/197] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:05.305747 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38415486-2ae6-4b44-9c99-a2b3d7eb2411 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:05.351764 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a536315-8b90-49f5-a1f8-c72e5a69c9c4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:05.393478 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcf2ca-ecfe-47be-9f72-f944d0ef22ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:05.394154 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcf2ca-ecfe-47be-9f72-f944d0ef22ba None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:05.394417 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcf2ca-ecfe-47be-9f72-f944d0ef22ba None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:05.394692 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcf2ca-ecfe-47be-9f72-f944d0ef22ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:05.416334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38415486-2ae6-4b44-9c99-a2b3d7eb2411 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:05.457993 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1cb19-86b2-4ecf-8457-ea6c11a81fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:05.459728 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1cb19-86b2-4ecf-8457-ea6c11a81fcf None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:05.460184 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1cb19-86b2-4ecf-8457-ea6c11a81fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:05.460936 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1cb19-86b2-4ecf-8457-ea6c11a81fcf None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:05.462961 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1cb19-86b2-4ecf-8457-ea6c11a81fcf None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:05.464734 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1cb19-86b2-4ecf-8457-ea6c11a81fcf None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:05.467762 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 103/198] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:05 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:05.468778 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1cb19-86b2-4ecf-8457-ea6c11a81fcf None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:05.471822 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcf2ca-ecfe-47be-9f72-f944d0ef22ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:05.475448 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcf2ca-ecfe-47be-9f72-f944d0ef22ba None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:05.584870 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1cb19-86b2-4ecf-8457-ea6c11a81fcf None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:05.605054 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 96/199] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:05.606300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcf2ca-ecfe-47be-9f72-f944d0ef22ba None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:05.623808 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c8a0-4101-4564-b92f-eb6b2ee37a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:05.624691 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c8a0-4101-4564-b92f-eb6b2ee37a56 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:05.625098 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c8a0-4101-4564-b92f-eb6b2ee37a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:05.625442 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c8a0-4101-4564-b92f-eb6b2ee37a56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:05.636564 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547c8a0-4101-4564-b92f-eb6b2ee37a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:05.643799 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-d547c8a0-4101-4564-b92f-eb6b2ee37a56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:52:05.645279 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 104/200] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:05.645948 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c8a0-4101-4564-b92f-eb6b2ee37a56 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:05.720010 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcf2ca-ecfe-47be-9f72-f944d0ef22ba None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:05.754849 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cc76c-d353-436a-a2cb-33901576816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:05.755860 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cc76c-d353-436a-a2cb-33901576816e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:05.756230 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cc76c-d353-436a-a2cb-33901576816e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:05.756576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46cc76c-d353-436a-a2cb-33901576816e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:05.757673 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cc76c-d353-436a-a2cb-33901576816e None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=128e459def144365b3b01282148ec980, user.id=22b327d6eb3c4a63a4d8d54e91ac0a59) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:05.758364 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cc76c-d353-436a-a2cb-33901576816e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:05.760131 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46cc76c-d353-436a-a2cb-33901576816e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:05.761125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c8a0-4101-4564-b92f-eb6b2ee37a56 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:05.770886 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 97/201] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:05 2022] GET /identity/v3/role_assignments?user.id=22b327d6eb3c4a63a4d8d54e91ac0a59&scope.project.id=128e459def144365b3b01282148ec980&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:05.772133 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cc76c-d353-436a-a2cb-33901576816e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:05.837008 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40d5a4-659e-4c4a-91af-ce7a72ee306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:05.838335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40d5a4-659e-4c4a-91af-ce7a72ee306d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:05.838865 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40d5a4-659e-4c4a-91af-ce7a72ee306d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:05.839383 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40d5a4-659e-4c4a-91af-ce7a72ee306d None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:05.846402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40d5a4-659e-4c4a-91af-ce7a72ee306d None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:05.847302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40d5a4-659e-4c4a-91af-ce7a72ee306d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:05.849197 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 105/202] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:05 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:05.854900 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40d5a4-659e-4c4a-91af-ce7a72ee306d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:05.917556 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46cc76c-d353-436a-a2cb-33901576816e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:05.962014 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7b2f6-233e-4a0d-81a1-fce0122c7287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:05.963075 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b2f6-233e-4a0d-81a1-fce0122c7287 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:05.963597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b2f6-233e-4a0d-81a1-fce0122c7287 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:05.963875 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7b2f6-233e-4a0d-81a1-fce0122c7287 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:05.964643 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7b2f6-233e-4a0d-81a1-fce0122c7287 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:05.964976 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7b2f6-233e-4a0d-81a1-fce0122c7287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:05.966382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7b2f6-233e-4a0d-81a1-fce0122c7287 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:05.984593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 98/203] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:05.985957 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7b2f6-233e-4a0d-81a1-fce0122c7287 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:06.031756 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40d5a4-659e-4c4a-91af-ce7a72ee306d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:06.066271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e185a-7c13-4da5-80b1-7d7d46ea4971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:06.066933 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e185a-7c13-4da5-80b1-7d7d46ea4971 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:06.067329 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e185a-7c13-4da5-80b1-7d7d46ea4971 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:06.067610 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e185a-7c13-4da5-80b1-7d7d46ea4971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:06.068450 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e185a-7c13-4da5-80b1-7d7d46ea4971 None admin] RBAC: Adding query filter params (role.id=20b1a2451e0a42628e0126aa881cac6b, scope.project.id=128e459def144365b3b01282148ec980, user.id=22b327d6eb3c4a63a4d8d54e91ac0a59) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:06.068761 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e185a-7c13-4da5-80b1-7d7d46ea4971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:06.070288 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e185a-7c13-4da5-80b1-7d7d46ea4971 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:06.076085 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 106/204] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:05 2022] GET /identity/v3/role_assignments?user.id=22b327d6eb3c4a63a4d8d54e91ac0a59&scope.project.id=128e459def144365b3b01282148ec980&role.id=20b1a2451e0a42628e0126aa881cac6b => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:06.133118 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7b2f6-233e-4a0d-81a1-fce0122c7287 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:06.183629 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea39b6-6ede-4688-8f7f-fcc62c449ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:06.184512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea39b6-6ede-4688-8f7f-fcc62c449ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:06.184813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea39b6-6ede-4688-8f7f-fcc62c449ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:06.185087 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea39b6-6ede-4688-8f7f-fcc62c449ea5 None admin] PATH_INFO: `/v3/users/749b4c712abc46cbbe4074b7d1ca8347` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:06.186327 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea39b6-6ede-4688-8f7f-fcc62c449ea5 None admin] RBAC: Authorizing `identity:get_user(user_id=749b4c712abc46cbbe4074b7d1ca8347)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:06.187815 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea39b6-6ede-4688-8f7f-fcc62c449ea5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:06.189538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 99/205] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:05 2022] GET /identity/v3/users/749b4c712abc46cbbe4074b7d1ca8347 => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:06.195886 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e185a-7c13-4da5-80b1-7d7d46ea4971 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:06.324719 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e185a-7c13-4da5-80b1-7d7d46ea4971 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:06.358867 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3246d23-cdb1-47d0-8e1f-2d2a42aedb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:06.359533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3246d23-cdb1-47d0-8e1f-2d2a42aedb65 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:06.359816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3246d23-cdb1-47d0-8e1f-2d2a42aedb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:06.360173 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3246d23-cdb1-47d0-8e1f-2d2a42aedb65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:06.429900 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3246d23-cdb1-47d0-8e1f-2d2a42aedb65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:06.431411 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3246d23-cdb1-47d0-8e1f-2d2a42aedb65 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:06.533508 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 107/206] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:06.539300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea39b6-6ede-4688-8f7f-fcc62c449ea5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:06.691333 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea39b6-6ede-4688-8f7f-fcc62c449ea5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:06.724941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551c770-e1da-488a-aa3d-f8408cb634f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:06.725812 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551c770-e1da-488a-aa3d-f8408cb634f2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:06.726086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551c770-e1da-488a-aa3d-f8408cb634f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:06.726353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551c770-e1da-488a-aa3d-f8408cb634f2 None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:06.727555 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551c770-e1da-488a-aa3d-f8408cb634f2 None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:06.729051 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551c770-e1da-488a-aa3d-f8408cb634f2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:06.731053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 100/207] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:06 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:06.736774 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3246d23-cdb1-47d0-8e1f-2d2a42aedb65 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:06.835916 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3246d23-cdb1-47d0-8e1f-2d2a42aedb65 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:06.869346 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88117d-a2db-4fba-b5ad-bf64f9f79361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:06.870313 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88117d-a2db-4fba-b5ad-bf64f9f79361 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:06.870592 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88117d-a2db-4fba-b5ad-bf64f9f79361 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:06.870915 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88117d-a2db-4fba-b5ad-bf64f9f79361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:06.871753 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88117d-a2db-4fba-b5ad-bf64f9f79361 None admin] RBAC: Adding query filter params (role.id=3f29e38dee7541f59eebc4b335c9237f, scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4, user.id=749b4c712abc46cbbe4074b7d1ca8347) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:06.872059 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88117d-a2db-4fba-b5ad-bf64f9f79361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:06.873556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88117d-a2db-4fba-b5ad-bf64f9f79361 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:06.880525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 108/208] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:06 2022] GET /identity/v3/role_assignments?user.id=749b4c712abc46cbbe4074b7d1ca8347&scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4&role.id=3f29e38dee7541f59eebc4b335c9237f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:07.829036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a9e0-9e15-46b0-83e9-057cd0e4f28d None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:07.830030 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a9e0-9e15-46b0-83e9-057cd0e4f28d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:07.830518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a9e0-9e15-46b0-83e9-057cd0e4f28d None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:07.832818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 101/209] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:07.838262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da860b7c-1f54-4687-96ec-be10980ebe4c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:07.839091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da860b7c-1f54-4687-96ec-be10980ebe4c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:07.839586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da860b7c-1f54-4687-96ec-be10980ebe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:07.857467 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-da860b7c-1f54-4687-96ec-be10980ebe4c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:07.858928 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-da860b7c-1f54-4687-96ec-be10980ebe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:07.872100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd04baa-ebed-4604-9d58-2f54282bd0b4 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:07.872691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd04baa-ebed-4604-9d58-2f54282bd0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:07.873196 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd04baa-ebed-4604-9d58-2f54282bd0b4 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:07.875432 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 102/210] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:07.881013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18ef5-576a-4721-a920-d5cc16a81887 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:07.881302 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18ef5-576a-4721-a920-d5cc16a81887 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:07.881582 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18ef5-576a-4721-a920-d5cc16a81887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:07.898521 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-efd18ef5-576a-4721-a920-d5cc16a81887 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:07.899703 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-efd18ef5-576a-4721-a920-d5cc16a81887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:07.932118 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 109/211] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:07.955647 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da860b7c-1f54-4687-96ec-be10980ebe4c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:07.968593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 103/212] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:07.993467 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd18ef5-576a-4721-a920-d5cc16a81887 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:08.089377 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da860b7c-1f54-4687-96ec-be10980ebe4c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:08.106216 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd18ef5-576a-4721-a920-d5cc16a81887 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:08.124932 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1eca0e-b888-4f64-a6ef-400329ea6465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:08.125459 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eca0e-b888-4f64-a6ef-400329ea6465 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:08.125734 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eca0e-b888-4f64-a6ef-400329ea6465 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:08.126005 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eca0e-b888-4f64-a6ef-400329ea6465 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:08.136347 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1eca0e-b888-4f64-a6ef-400329ea6465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:08.143704 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-3e1eca0e-b888-4f64-a6ef-400329ea6465 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:52:08.151960 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 110/213] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:08.152097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca736b7-68c1-4cef-ba43-982f505eb93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:08.152097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca736b7-68c1-4cef-ba43-982f505eb93c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:08.152097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca736b7-68c1-4cef-ba43-982f505eb93c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:08.152097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca736b7-68c1-4cef-ba43-982f505eb93c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:08.152999 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1eca0e-b888-4f64-a6ef-400329ea6465 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:08.154662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca736b7-68c1-4cef-ba43-982f505eb93c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:08.156197 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca736b7-68c1-4cef-ba43-982f505eb93c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:08.158323 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 104/214] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:08.170308 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca736b7-68c1-4cef-ba43-982f505eb93c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:08.262158 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1eca0e-b888-4f64-a6ef-400329ea6465 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:08.296137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca736b7-68c1-4cef-ba43-982f505eb93c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:08.304072 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcce0ce-7cfc-4aaa-83b3-5e5a1cc48dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:08.305190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcce0ce-7cfc-4aaa-83b3-5e5a1cc48dce None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:08.305480 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcce0ce-7cfc-4aaa-83b3-5e5a1cc48dce None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:08.305759 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcce0ce-7cfc-4aaa-83b3-5e5a1cc48dce None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:08.306517 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcce0ce-7cfc-4aaa-83b3-5e5a1cc48dce None admin] RBAC: Adding query filter params (name=member) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:08.306826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcce0ce-7cfc-4aaa-83b3-5e5a1cc48dce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:08.308590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcce0ce-7cfc-4aaa-83b3-5e5a1cc48dce None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:08.320834 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 111/215] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:08.325696 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcce0ce-7cfc-4aaa-83b3-5e5a1cc48dce None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:08.341404 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d36f3-57ec-48e5-accb-a9530f783eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:08.342022 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d36f3-57ec-48e5-accb-a9530f783eae None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:08.342310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d36f3-57ec-48e5-accb-a9530f783eae None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:08.342576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d36f3-57ec-48e5-accb-a9530f783eae None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:08.343586 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d36f3-57ec-48e5-accb-a9530f783eae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:08.345226 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d36f3-57ec-48e5-accb-a9530f783eae None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:08.371100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 105/216] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:52:08 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:52:08.454755 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcce0ce-7cfc-4aaa-83b3-5e5a1cc48dce None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:08.493902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e241ad-7442-4e2e-bbc4-72e3b01ae867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:08.495484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e241ad-7442-4e2e-bbc4-72e3b01ae867 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:08.496023 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e241ad-7442-4e2e-bbc4-72e3b01ae867 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:08.496498 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e241ad-7442-4e2e-bbc4-72e3b01ae867 None admin] PATH_INFO: `/v3/users/d5c18985cf854257bf0a1636ed921dc0` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:08.512709 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e241ad-7442-4e2e-bbc4-72e3b01ae867 None admin] RBAC: Authorizing `identity:get_user(user_id=d5c18985cf854257bf0a1636ed921dc0)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:08.514685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e241ad-7442-4e2e-bbc4-72e3b01ae867 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:08.517483 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 112/217] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:08 2022] GET /identity/v3/users/d5c18985cf854257bf0a1636ed921dc0 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:08.523523 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d36f3-57ec-48e5-accb-a9530f783eae None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:08.587610 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff207-b7cb-4e23-bb39-926898051c41 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:08.587913 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff207-b7cb-4e23-bb39-926898051c41 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:08.588217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff207-b7cb-4e23-bb39-926898051c41 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:08.590025 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 113/218] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:52:08.595091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a22ae0-4bdc-4e2f-b829-36be7e8ee97b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:08.595312 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a22ae0-4bdc-4e2f-b829-36be7e8ee97b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:08.595587 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a22ae0-4bdc-4e2f-b829-36be7e8ee97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:08.612890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b8a22ae0-4bdc-4e2f-b829-36be7e8ee97b None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:08.614132 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b8a22ae0-4bdc-4e2f-b829-36be7e8ee97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:08.640194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d36f3-57ec-48e5-accb-a9530f783eae None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:08.677622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bc9c8-0a75-4202-a204-c079173076ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:08.678317 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc9c8-0a75-4202-a204-c079173076ef None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:08.679406 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc9c8-0a75-4202-a204-c079173076ef None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:08.679406 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc9c8-0a75-4202-a204-c079173076ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:08.700898 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 114/219] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:08.721207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a22ae0-4bdc-4e2f-b829-36be7e8ee97b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:08.769456 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bc9c8-0a75-4202-a204-c079173076ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:08.771835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bc9c8-0a75-4202-a204-c079173076ef None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:08.856847 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a22ae0-4bdc-4e2f-b829-36be7e8ee97b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:08.880708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 106/220] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:08.881899 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000293f-f7ed-4fd2-86bf-872da5b2082f None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:08.882187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000293f-f7ed-4fd2-86bf-872da5b2082f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:08.882464 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000293f-f7ed-4fd2-86bf-872da5b2082f None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:08.884172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 107/221] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:08.889937 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c30327-bc73-458a-a490-456d33e3ba37 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:08.890154 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c30327-bc73-458a-a490-456d33e3ba37 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:08.890425 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c30327-bc73-458a-a490-456d33e3ba37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:08.891860 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a4e1f-265d-483b-8a72-7b6aad92a6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:08.892653 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a4e1f-265d-483b-8a72-7b6aad92a6ee None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:08.892960 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a4e1f-265d-483b-8a72-7b6aad92a6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:08.893232 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a4e1f-265d-483b-8a72-7b6aad92a6ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:08.904296 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a4e1f-265d-483b-8a72-7b6aad92a6ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:08.909164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-22c30327-bc73-458a-a490-456d33e3ba37 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:08.910530 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-22c30327-bc73-458a-a490-456d33e3ba37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:08.911348 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-208a4e1f-265d-483b-8a72-7b6aad92a6ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:52:08.916899 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 115/222] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:52:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:08.917765 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a4e1f-265d-483b-8a72-7b6aad92a6ee None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:08.999212 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 108/223] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:09.000348 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c30327-bc73-458a-a490-456d33e3ba37 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:09.018574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a4e1f-265d-483b-8a72-7b6aad92a6ee None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:09.053039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dda25-ee67-4f8f-a7fd-f26b0d9acc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:09.053899 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dda25-ee67-4f8f-a7fd-f26b0d9acc6d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:09.054197 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dda25-ee67-4f8f-a7fd-f26b0d9acc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:09.054724 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dda25-ee67-4f8f-a7fd-f26b0d9acc6d None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:09.055634 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9dda25-ee67-4f8f-a7fd-f26b0d9acc6d None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:09.057119 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9dda25-ee67-4f8f-a7fd-f26b0d9acc6d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:09.059169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 116/224] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:08 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:09.064146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dda25-ee67-4f8f-a7fd-f26b0d9acc6d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:09.106922 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c30327-bc73-458a-a490-456d33e3ba37 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:09.141452 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff4bfb-6687-4d5b-9b74-d5ed8a6c338c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:09.142334 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff4bfb-6687-4d5b-9b74-d5ed8a6c338c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:09.142758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff4bfb-6687-4d5b-9b74-d5ed8a6c338c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:09.143200 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff4bfb-6687-4d5b-9b74-d5ed8a6c338c None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:09.144093 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff4bfb-6687-4d5b-9b74-d5ed8a6c338c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:09.144536 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff4bfb-6687-4d5b-9b74-d5ed8a6c338c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:09.146148 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff4bfb-6687-4d5b-9b74-d5ed8a6c338c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:09.154791 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 109/225] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:09.155762 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff4bfb-6687-4d5b-9b74-d5ed8a6c338c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:09.164346 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dda25-ee67-4f8f-a7fd-f26b0d9acc6d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:09.198506 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297281ba-8b3c-48e5-be2a-a2d3cffc218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:09.199438 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297281ba-8b3c-48e5-be2a-a2d3cffc218a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:09.199836 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297281ba-8b3c-48e5-be2a-a2d3cffc218a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:09.200118 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297281ba-8b3c-48e5-be2a-a2d3cffc218a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:09.210568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297281ba-8b3c-48e5-be2a-a2d3cffc218a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:09.218026 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-297281ba-8b3c-48e5-be2a-a2d3cffc218a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:52:09.219212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 117/226] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:52:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:09.220035 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297281ba-8b3c-48e5-be2a-a2d3cffc218a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:09.265322 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff4bfb-6687-4d5b-9b74-d5ed8a6c338c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:09.302585 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33797e2c-2a38-4407-b381-3622d26e9f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:09.303460 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33797e2c-2a38-4407-b381-3622d26e9f26 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:09.303885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33797e2c-2a38-4407-b381-3622d26e9f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:09.304301 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33797e2c-2a38-4407-b381-3622d26e9f26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:09.305349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33797e2c-2a38-4407-b381-3622d26e9f26 None admin] RBAC: Adding query filter params (role.id=76a348ab64cc49e0b464e3578474c8d6, scope.project.id=128e459def144365b3b01282148ec980, user.id=d5c18985cf854257bf0a1636ed921dc0) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:09.305820 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33797e2c-2a38-4407-b381-3622d26e9f26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:09.307406 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33797e2c-2a38-4407-b381-3622d26e9f26 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:09.313102 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 110/227] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:09 2022] GET /identity/v3/role_assignments?user.id=d5c18985cf854257bf0a1636ed921dc0&scope.project.id=128e459def144365b3b01282148ec980&role.id=76a348ab64cc49e0b464e3578474c8d6 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:09.320825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33797e2c-2a38-4407-b381-3622d26e9f26 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:09.321042 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297281ba-8b3c-48e5-be2a-a2d3cffc218a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:09.357020 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b606b2-fc26-4f5e-a576-51a7533ba6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:09.357876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b606b2-fc26-4f5e-a576-51a7533ba6ae None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:09.358156 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b606b2-fc26-4f5e-a576-51a7533ba6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:09.358944 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b606b2-fc26-4f5e-a576-51a7533ba6ae None admin] PATH_INFO: `/v3/users/22b327d6eb3c4a63a4d8d54e91ac0a59` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:09.359721 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b606b2-fc26-4f5e-a576-51a7533ba6ae None admin] RBAC: Authorizing `identity:get_user(user_id=22b327d6eb3c4a63a4d8d54e91ac0a59)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:09.361382 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b606b2-fc26-4f5e-a576-51a7533ba6ae None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:09.373070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 118/228] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:09 2022] GET /identity/v3/users/22b327d6eb3c4a63a4d8d54e91ac0a59 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:09.375041 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b606b2-fc26-4f5e-a576-51a7533ba6ae None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:09.504263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33797e2c-2a38-4407-b381-3622d26e9f26 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:09.523102 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b606b2-fc26-4f5e-a576-51a7533ba6ae None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:09.543925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc199615-1f76-4c23-9b0c-0fe2916f7263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:09.545036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc199615-1f76-4c23-9b0c-0fe2916f7263 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:09.545540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc199615-1f76-4c23-9b0c-0fe2916f7263 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:09.546037 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc199615-1f76-4c23-9b0c-0fe2916f7263 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:09.546991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc199615-1f76-4c23-9b0c-0fe2916f7263 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:09.547495 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc199615-1f76-4c23-9b0c-0fe2916f7263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:09.549103 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc199615-1f76-4c23-9b0c-0fe2916f7263 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:09.556746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7d27c-a4ff-4df6-8b7a-d61acfee8608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:09.557656 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7d27c-a4ff-4df6-8b7a-d61acfee8608 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:09.557934 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7d27c-a4ff-4df6-8b7a-d61acfee8608 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:09.558209 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7d27c-a4ff-4df6-8b7a-d61acfee8608 None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:09.559453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7d27c-a4ff-4df6-8b7a-d61acfee8608 None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:09.560187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 111/229] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:09.568851 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7d27c-a4ff-4df6-8b7a-d61acfee8608 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:09.568851 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 119/230] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:09 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:09.570228 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc199615-1f76-4c23-9b0c-0fe2916f7263 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:09.571343 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7d27c-a4ff-4df6-8b7a-d61acfee8608 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:09.723127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7d27c-a4ff-4df6-8b7a-d61acfee8608 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:09.755736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc199615-1f76-4c23-9b0c-0fe2916f7263 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:09.769950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e44fb3-9479-49fc-8b7d-3e7584da4b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:09.771381 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e44fb3-9479-49fc-8b7d-3e7584da4b0e None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:09.771663 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e44fb3-9479-49fc-8b7d-3e7584da4b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:09.771939 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e44fb3-9479-49fc-8b7d-3e7584da4b0e None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980/users/22b327d6eb3c4a63a4d8d54e91ac0a59/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:09.776213 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e44fb3-9479-49fc-8b7d-3e7584da4b0e None admin] RBAC: Authorizing `identity:create_grant(project_id=128e459def144365b3b01282148ec980, user_id=22b327d6eb3c4a63a4d8d54e91ac0a59, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:09.777702 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e44fb3-9479-49fc-8b7d-3e7584da4b0e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:09.805309 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d39edc-1cba-41fb-a654-a6c10e5e7664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:09.806201 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d39edc-1cba-41fb-a654-a6c10e5e7664 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:09.806590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d39edc-1cba-41fb-a654-a6c10e5e7664 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:09.806871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d39edc-1cba-41fb-a654-a6c10e5e7664 None admin] PATH_INFO: `/v3/users/22b327d6eb3c4a63a4d8d54e91ac0a59` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:09.808393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d39edc-1cba-41fb-a654-a6c10e5e7664 None admin] RBAC: Authorizing `identity:get_user(user_id=22b327d6eb3c4a63a4d8d54e91ac0a59)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:09.810141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d39edc-1cba-41fb-a654-a6c10e5e7664 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:09.812288 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 112/231] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:09 2022] GET /identity/v3/users/22b327d6eb3c4a63a4d8d54e91ac0a59 => generated 283 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:09.814913 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 120/232] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:52:09 2022] PUT /identity/v3/projects/128e459def144365b3b01282148ec980/users/22b327d6eb3c4a63a4d8d54e91ac0a59/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:52:09.822356 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d39edc-1cba-41fb-a654-a6c10e5e7664 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:09.940567 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d39edc-1cba-41fb-a654-a6c10e5e7664 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:09.982632 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10343311-637f-4522-996f-c109c78aa864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:09.983514 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10343311-637f-4522-996f-c109c78aa864 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:09.983797 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10343311-637f-4522-996f-c109c78aa864 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:09.984074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10343311-637f-4522-996f-c109c78aa864 None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:09.985288 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10343311-637f-4522-996f-c109c78aa864 None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:09.986764 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10343311-637f-4522-996f-c109c78aa864 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:09.991988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 113/233] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:09 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:09.998035 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e44fb3-9479-49fc-8b7d-3e7584da4b0e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:10.113535 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e44fb3-9479-49fc-8b7d-3e7584da4b0e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:10.158616 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8f8ef-e7d9-4650-93d4-deb6c37d4d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:10.159568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8f8ef-e7d9-4650-93d4-deb6c37d4d68 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:10.159851 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8f8ef-e7d9-4650-93d4-deb6c37d4d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:10.160129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8f8ef-e7d9-4650-93d4-deb6c37d4d68 None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980/users/22b327d6eb3c4a63a4d8d54e91ac0a59/roles/20b1a2451e0a42628e0126aa881cac6b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:10.163731 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8f8ef-e7d9-4650-93d4-deb6c37d4d68 None admin] RBAC: Authorizing `identity:create_grant(project_id=128e459def144365b3b01282148ec980, user_id=22b327d6eb3c4a63a4d8d54e91ac0a59, role_id=20b1a2451e0a42628e0126aa881cac6b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:10.165205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8f8ef-e7d9-4650-93d4-deb6c37d4d68 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:10.182165 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 121/234] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:52:09 2022] PUT /identity/v3/projects/128e459def144365b3b01282148ec980/users/22b327d6eb3c4a63a4d8d54e91ac0a59/roles/20b1a2451e0a42628e0126aa881cac6b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:52:11.202242 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb49a-11b6-4704-9ba4-530e3beef5f3 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:11.202761 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb49a-11b6-4704-9ba4-530e3beef5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:11.202832 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb49a-11b6-4704-9ba4-530e3beef5f3 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:11.204629 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 114/235] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:11.210537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11f147-c3d9-4132-bb8e-f0ff3db7c2fe None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:11.210943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11f147-c3d9-4132-bb8e-f0ff3db7c2fe None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:11.211114 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11f147-c3d9-4132-bb8e-f0ff3db7c2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:11.228200 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2c11f147-c3d9-4132-bb8e-f0ff3db7c2fe None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:11.229346 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2c11f147-c3d9-4132-bb8e-f0ff3db7c2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:11.296900 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 122/236] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:11.315841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676eafd-bfe4-4bd0-b4bb-25241b7cf594 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:11.316126 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676eafd-bfe4-4bd0-b4bb-25241b7cf594 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:11.316404 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676eafd-bfe4-4bd0-b4bb-25241b7cf594 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:11.318590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 115/237] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:11.323775 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4992b74-3a55-4f22-bec4-4bc3f98e799b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:11.324085 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4992b74-3a55-4f22-bec4-4bc3f98e799b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:11.324339 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4992b74-3a55-4f22-bec4-4bc3f98e799b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:11.336725 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676eafd-bfe4-4bd0-b4bb-25241b7cf594 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:11.341986 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e4992b74-3a55-4f22-bec4-4bc3f98e799b None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:11.343229 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e4992b74-3a55-4f22-bec4-4bc3f98e799b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:11.413424 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 123/238] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:11.439390 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4992b74-3a55-4f22-bec4-4bc3f98e799b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:11.552260 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4992b74-3a55-4f22-bec4-4bc3f98e799b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:11.590197 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fbbbe-9bd8-4b48-8868-8178e9101cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:11.590999 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fbbbe-9bd8-4b48-8868-8178e9101cfd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:11.591280 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fbbbe-9bd8-4b48-8868-8178e9101cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:11.591556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fbbbe-9bd8-4b48-8868-8178e9101cfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:11.592722 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fbbbe-9bd8-4b48-8868-8178e9101cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:11.594371 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676eafd-bfe4-4bd0-b4bb-25241b7cf594 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:11.594497 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fbbbe-9bd8-4b48-8868-8178e9101cfd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:11.596478 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 124/239] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:11.603372 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fbbbe-9bd8-4b48-8868-8178e9101cfd None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:11.659320 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f65c0-8976-4c45-84ca-526c1b0bfba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:11.660184 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f65c0-8976-4c45-84ca-526c1b0bfba2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:11.660467 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f65c0-8976-4c45-84ca-526c1b0bfba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:11.661324 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f65c0-8976-4c45-84ca-526c1b0bfba2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:11.672935 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f65c0-8976-4c45-84ca-526c1b0bfba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:11.681114 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-cf0f65c0-8976-4c45-84ca-526c1b0bfba2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:52:11.683130 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 116/240] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:11.689176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f65c0-8976-4c45-84ca-526c1b0bfba2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:11.752825 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fbbbe-9bd8-4b48-8868-8178e9101cfd None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:11.789444 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1111860-0a4f-4f26-8f35-2b0536729fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:11.790119 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1111860-0a4f-4f26-8f35-2b0536729fc9 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:11.790396 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1111860-0a4f-4f26-8f35-2b0536729fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:11.790669 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1111860-0a4f-4f26-8f35-2b0536729fc9 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:11.791373 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1111860-0a4f-4f26-8f35-2b0536729fc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:11.792837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1111860-0a4f-4f26-8f35-2b0536729fc9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:11.818241 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 125/241] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:52:11 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:52:11.913228 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f65c0-8976-4c45-84ca-526c1b0bfba2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:11.967987 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5a1a6-1913-4e85-bf46-98a3ceda64c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:11.968676 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5a1a6-1913-4e85-bf46-98a3ceda64c7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:11.968975 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5a1a6-1913-4e85-bf46-98a3ceda64c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:11.969247 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5a1a6-1913-4e85-bf46-98a3ceda64c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:11.970011 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5a1a6-1913-4e85-bf46-98a3ceda64c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:11.970319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5a1a6-1913-4e85-bf46-98a3ceda64c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:11.972114 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5a1a6-1913-4e85-bf46-98a3ceda64c7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:11.985393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 117/242] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:11.992191 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1111860-0a4f-4f26-8f35-2b0536729fc9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:12.133725 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1111860-0a4f-4f26-8f35-2b0536729fc9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:12.170431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18ca1e-a6f7-47e9-8dd5-45af18b93541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:12.171534 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18ca1e-a6f7-47e9-8dd5-45af18b93541 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:12.171950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18ca1e-a6f7-47e9-8dd5-45af18b93541 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:12.172417 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18ca1e-a6f7-47e9-8dd5-45af18b93541 None admin] PATH_INFO: `/v3/users/4a76ef018cce4739a22b5690df21174e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:12.195083 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18ca1e-a6f7-47e9-8dd5-45af18b93541 None admin] RBAC: Authorizing `identity:get_user(user_id=4a76ef018cce4739a22b5690df21174e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:12.198100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18ca1e-a6f7-47e9-8dd5-45af18b93541 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:12.201433 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 126/243] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:11 2022] GET /identity/v3/users/4a76ef018cce4739a22b5690df21174e => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:12.210830 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5a1a6-1913-4e85-bf46-98a3ceda64c7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:12.387005 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5a1a6-1913-4e85-bf46-98a3ceda64c7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:12.451991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639bcb8-77e8-4d86-a7df-f4127d742a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:12.453373 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639bcb8-77e8-4d86-a7df-f4127d742a37 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:12.454050 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639bcb8-77e8-4d86-a7df-f4127d742a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:12.454680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639bcb8-77e8-4d86-a7df-f4127d742a37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:12.573757 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639bcb8-77e8-4d86-a7df-f4127d742a37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:12.576654 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639bcb8-77e8-4d86-a7df-f4127d742a37 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:12.754229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 118/244] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:12.762254 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18ca1e-a6f7-47e9-8dd5-45af18b93541 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:12.766498 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df24d7b-0fd4-476c-bc6e-670a08c5c7ce None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:12.767144 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df24d7b-0fd4-476c-bc6e-670a08c5c7ce None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:12.767794 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df24d7b-0fd4-476c-bc6e-670a08c5c7ce None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:12.771061 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 119/245] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:12.789431 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e671939-2dc9-4ce4-bdaa-2633529068f0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:12.790369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e671939-2dc9-4ce4-bdaa-2633529068f0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:12.790795 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e671939-2dc9-4ce4-bdaa-2633529068f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:12.812642 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0e671939-2dc9-4ce4-bdaa-2633529068f0 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:12.814898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0e671939-2dc9-4ce4-bdaa-2633529068f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:12.885284 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18ca1e-a6f7-47e9-8dd5-45af18b93541 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:12.904232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 120/246] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:12.906327 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311909f-2bfa-4a5b-909f-a6e2b5965987 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:12.906757 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311909f-2bfa-4a5b-909f-a6e2b5965987 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:12.907188 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311909f-2bfa-4a5b-909f-a6e2b5965987 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:12.910079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 121/247] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:12.918120 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ec9df-ee55-4263-9f91-fe0d47d65236 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:12.918672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ec9df-ee55-4263-9f91-fe0d47d65236 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:12.918672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ec9df-ee55-4263-9f91-fe0d47d65236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:12.937125 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f23ec9df-ee55-4263-9f91-fe0d47d65236 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:12.938309 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f23ec9df-ee55-4263-9f91-fe0d47d65236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:12.938485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71612ff8-fdbf-4fa7-84c9-e55fb5b21d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:12.939397 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71612ff8-fdbf-4fa7-84c9-e55fb5b21d50 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:12.939672 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71612ff8-fdbf-4fa7-84c9-e55fb5b21d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:12.939942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71612ff8-fdbf-4fa7-84c9-e55fb5b21d50 None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:12.941283 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71612ff8-fdbf-4fa7-84c9-e55fb5b21d50 None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:12.942854 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71612ff8-fdbf-4fa7-84c9-e55fb5b21d50 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:12.945062 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 127/248] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:12 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:12.946161 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71612ff8-fdbf-4fa7-84c9-e55fb5b21d50 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:13.078260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 122/249] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:13.079058 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ec9df-ee55-4263-9f91-fe0d47d65236 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:13.124062 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71612ff8-fdbf-4fa7-84c9-e55fb5b21d50 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:13.164098 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea671a-c36c-4a6b-ad39-dfad795fff33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:13.165290 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea671a-c36c-4a6b-ad39-dfad795fff33 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:13.165576 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea671a-c36c-4a6b-ad39-dfad795fff33 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:13.166169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea671a-c36c-4a6b-ad39-dfad795fff33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:13.178537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea671a-c36c-4a6b-ad39-dfad795fff33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:13.187767 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ec9df-ee55-4263-9f91-fe0d47d65236 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:13.188132 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-e7ea671a-c36c-4a6b-ad39-dfad795fff33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:52:13.189512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 128/250] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:13.196217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea671a-c36c-4a6b-ad39-dfad795fff33 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:13.232629 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad08e20-6404-45c4-a9b8-7b0d8c1e1a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:13.233384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad08e20-6404-45c4-a9b8-7b0d8c1e1a72 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:13.233671 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad08e20-6404-45c4-a9b8-7b0d8c1e1a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:13.233943 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad08e20-6404-45c4-a9b8-7b0d8c1e1a72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:13.235097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad08e20-6404-45c4-a9b8-7b0d8c1e1a72 None admin] RBAC: Adding query filter params (role.id=3f29e38dee7541f59eebc4b335c9237f, scope.project.id=128e459def144365b3b01282148ec980, user.id=4a76ef018cce4739a22b5690df21174e) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:13.235538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad08e20-6404-45c4-a9b8-7b0d8c1e1a72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:13.237233 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad08e20-6404-45c4-a9b8-7b0d8c1e1a72 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:13.244295 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 123/251] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:13 2022] GET /identity/v3/role_assignments?user.id=4a76ef018cce4739a22b5690df21174e&scope.project.id=128e459def144365b3b01282148ec980&role.id=3f29e38dee7541f59eebc4b335c9237f => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:13.246263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efde65-8a5c-4a8b-8e2f-017c2550e23a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:13.246549 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efde65-8a5c-4a8b-8e2f-017c2550e23a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:13.246828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efde65-8a5c-4a8b-8e2f-017c2550e23a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:13.249245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 124/252] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:13.249840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efde65-8a5c-4a8b-8e2f-017c2550e23a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:13.334835 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea671a-c36c-4a6b-ad39-dfad795fff33 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:13.361087 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efde65-8a5c-4a8b-8e2f-017c2550e23a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:13.393497 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6232da-e3e9-4023-b01e-05e961b1318b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:13.400934 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6232da-e3e9-4023-b01e-05e961b1318b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:13.401813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6232da-e3e9-4023-b01e-05e961b1318b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:13.403668 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6232da-e3e9-4023-b01e-05e961b1318b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:13.428116 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed0436-06ef-4e3c-8a77-c719b4bca2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:13.429811 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed0436-06ef-4e3c-8a77-c719b4bca2ca None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:13.430419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed0436-06ef-4e3c-8a77-c719b4bca2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:13.431138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed0436-06ef-4e3c-8a77-c719b4bca2ca None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:13.431884 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6232da-e3e9-4023-b01e-05e961b1318b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:13.435673 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed0436-06ef-4e3c-8a77-c719b4bca2ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:13.436264 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed0436-06ef-4e3c-8a77-c719b4bca2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:13.437960 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed0436-06ef-4e3c-8a77-c719b4bca2ca None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:13.448730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-ba6232da-e3e9-4023-b01e-05e961b1318b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:52:13.451495 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 129/253] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:52:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:13.454721 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b566d-1997-485b-baf7-6bde77ef41a6 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:13.456682 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b566d-1997-485b-baf7-6bde77ef41a6 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:13.457322 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b566d-1997-485b-baf7-6bde77ef41a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:13.458501 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 125/254] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:13.459377 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed0436-06ef-4e3c-8a77-c719b4bca2ca None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:13.495499 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f33b566d-1997-485b-baf7-6bde77ef41a6 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:13.496966 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f33b566d-1997-485b-baf7-6bde77ef41a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:13.617224 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 130/255] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:13.619352 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b566d-1997-485b-baf7-6bde77ef41a6 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:13.625220 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed0436-06ef-4e3c-8a77-c719b4bca2ca None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:13.698446 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bce5c1-6af1-4a5b-948d-2760192efadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:13.699195 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bce5c1-6af1-4a5b-948d-2760192efadd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:13.699482 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bce5c1-6af1-4a5b-948d-2760192efadd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:13.699823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bce5c1-6af1-4a5b-948d-2760192efadd None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:13.700655 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bce5c1-6af1-4a5b-948d-2760192efadd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:13.700988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bce5c1-6af1-4a5b-948d-2760192efadd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:13.702394 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bce5c1-6af1-4a5b-948d-2760192efadd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:13.717880 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 126/256] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:13.718743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bce5c1-6af1-4a5b-948d-2760192efadd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:13.915413 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b566d-1997-485b-baf7-6bde77ef41a6 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:13.941047 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bce5c1-6af1-4a5b-948d-2760192efadd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:13.981555 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc245951-82b1-46a8-9e9d-bc6da621da98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:13.982449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc245951-82b1-46a8-9e9d-bc6da621da98 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:13.982730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc245951-82b1-46a8-9e9d-bc6da621da98 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:13.983007 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc245951-82b1-46a8-9e9d-bc6da621da98 None admin] PATH_INFO: `/v3/users/d5c18985cf854257bf0a1636ed921dc0` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:13.985472 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc245951-82b1-46a8-9e9d-bc6da621da98 None admin] RBAC: Authorizing `identity:get_user(user_id=d5c18985cf854257bf0a1636ed921dc0)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:13.986940 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc245951-82b1-46a8-9e9d-bc6da621da98 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:13.990567 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 131/257] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:13 2022] GET /identity/v3/users/d5c18985cf854257bf0a1636ed921dc0 => generated 297 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:13.991392 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc245951-82b1-46a8-9e9d-bc6da621da98 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:14.015319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a67f4-d521-4010-80f8-446259981fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:14.016146 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a67f4-d521-4010-80f8-446259981fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:14.016429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a67f4-d521-4010-80f8-446259981fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:14.016709 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a67f4-d521-4010-80f8-446259981fd2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:14.049667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a67f4-d521-4010-80f8-446259981fd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:14.065949 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-ac6a67f4-d521-4010-80f8-446259981fd2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:52:14.067922 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 127/258] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:52:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:14.068949 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a67f4-d521-4010-80f8-446259981fd2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:14.097401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc245951-82b1-46a8-9e9d-bc6da621da98 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:14.132503 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16262b56-de8c-4852-82df-0ac6a935b7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:14.133589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16262b56-de8c-4852-82df-0ac6a935b7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:14.133876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16262b56-de8c-4852-82df-0ac6a935b7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:14.134149 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16262b56-de8c-4852-82df-0ac6a935b7b6 None admin] PATH_INFO: `/v3/users/22b327d6eb3c4a63a4d8d54e91ac0a59` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:14.135359 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16262b56-de8c-4852-82df-0ac6a935b7b6 None admin] RBAC: Authorizing `identity:get_user(user_id=22b327d6eb3c4a63a4d8d54e91ac0a59)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:14.136899 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16262b56-de8c-4852-82df-0ac6a935b7b6 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:14.138543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 132/259] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:13 2022] GET /identity/v3/users/22b327d6eb3c4a63a4d8d54e91ac0a59 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:14.139297 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16262b56-de8c-4852-82df-0ac6a935b7b6 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:14.242479 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16262b56-de8c-4852-82df-0ac6a935b7b6 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:14.261799 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a67f4-d521-4010-80f8-446259981fd2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:14.277278 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601596f-8c61-4af4-852b-f99bbf457e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:14.277955 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601596f-8c61-4af4-852b-f99bbf457e35 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:14.278236 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601596f-8c61-4af4-852b-f99bbf457e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:14.278564 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601596f-8c61-4af4-852b-f99bbf457e35 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:14.279251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601596f-8c61-4af4-852b-f99bbf457e35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:14.279558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601596f-8c61-4af4-852b-f99bbf457e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:14.288826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601596f-8c61-4af4-852b-f99bbf457e35 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:14.289923 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 133/260] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:14.290438 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601596f-8c61-4af4-852b-f99bbf457e35 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:14.318485 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29db06-768c-49f8-910a-9a84f17d1ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:14.319690 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29db06-768c-49f8-910a-9a84f17d1ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:14.320160 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29db06-768c-49f8-910a-9a84f17d1ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:14.320642 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29db06-768c-49f8-910a-9a84f17d1ac8 None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:14.322071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29db06-768c-49f8-910a-9a84f17d1ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:14.323717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29db06-768c-49f8-910a-9a84f17d1ac8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:14.325619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 128/261] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:14 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:14.330975 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29db06-768c-49f8-910a-9a84f17d1ac8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:14.393120 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601596f-8c61-4af4-852b-f99bbf457e35 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:14.435976 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbe36b-a478-40a3-8118-2727d3461ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:14.436651 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbe36b-a478-40a3-8118-2727d3461ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:14.436951 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbe36b-a478-40a3-8118-2727d3461ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:14.439333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbe36b-a478-40a3-8118-2727d3461ac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:14.528865 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29db06-768c-49f8-910a-9a84f17d1ac8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:14.570257 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbe44d-c8fb-415b-b8c0-7d8fab127604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:14.572074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe44d-c8fb-415b-b8c0-7d8fab127604 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:14.572359 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe44d-c8fb-415b-b8c0-7d8fab127604 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:14.572634 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe44d-c8fb-415b-b8c0-7d8fab127604 None admin] PATH_INFO: `/v3/users/22b327d6eb3c4a63a4d8d54e91ac0a59` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:14.577807 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbe44d-c8fb-415b-b8c0-7d8fab127604 None admin] RBAC: Authorizing `identity:get_user(user_id=22b327d6eb3c4a63a4d8d54e91ac0a59)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:14.579598 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbe44d-c8fb-415b-b8c0-7d8fab127604 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:14.583341 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 129/262] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:14 2022] GET /identity/v3/users/22b327d6eb3c4a63a4d8d54e91ac0a59 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:14.584080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbe44d-c8fb-415b-b8c0-7d8fab127604 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:14.592035 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbe36b-a478-40a3-8118-2727d3461ac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:14.593545 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbe36b-a478-40a3-8118-2727d3461ac1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:14.724753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbe44d-c8fb-415b-b8c0-7d8fab127604 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:14.773923 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671546e5-7023-48a1-9768-d37154dd1382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:14.776154 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671546e5-7023-48a1-9768-d37154dd1382 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:14.781330 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671546e5-7023-48a1-9768-d37154dd1382 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:14.781563 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671546e5-7023-48a1-9768-d37154dd1382 None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980/users/d5c18985cf854257bf0a1636ed921dc0/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:14.783922 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671546e5-7023-48a1-9768-d37154dd1382 None admin] RBAC: Authorizing `identity:create_grant(project_id=128e459def144365b3b01282148ec980, user_id=d5c18985cf854257bf0a1636ed921dc0, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:14.785426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671546e5-7023-48a1-9768-d37154dd1382 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:14.799189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 134/263] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:14.800512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbe36b-a478-40a3-8118-2727d3461ac1 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:14.820102 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 130/264] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:52:14 2022] PUT /identity/v3/projects/128e459def144365b3b01282148ec980/users/d5c18985cf854257bf0a1636ed921dc0/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:52:14.821003 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671546e5-7023-48a1-9768-d37154dd1382 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:14.906552 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbe36b-a478-40a3-8118-2727d3461ac1 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:14.945847 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b55b0-3e57-4c4b-a875-3911fec395dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:14.947447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b55b0-3e57-4c4b-a875-3911fec395dd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:14.949390 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b55b0-3e57-4c4b-a875-3911fec395dd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:14.950757 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b55b0-3e57-4c4b-a875-3911fec395dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:15.047875 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671546e5-7023-48a1-9768-d37154dd1382 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:15.059109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b55b0-3e57-4c4b-a875-3911fec395dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:15.060694 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b55b0-3e57-4c4b-a875-3911fec395dd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:15.107631 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4130f5-b50f-4869-a87b-5c1624eaffc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:15.108525 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4130f5-b50f-4869-a87b-5c1624eaffc8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:15.108819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4130f5-b50f-4869-a87b-5c1624eaffc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:15.109106 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4130f5-b50f-4869-a87b-5c1624eaffc8 None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:15.113627 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4130f5-b50f-4869-a87b-5c1624eaffc8 None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:15.115576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4130f5-b50f-4869-a87b-5c1624eaffc8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:15.117757 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 131/265] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:14 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:15.123642 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4130f5-b50f-4869-a87b-5c1624eaffc8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:15.170989 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 135/266] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:15.176689 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b55b0-3e57-4c4b-a875-3911fec395dd None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:15.241502 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4130f5-b50f-4869-a87b-5c1624eaffc8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:15.286857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb098ff6-2fd7-42fd-9f1c-c58478fe1563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:15.287603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb098ff6-2fd7-42fd-9f1c-c58478fe1563 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:15.287806 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb098ff6-2fd7-42fd-9f1c-c58478fe1563 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:15.288085 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb098ff6-2fd7-42fd-9f1c-c58478fe1563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:15.288975 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb098ff6-2fd7-42fd-9f1c-c58478fe1563 None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=128e459def144365b3b01282148ec980, user.id=22b327d6eb3c4a63a4d8d54e91ac0a59) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:15.289290 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb098ff6-2fd7-42fd-9f1c-c58478fe1563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:15.290757 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb098ff6-2fd7-42fd-9f1c-c58478fe1563 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:15.298408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 132/267] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:15 2022] GET /identity/v3/role_assignments?user.id=22b327d6eb3c4a63a4d8d54e91ac0a59&scope.project.id=128e459def144365b3b01282148ec980&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:15.311658 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b55b0-3e57-4c4b-a875-3911fec395dd None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:15.355203 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745d9dd-5c55-4794-b228-7e5de806bac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:15.356083 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745d9dd-5c55-4794-b228-7e5de806bac4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:15.356357 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745d9dd-5c55-4794-b228-7e5de806bac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:15.356627 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745d9dd-5c55-4794-b228-7e5de806bac4 None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:15.357883 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745d9dd-5c55-4794-b228-7e5de806bac4 None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:15.359417 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745d9dd-5c55-4794-b228-7e5de806bac4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:15.361219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 136/268] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:15 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:15.367683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb098ff6-2fd7-42fd-9f1c-c58478fe1563 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:15.477775 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dfa65-a5fa-4f23-9a70-84b896c80317 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:15.478097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dfa65-a5fa-4f23-9a70-84b896c80317 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:15.478320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dfa65-a5fa-4f23-9a70-84b896c80317 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:15.480412 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 137/269] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:15.486173 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e228304-f28b-47ab-8081-076075328c02 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:15.486459 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e228304-f28b-47ab-8081-076075328c02 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:15.486744 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e228304-f28b-47ab-8081-076075328c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:15.516819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb098ff6-2fd7-42fd-9f1c-c58478fe1563 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:15.538041 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9e228304-f28b-47ab-8081-076075328c02 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:15.539257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9e228304-f28b-47ab-8081-076075328c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:15.561010 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144525d-487c-4765-8c57-8dc8581fe507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:15.561610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144525d-487c-4765-8c57-8dc8581fe507 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:15.561889 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144525d-487c-4765-8c57-8dc8581fe507 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:15.562166 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144525d-487c-4765-8c57-8dc8581fe507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:15.563004 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144525d-487c-4765-8c57-8dc8581fe507 None admin] RBAC: Adding query filter params (role.id=20b1a2451e0a42628e0126aa881cac6b, scope.project.id=128e459def144365b3b01282148ec980, user.id=22b327d6eb3c4a63a4d8d54e91ac0a59) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:15.563315 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144525d-487c-4765-8c57-8dc8581fe507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:15.564777 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144525d-487c-4765-8c57-8dc8581fe507 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:15.576777 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 133/270] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:15 2022] GET /identity/v3/role_assignments?user.id=22b327d6eb3c4a63a4d8d54e91ac0a59&scope.project.id=128e459def144365b3b01282148ec980&role.id=20b1a2451e0a42628e0126aa881cac6b => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:15.637728 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacef08a-5855-420d-835d-1e3b988ad735 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:15.638061 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacef08a-5855-420d-835d-1e3b988ad735 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:15.638274 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacef08a-5855-420d-835d-1e3b988ad735 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:15.641528 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 134/271] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:52:15.641796 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 138/272] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:15.646625 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113ce1c-3e63-46f3-9317-3f2e5bd1886a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:15.646921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113ce1c-3e63-46f3-9317-3f2e5bd1886a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:15.647197 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113ce1c-3e63-46f3-9317-3f2e5bd1886a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:15.673466 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1113ce1c-3e63-46f3-9317-3f2e5bd1886a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:15.674769 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1113ce1c-3e63-46f3-9317-3f2e5bd1886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:15.688263 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e228304-f28b-47ab-8081-076075328c02 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:15.806533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 135/273] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:15.855826 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113ce1c-3e63-46f3-9317-3f2e5bd1886a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:15.857438 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e228304-f28b-47ab-8081-076075328c02 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:15.898788 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d86d0-be26-43b5-b568-483ed862d626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:15.899591 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d86d0-be26-43b5-b568-483ed862d626 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:15.899861 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d86d0-be26-43b5-b568-483ed862d626 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:15.900127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d86d0-be26-43b5-b568-483ed862d626 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:15.901323 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d86d0-be26-43b5-b568-483ed862d626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:15.902763 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d86d0-be26-43b5-b568-483ed862d626 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:15.904530 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 139/274] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:15.909951 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d86d0-be26-43b5-b568-483ed862d626 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:15.969160 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113ce1c-3e63-46f3-9317-3f2e5bd1886a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:16.010997 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c686d6f-b038-440c-a895-c27fa9a5d657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:16.011823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c686d6f-b038-440c-a895-c27fa9a5d657 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:16.012097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c686d6f-b038-440c-a895-c27fa9a5d657 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:16.012364 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c686d6f-b038-440c-a895-c27fa9a5d657 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:16.019688 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d86d0-be26-43b5-b568-483ed862d626 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:16.024234 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c686d6f-b038-440c-a895-c27fa9a5d657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:16.031396 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-1c686d6f-b038-440c-a895-c27fa9a5d657 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:52:16.036667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 136/275] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:16.039340 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c686d6f-b038-440c-a895-c27fa9a5d657 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:16.056337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848c29f-23d0-4310-803e-cb4f5984ca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:16.057037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848c29f-23d0-4310-803e-cb4f5984ca08 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:16.057313 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848c29f-23d0-4310-803e-cb4f5984ca08 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:16.057581 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848c29f-23d0-4310-803e-cb4f5984ca08 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:16.058284 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848c29f-23d0-4310-803e-cb4f5984ca08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:16.059783 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848c29f-23d0-4310-803e-cb4f5984ca08 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:16.093400 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 140/276] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:52:15 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:52:16.150241 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c686d6f-b038-440c-a895-c27fa9a5d657 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:16.190863 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359734b4-fe7b-4158-92a3-1ec16dfdcbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:16.191975 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359734b4-fe7b-4158-92a3-1ec16dfdcbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:16.192469 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359734b4-fe7b-4158-92a3-1ec16dfdcbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:16.192976 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359734b4-fe7b-4158-92a3-1ec16dfdcbf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:16.193959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359734b4-fe7b-4158-92a3-1ec16dfdcbf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:16.194691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359734b4-fe7b-4158-92a3-1ec16dfdcbf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:16.196328 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359734b4-fe7b-4158-92a3-1ec16dfdcbf4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:16.206292 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 137/277] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:16.213361 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848c29f-23d0-4310-803e-cb4f5984ca08 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:16.329841 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848c29f-23d0-4310-803e-cb4f5984ca08 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:16.365327 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314aa9e4-e3b4-4e9b-8df8-b36dff45c3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:16.366202 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa9e4-e3b4-4e9b-8df8-b36dff45c3aa None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:16.366484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa9e4-e3b4-4e9b-8df8-b36dff45c3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:16.366757 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa9e4-e3b4-4e9b-8df8-b36dff45c3aa None admin] PATH_INFO: `/v3/users/8d0a7c8fa7c544bc87ed7d82ffac0a96` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:16.380829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314aa9e4-e3b4-4e9b-8df8-b36dff45c3aa None admin] RBAC: Authorizing `identity:get_user(user_id=8d0a7c8fa7c544bc87ed7d82ffac0a96)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:16.382307 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314aa9e4-e3b4-4e9b-8df8-b36dff45c3aa None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:16.384312 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 141/278] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:16 2022] GET /identity/v3/users/8d0a7c8fa7c544bc87ed7d82ffac0a96 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:16.390850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359734b4-fe7b-4158-92a3-1ec16dfdcbf4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:16.392864 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cd5ec-9418-406b-bed2-9630d922d4b2 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:16.393152 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cd5ec-9418-406b-bed2-9630d922d4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:16.393425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cd5ec-9418-406b-bed2-9630d922d4b2 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:16.395897 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 142/279] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:16.401285 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a500a-76b8-48c5-9d84-f235045e12a7 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:16.401501 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a500a-76b8-48c5-9d84-f235045e12a7 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:16.401785 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a500a-76b8-48c5-9d84-f235045e12a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:16.420092 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f52a500a-76b8-48c5-9d84-f235045e12a7 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:16.421303 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f52a500a-76b8-48c5-9d84-f235045e12a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:16.498655 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 143/280] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:16.518106 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359734b4-fe7b-4158-92a3-1ec16dfdcbf4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:16.522175 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a500a-76b8-48c5-9d84-f235045e12a7 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:16.554519 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff33366-46a7-4cf9-b3bc-48a661852647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:16.555587 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff33366-46a7-4cf9-b3bc-48a661852647 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:16.556836 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff33366-46a7-4cf9-b3bc-48a661852647 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:16.557260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff33366-46a7-4cf9-b3bc-48a661852647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:16.558258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff33366-46a7-4cf9-b3bc-48a661852647 None admin] RBAC: Adding query filter params (role.id=76a348ab64cc49e0b464e3578474c8d6, user.id=8d0a7c8fa7c544bc87ed7d82ffac0a96, scope.system=all) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:16.558727 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff33366-46a7-4cf9-b3bc-48a661852647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:16.560405 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff33366-46a7-4cf9-b3bc-48a661852647 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:16.568045 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 138/281] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Sep 27 04:52:16 2022] GET /identity/v3/role_assignments?user.id=8d0a7c8fa7c544bc87ed7d82ffac0a96&scope.system=all&role.id=76a348ab64cc49e0b464e3578474c8d6 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:16.632586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a500a-76b8-48c5-9d84-f235045e12a7 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:16.680817 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533646a8-4607-466c-8d68-68d8a118e630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:16.681617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533646a8-4607-466c-8d68-68d8a118e630 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:16.681893 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533646a8-4607-466c-8d68-68d8a118e630 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:16.682158 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533646a8-4607-466c-8d68-68d8a118e630 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:16.697405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533646a8-4607-466c-8d68-68d8a118e630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:16.705267 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-533646a8-4607-466c-8d68-68d8a118e630 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:52:16.706935 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 144/282] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:16.712780 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff33366-46a7-4cf9-b3bc-48a661852647 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:16.846088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff33366-46a7-4cf9-b3bc-48a661852647 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:16.882157 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46a92e-2289-4344-a786-8c0bbebdad56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:16.883235 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46a92e-2289-4344-a786-8c0bbebdad56 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:16.883715 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46a92e-2289-4344-a786-8c0bbebdad56 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:16.884186 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46a92e-2289-4344-a786-8c0bbebdad56 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:16.885168 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46a92e-2289-4344-a786-8c0bbebdad56 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:16.885670 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46a92e-2289-4344-a786-8c0bbebdad56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:16.887314 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46a92e-2289-4344-a786-8c0bbebdad56 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:16.896482 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 139/283] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:16.902684 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533646a8-4607-466c-8d68-68d8a118e630 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:17.052865 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533646a8-4607-466c-8d68-68d8a118e630 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:17.101246 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60198f2-9594-43cd-92f8-feed47a78e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:17.102474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60198f2-9594-43cd-92f8-feed47a78e02 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:17.102954 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60198f2-9594-43cd-92f8-feed47a78e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:17.103421 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60198f2-9594-43cd-92f8-feed47a78e02 None admin] PATH_INFO: `/v3/users/4a76ef018cce4739a22b5690df21174e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:17.104829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60198f2-9594-43cd-92f8-feed47a78e02 None admin] RBAC: Authorizing `identity:get_user(user_id=4a76ef018cce4739a22b5690df21174e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:17.106499 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60198f2-9594-43cd-92f8-feed47a78e02 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:17.108323 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 145/284] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:16 2022] GET /identity/v3/users/4a76ef018cce4739a22b5690df21174e => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:17.115141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46a92e-2289-4344-a786-8c0bbebdad56 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:17.231126 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46a92e-2289-4344-a786-8c0bbebdad56 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:17.265288 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a0635-8b60-4403-8f96-ab84608945da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:17.266512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a0635-8b60-4403-8f96-ab84608945da None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:17.266990 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a0635-8b60-4403-8f96-ab84608945da None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:17.267460 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a0635-8b60-4403-8f96-ab84608945da None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:17.268887 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a0635-8b60-4403-8f96-ab84608945da None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:17.271148 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a0635-8b60-4403-8f96-ab84608945da None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:17.273088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 140/285] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:17 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:17.282024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60198f2-9594-43cd-92f8-feed47a78e02 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:17.403337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60198f2-9594-43cd-92f8-feed47a78e02 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:17.455384 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822836e-b980-490e-a4c5-d95df0b97eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:17.456326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822836e-b980-490e-a4c5-d95df0b97eed None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:17.456604 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822836e-b980-490e-a4c5-d95df0b97eed None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:17.456909 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822836e-b980-490e-a4c5-d95df0b97eed None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980/users/4a76ef018cce4739a22b5690df21174e/roles/3f29e38dee7541f59eebc4b335c9237f` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:17.462200 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822836e-b980-490e-a4c5-d95df0b97eed None admin] RBAC: Authorizing `identity:create_grant(project_id=128e459def144365b3b01282148ec980, user_id=4a76ef018cce4739a22b5690df21174e, role_id=3f29e38dee7541f59eebc4b335c9237f)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:17.463664 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822836e-b980-490e-a4c5-d95df0b97eed None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:17.483483 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 146/286] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:52:17 2022] PUT /identity/v3/projects/128e459def144365b3b01282148ec980/users/4a76ef018cce4739a22b5690df21174e/roles/3f29e38dee7541f59eebc4b335c9237f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:52:18.077451 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c1323-6796-42e2-a9eb-17f9656ce661 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:18.078487 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c1323-6796-42e2-a9eb-17f9656ce661 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:18.078978 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c1323-6796-42e2-a9eb-17f9656ce661 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:18.081051 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 141/287] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:18.086565 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f90d8-ae2f-4482-9113-66932008545d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:18.086980 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f90d8-ae2f-4482-9113-66932008545d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:18.087147 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f90d8-ae2f-4482-9113-66932008545d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:18.109819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b90f90d8-ae2f-4482-9113-66932008545d None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:18.111014 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b90f90d8-ae2f-4482-9113-66932008545d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:18.202485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 147/288] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:18.250361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c1323-6796-42e2-a9eb-17f9656ce661 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:18.373210 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c1323-6796-42e2-a9eb-17f9656ce661 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:18.407680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac6e9a-5939-4564-9f34-7e8dd0b74d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:18.408879 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac6e9a-5939-4564-9f34-7e8dd0b74d7f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:18.409364 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac6e9a-5939-4564-9f34-7e8dd0b74d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:18.409836 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac6e9a-5939-4564-9f34-7e8dd0b74d7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:18.421436 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac6e9a-5939-4564-9f34-7e8dd0b74d7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:18.428982 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-afac6e9a-5939-4564-9f34-7e8dd0b74d7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:52:18.430722 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 142/289] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:18.438053 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f90d8-ae2f-4482-9113-66932008545d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:18.590919 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f90d8-ae2f-4482-9113-66932008545d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:18.634865 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924ccad-844d-45a4-a007-827312c52d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:18.635533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924ccad-844d-45a4-a007-827312c52d79 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:18.635813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924ccad-844d-45a4-a007-827312c52d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:18.636082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924ccad-844d-45a4-a007-827312c52d79 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:18.636838 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924ccad-844d-45a4-a007-827312c52d79 None admin] RBAC: Adding query filter params (name=member) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:18.637140 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924ccad-844d-45a4-a007-827312c52d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:18.638589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924ccad-844d-45a4-a007-827312c52d79 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:18.654268 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 148/290] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:18.659858 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac6e9a-5939-4564-9f34-7e8dd0b74d7f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:18.781340 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac6e9a-5939-4564-9f34-7e8dd0b74d7f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:18.816447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70134e6e-a409-49b6-90db-f6fb32cf04a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:18.817781 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70134e6e-a409-49b6-90db-f6fb32cf04a2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:18.818291 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70134e6e-a409-49b6-90db-f6fb32cf04a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:18.818764 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70134e6e-a409-49b6-90db-f6fb32cf04a2 None admin] PATH_INFO: `/v3/users/d5c18985cf854257bf0a1636ed921dc0` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:18.820173 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70134e6e-a409-49b6-90db-f6fb32cf04a2 None admin] RBAC: Authorizing `identity:get_user(user_id=d5c18985cf854257bf0a1636ed921dc0)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:18.821900 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70134e6e-a409-49b6-90db-f6fb32cf04a2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:18.824081 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 143/291] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:18 2022] GET /identity/v3/users/d5c18985cf854257bf0a1636ed921dc0 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:18.829488 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924ccad-844d-45a4-a007-827312c52d79 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:18.950087 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924ccad-844d-45a4-a007-827312c52d79 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:18.984127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceda62e-2c21-439e-83e6-915f26a4d013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:18.984809 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda62e-2c21-439e-83e6-915f26a4d013 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:18.985092 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda62e-2c21-439e-83e6-915f26a4d013 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:18.985371 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceda62e-2c21-439e-83e6-915f26a4d013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:19.058001 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceda62e-2c21-439e-83e6-915f26a4d013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:19.059478 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceda62e-2c21-439e-83e6-915f26a4d013 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:19.154402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac37a7d-276c-4f36-8327-9e348d488833 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:19.154935 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac37a7d-276c-4f36-8327-9e348d488833 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:19.154935 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac37a7d-276c-4f36-8327-9e348d488833 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:19.157032 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 144/292] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:19.166176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19a7cc-d014-4b0a-981e-1f7d5c7fd27d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:19.166757 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19a7cc-d014-4b0a-981e-1f7d5c7fd27d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:19.167236 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19a7cc-d014-4b0a-981e-1f7d5c7fd27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:19.172829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 149/293] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:19.174457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceda62e-2c21-439e-83e6-915f26a4d013 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:19.217910 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-af19a7cc-d014-4b0a-981e-1f7d5c7fd27d None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:19.219458 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-af19a7cc-d014-4b0a-981e-1f7d5c7fd27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:19.278782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceda62e-2c21-439e-83e6-915f26a4d013 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:19.329199 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 145/294] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:19.354842 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e8169-bca4-4e2a-bf54-099dfd868dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:19.355731 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e8169-bca4-4e2a-bf54-099dfd868dbc None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:19.355990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e8169-bca4-4e2a-bf54-099dfd868dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:19.356261 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e8169-bca4-4e2a-bf54-099dfd868dbc None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:19.357490 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e8169-bca4-4e2a-bf54-099dfd868dbc None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:19.359106 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e8169-bca4-4e2a-bf54-099dfd868dbc None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:19.365144 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 150/295] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:19 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:19.367369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19a7cc-d014-4b0a-981e-1f7d5c7fd27d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:19.367645 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e8169-bca4-4e2a-bf54-099dfd868dbc None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:19.482691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19a7cc-d014-4b0a-981e-1f7d5c7fd27d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:19.521531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104106a5-3224-4859-b33d-490d17c44005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:19.522688 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104106a5-3224-4859-b33d-490d17c44005 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:19.523181 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104106a5-3224-4859-b33d-490d17c44005 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:19.523674 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104106a5-3224-4859-b33d-490d17c44005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:19.524699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104106a5-3224-4859-b33d-490d17c44005 None admin] RBAC: Adding query filter params (role.id=76a348ab64cc49e0b464e3578474c8d6, scope.project.id=128e459def144365b3b01282148ec980, user.id=d5c18985cf854257bf0a1636ed921dc0) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:19.525417 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104106a5-3224-4859-b33d-490d17c44005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:19.527209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104106a5-3224-4859-b33d-490d17c44005 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:19.540313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 146/296] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:19 2022] GET /identity/v3/role_assignments?user.id=d5c18985cf854257bf0a1636ed921dc0&scope.project.id=128e459def144365b3b01282148ec980&role.id=76a348ab64cc49e0b464e3578474c8d6 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:19.555053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fbb38-9e65-4c8b-bccf-75580ab5f23e None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:19.555933 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fbb38-9e65-4c8b-bccf-75580ab5f23e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:19.556408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fbb38-9e65-4c8b-bccf-75580ab5f23e None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:19.559278 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 147/297] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:52:19.566411 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abe52b-53ae-41ae-a483-9e8771b9b6bd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:19.567560 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abe52b-53ae-41ae-a483-9e8771b9b6bd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:19.568061 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abe52b-53ae-41ae-a483-9e8771b9b6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:19.595285 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e8169-bca4-4e2a-bf54-099dfd868dbc None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:19.604842 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c6abe52b-53ae-41ae-a483-9e8771b9b6bd None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:19.612178 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c6abe52b-53ae-41ae-a483-9e8771b9b6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:19.673804 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b91719-c81f-42a7-ad87-19c2de793c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:19.677277 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b91719-c81f-42a7-ad87-19c2de793c3f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:19.679166 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b91719-c81f-42a7-ad87-19c2de793c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:19.680494 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b91719-c81f-42a7-ad87-19c2de793c3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:19.692957 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b91719-c81f-42a7-ad87-19c2de793c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:19.700782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-d0b91719-c81f-42a7-ad87-19c2de793c3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:52:19.702736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 151/298] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:19.704352 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd9aab-6f36-48ab-9d93-b8704416eef2 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:19.704858 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd9aab-6f36-48ab-9d93-b8704416eef2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:19.705333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd9aab-6f36-48ab-9d93-b8704416eef2 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:19.707928 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 152/299] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:19.709111 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd9aab-6f36-48ab-9d93-b8704416eef2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:19.744497 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 148/300] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:19.745896 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b68c8-48dc-4705-aff2-1df2d097559f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:19.746191 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b68c8-48dc-4705-aff2-1df2d097559f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:19.746471 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b68c8-48dc-4705-aff2-1df2d097559f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:19.764394 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f07b68c8-48dc-4705-aff2-1df2d097559f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:19.765618 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f07b68c8-48dc-4705-aff2-1df2d097559f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:19.841253 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd9aab-6f36-48ab-9d93-b8704416eef2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:19.843553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 149/301] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:19.843553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b68c8-48dc-4705-aff2-1df2d097559f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:19.884865 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2098c2-5b63-4946-9a88-913c4a5c83d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:19.885334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2098c2-5b63-4946-9a88-913c4a5c83d1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:19.885615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2098c2-5b63-4946-9a88-913c4a5c83d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:19.885887 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2098c2-5b63-4946-9a88-913c4a5c83d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:19.886636 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2098c2-5b63-4946-9a88-913c4a5c83d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:19.886937 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2098c2-5b63-4946-9a88-913c4a5c83d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:19.888312 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2098c2-5b63-4946-9a88-913c4a5c83d1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:19.897883 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 153/302] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:19.898747 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2098c2-5b63-4946-9a88-913c4a5c83d1 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:19.951218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b68c8-48dc-4705-aff2-1df2d097559f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:19.993790 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf21b2-ba39-42de-ace4-74f4c5f11cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:19.994947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf21b2-ba39-42de-ace4-74f4c5f11cbe None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:19.995426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf21b2-ba39-42de-ace4-74f4c5f11cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:19.995735 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf21b2-ba39-42de-ace4-74f4c5f11cbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:19.997028 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf21b2-ba39-42de-ace4-74f4c5f11cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:19.998561 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf21b2-ba39-42de-ace4-74f4c5f11cbe None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:20.000488 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 150/303] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:20.001105 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf21b2-ba39-42de-ace4-74f4c5f11cbe None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:20.007810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2098c2-5b63-4946-9a88-913c4a5c83d1 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:20.042535 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4366a0-9a4e-4e40-a370-d1941fe2b1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:20.043332 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4366a0-9a4e-4e40-a370-d1941fe2b1af None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:20.043614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4366a0-9a4e-4e40-a370-d1941fe2b1af None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:20.043890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4366a0-9a4e-4e40-a370-d1941fe2b1af None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:20.055536 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4366a0-9a4e-4e40-a370-d1941fe2b1af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:20.062623 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-3b4366a0-9a4e-4e40-a370-d1941fe2b1af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:52:20.064002 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 154/304] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:20.064559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4366a0-9a4e-4e40-a370-d1941fe2b1af None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:20.111377 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf21b2-ba39-42de-ace4-74f4c5f11cbe None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:20.146117 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7c36e-ccc0-4a5e-a669-739ae2c5ac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:20.147290 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7c36e-ccc0-4a5e-a669-739ae2c5ac37 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:20.147737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7c36e-ccc0-4a5e-a669-739ae2c5ac37 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:20.148178 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7c36e-ccc0-4a5e-a669-739ae2c5ac37 None admin] PATH_INFO: `/v3/users/4d2a0035205141d69b0ba650e69816fd` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:20.159984 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4366a0-9a4e-4e40-a370-d1941fe2b1af None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:20.164068 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7c36e-ccc0-4a5e-a669-739ae2c5ac37 None admin] RBAC: Authorizing `identity:get_user(user_id=4d2a0035205141d69b0ba650e69816fd)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:20.166113 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7c36e-ccc0-4a5e-a669-739ae2c5ac37 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:20.167947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 151/305] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:20 2022] GET /identity/v3/users/4d2a0035205141d69b0ba650e69816fd => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:20.169034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7c36e-ccc0-4a5e-a669-739ae2c5ac37 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:20.198979 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de216ee-de91-45fc-bdf5-20ceb3155462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:20.199645 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de216ee-de91-45fc-bdf5-20ceb3155462 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:20.199922 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de216ee-de91-45fc-bdf5-20ceb3155462 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:20.200195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de216ee-de91-45fc-bdf5-20ceb3155462 None admin] PATH_INFO: `/v3/groups` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:20.200932 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de216ee-de91-45fc-bdf5-20ceb3155462 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:20.202371 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de216ee-de91-45fc-bdf5-20ceb3155462 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:20.224831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 155/306] 10.222.0.27 () {60 vars in 1134 bytes} [Tue Sep 27 04:52:20 2022] POST /identity/v3/groups => generated 229 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:52:20.224831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de216ee-de91-45fc-bdf5-20ceb3155462 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:20.304720 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7c36e-ccc0-4a5e-a669-739ae2c5ac37 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:20.343579 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31faf8c-49c4-48e6-b3bd-7d53223b5395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:20.344354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31faf8c-49c4-48e6-b3bd-7d53223b5395 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:20.344703 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31faf8c-49c4-48e6-b3bd-7d53223b5395 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:20.345068 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31faf8c-49c4-48e6-b3bd-7d53223b5395 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:20.345927 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31faf8c-49c4-48e6-b3bd-7d53223b5395 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:20.346327 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31faf8c-49c4-48e6-b3bd-7d53223b5395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:20.347338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de216ee-de91-45fc-bdf5-20ceb3155462 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:20.348879 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31faf8c-49c4-48e6-b3bd-7d53223b5395 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:20.358322 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 152/307] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:20.364592 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31faf8c-49c4-48e6-b3bd-7d53223b5395 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:20.385539 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d3836-1aed-42b1-8cc8-c677ae6d0ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:20.386260 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d3836-1aed-42b1-8cc8-c677ae6d0ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:20.386545 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d3836-1aed-42b1-8cc8-c677ae6d0ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:20.386876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d3836-1aed-42b1-8cc8-c677ae6d0ea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:20.387776 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d3836-1aed-42b1-8cc8-c677ae6d0ea7 None admin] RBAC: Adding query filter params (role.id=3f29e38dee7541f59eebc4b335c9237f, user.id=4d2a0035205141d69b0ba650e69816fd, scope.system=all) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:20.388096 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d3836-1aed-42b1-8cc8-c677ae6d0ea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:20.389690 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d3836-1aed-42b1-8cc8-c677ae6d0ea7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:20.396848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 156/308] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Sep 27 04:52:20 2022] GET /identity/v3/role_assignments?user.id=4d2a0035205141d69b0ba650e69816fd&scope.system=all&role.id=3f29e38dee7541f59eebc4b335c9237f => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:20.396848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551b60-78a9-4273-a5ca-708eb32ecb4d None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:20.397093 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551b60-78a9-4273-a5ca-708eb32ecb4d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:20.397520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93551b60-78a9-4273-a5ca-708eb32ecb4d None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:20.399348 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 157/309] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:20.411308 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c739fe3-365d-4171-8fc7-a44b0f5bd901 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:20.411852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c739fe3-365d-4171-8fc7-a44b0f5bd901 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:20.412269 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c739fe3-365d-4171-8fc7-a44b0f5bd901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:20.433256 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3c739fe3-365d-4171-8fc7-a44b0f5bd901 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:20.434585 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3c739fe3-365d-4171-8fc7-a44b0f5bd901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:20.492424 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31faf8c-49c4-48e6-b3bd-7d53223b5395 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:20.528697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256c6f3-180e-4e9b-98dd-2ac9ddc0f30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:20.529944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256c6f3-180e-4e9b-98dd-2ac9ddc0f30e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:20.536817 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 158/310] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:20.536998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256c6f3-180e-4e9b-98dd-2ac9ddc0f30e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:20.536998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256c6f3-180e-4e9b-98dd-2ac9ddc0f30e None admin] PATH_INFO: `/v3/users/8d0a7c8fa7c544bc87ed7d82ffac0a96` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:20.536998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256c6f3-180e-4e9b-98dd-2ac9ddc0f30e None admin] RBAC: Authorizing `identity:get_user(user_id=8d0a7c8fa7c544bc87ed7d82ffac0a96)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:20.536998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256c6f3-180e-4e9b-98dd-2ac9ddc0f30e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:20.539088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 153/311] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:20 2022] GET /identity/v3/users/8d0a7c8fa7c544bc87ed7d82ffac0a96 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:20.545929 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c739fe3-365d-4171-8fc7-a44b0f5bd901 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:20.558401 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256c6f3-180e-4e9b-98dd-2ac9ddc0f30e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:20.667960 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256c6f3-180e-4e9b-98dd-2ac9ddc0f30e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:20.669005 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c739fe3-365d-4171-8fc7-a44b0f5bd901 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:20.702205 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dd8cc-cc38-4e92-9fb5-38f102024f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:20.703058 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dd8cc-cc38-4e92-9fb5-38f102024f01 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:20.703414 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dd8cc-cc38-4e92-9fb5-38f102024f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:20.703800 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dd8cc-cc38-4e92-9fb5-38f102024f01 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:20.711701 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dde47-4e4a-43da-9065-db11c71a3756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:20.713262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dde47-4e4a-43da-9065-db11c71a3756 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:20.713728 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dde47-4e4a-43da-9065-db11c71a3756 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:20.714187 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dde47-4e4a-43da-9065-db11c71a3756 None admin] PATH_INFO: `/v3/system/users/8d0a7c8fa7c544bc87ed7d82ffac0a96/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:20.716093 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dde47-4e4a-43da-9065-db11c71a3756 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8d0a7c8fa7c544bc87ed7d82ffac0a96, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:20.717354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84dd8cc-cc38-4e92-9fb5-38f102024f01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:20.717567 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dde47-4e4a-43da-9065-db11c71a3756 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:20.727008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-f84dd8cc-cc38-4e92-9fb5-38f102024f01 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:52:20.733239 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 159/312] 10.222.0.27 () {58 vars in 1334 bytes} [Tue Sep 27 04:52:20 2022] PUT /identity/v3/system/users/8d0a7c8fa7c544bc87ed7d82ffac0a96/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:52:20.733436 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 154/313] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:20.740905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dde47-4e4a-43da-9065-db11c71a3756 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:20.856287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dde47-4e4a-43da-9065-db11c71a3756 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:20.894669 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fea3f2-1360-49c2-bb1e-6935907f6802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:20.896341 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fea3f2-1360-49c2-bb1e-6935907f6802 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:20.896906 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fea3f2-1360-49c2-bb1e-6935907f6802 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:20.897408 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fea3f2-1360-49c2-bb1e-6935907f6802 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:20.898383 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fea3f2-1360-49c2-bb1e-6935907f6802 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:20.898953 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fea3f2-1360-49c2-bb1e-6935907f6802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:20.900590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fea3f2-1360-49c2-bb1e-6935907f6802 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:20.910736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 160/314] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:20.918155 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dd8cc-cc38-4e92-9fb5-38f102024f01 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:21.028813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dd8cc-cc38-4e92-9fb5-38f102024f01 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:21.062841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd8598-17c5-4201-8864-3b3a06db3fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:21.063716 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd8598-17c5-4201-8864-3b3a06db3fcd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:21.063998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd8598-17c5-4201-8864-3b3a06db3fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:21.064275 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd8598-17c5-4201-8864-3b3a06db3fcd None admin] PATH_INFO: `/v3/users/4a76ef018cce4739a22b5690df21174e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:21.065495 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd8598-17c5-4201-8864-3b3a06db3fcd None admin] RBAC: Authorizing `identity:get_user(user_id=4a76ef018cce4739a22b5690df21174e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:21.067140 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd8598-17c5-4201-8864-3b3a06db3fcd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:21.069079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 155/315] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:20 2022] GET /identity/v3/users/4a76ef018cce4739a22b5690df21174e => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:21.074557 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fea3f2-1360-49c2-bb1e-6935907f6802 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:21.179765 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fea3f2-1360-49c2-bb1e-6935907f6802 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:21.216382 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fce648-35ea-4949-a4b9-e0c2defd60ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:21.217063 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fce648-35ea-4949-a4b9-e0c2defd60ff None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:21.217339 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fce648-35ea-4949-a4b9-e0c2defd60ff None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:21.217624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fce648-35ea-4949-a4b9-e0c2defd60ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:21.287367 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fce648-35ea-4949-a4b9-e0c2defd60ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:21.288925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fce648-35ea-4949-a4b9-e0c2defd60ff None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:21.391910 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 161/316] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:21.397705 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd8598-17c5-4201-8864-3b3a06db3fcd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:21.503785 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd8598-17c5-4201-8864-3b3a06db3fcd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:21.542023 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7c509-d421-47a6-9dd6-dbe5eff899ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:21.543261 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7c509-d421-47a6-9dd6-dbe5eff899ae None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:21.543745 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7c509-d421-47a6-9dd6-dbe5eff899ae None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:21.544210 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7c509-d421-47a6-9dd6-dbe5eff899ae None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:21.545605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7c509-d421-47a6-9dd6-dbe5eff899ae None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:21.547228 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7c509-d421-47a6-9dd6-dbe5eff899ae None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:21.549166 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 156/317] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:21 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:21.560823 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fce648-35ea-4949-a4b9-e0c2defd60ff None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:21.659400 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fce648-35ea-4949-a4b9-e0c2defd60ff None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:21.694283 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f4d12-6e6d-4af2-80dc-d521d33d13f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:21.694943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f4d12-6e6d-4af2-80dc-d521d33d13f8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:21.695228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f4d12-6e6d-4af2-80dc-d521d33d13f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:21.695507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f4d12-6e6d-4af2-80dc-d521d33d13f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:21.696337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f4d12-6e6d-4af2-80dc-d521d33d13f8 None admin] RBAC: Adding query filter params (role.id=3f29e38dee7541f59eebc4b335c9237f, scope.project.id=128e459def144365b3b01282148ec980, user.id=4a76ef018cce4739a22b5690df21174e) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:21.696648 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f4d12-6e6d-4af2-80dc-d521d33d13f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:21.698129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f4d12-6e6d-4af2-80dc-d521d33d13f8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:21.704410 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 162/318] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:21 2022] GET /identity/v3/role_assignments?user.id=4a76ef018cce4739a22b5690df21174e&scope.project.id=128e459def144365b3b01282148ec980&role.id=3f29e38dee7541f59eebc4b335c9237f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:22.667939 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac226d-6b7d-430f-9eb7-38bf0d184827 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:22.668476 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac226d-6b7d-430f-9eb7-38bf0d184827 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:22.668476 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac226d-6b7d-430f-9eb7-38bf0d184827 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:22.670447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 157/319] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:22.675463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490bda7-a887-4d6d-ad3d-59e0df57d3c3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:22.675870 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490bda7-a887-4d6d-ad3d-59e0df57d3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:22.676047 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490bda7-a887-4d6d-ad3d-59e0df57d3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:22.693225 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7490bda7-a887-4d6d-ad3d-59e0df57d3c3 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:22.694403 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7490bda7-a887-4d6d-ad3d-59e0df57d3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:22.759351 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 163/320] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:22.781683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac226d-6b7d-430f-9eb7-38bf0d184827 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:22.785502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe2f35-793f-4335-aa1f-56356d912d77 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:22.785795 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe2f35-793f-4335-aa1f-56356d912d77 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:22.786076 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe2f35-793f-4335-aa1f-56356d912d77 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:22.788908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 164/321] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:52:22.793985 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd07137-5874-4ceb-971b-0a1c51d93e82 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:22.794265 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd07137-5874-4ceb-971b-0a1c51d93e82 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:22.794535 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd07137-5874-4ceb-971b-0a1c51d93e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:22.812367 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7fd07137-5874-4ceb-971b-0a1c51d93e82 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:22.813632 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7fd07137-5874-4ceb-971b-0a1c51d93e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:22.884517 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 165/322] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:22.892565 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac226d-6b7d-430f-9eb7-38bf0d184827 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:22.906596 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd07137-5874-4ceb-971b-0a1c51d93e82 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:22.926003 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93da295-dd78-4367-8f07-9af184513f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:22.926894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93da295-dd78-4367-8f07-9af184513f48 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:22.927172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93da295-dd78-4367-8f07-9af184513f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:22.927445 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93da295-dd78-4367-8f07-9af184513f48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:22.928595 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93da295-dd78-4367-8f07-9af184513f48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:22.930149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93da295-dd78-4367-8f07-9af184513f48 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:22.931899 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 158/323] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:22.937167 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93da295-dd78-4367-8f07-9af184513f48 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:23.008858 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd07137-5874-4ceb-971b-0a1c51d93e82 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:23.039637 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93da295-dd78-4367-8f07-9af184513f48 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:23.049052 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bd74c-8976-4732-a520-ea1672692b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:23.050414 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd74c-8976-4732-a520-ea1672692b57 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:23.051177 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd74c-8976-4732-a520-ea1672692b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:23.051636 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd74c-8976-4732-a520-ea1672692b57 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:23.062463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bd74c-8976-4732-a520-ea1672692b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:23.069744 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-4e4bd74c-8976-4732-a520-ea1672692b57 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:52:23.071089 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 166/324] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:23.074762 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10904cd-9527-45ab-b4d7-6c0e47747cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:23.075680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10904cd-9527-45ab-b4d7-6c0e47747cc6 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:23.075680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10904cd-9527-45ab-b4d7-6c0e47747cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:23.075976 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10904cd-9527-45ab-b4d7-6c0e47747cc6 None admin] PATH_INFO: `/v3/groups` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:23.076496 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bd74c-8976-4732-a520-ea1672692b57 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:23.076661 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10904cd-9527-45ab-b4d7-6c0e47747cc6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:23.078224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10904cd-9527-45ab-b4d7-6c0e47747cc6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:23.093417 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 159/325] 10.222.0.27 () {60 vars in 1134 bytes} [Tue Sep 27 04:52:22 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:52:23.183352 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bd74c-8976-4732-a520-ea1672692b57 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:23.198683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55863d55-ec09-4369-90b7-f99e389cb9b3 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:23.199015 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55863d55-ec09-4369-90b7-f99e389cb9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:23.199248 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55863d55-ec09-4369-90b7-f99e389cb9b3 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:23.201243 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 160/326] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:52:23.206684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420afc4-6e81-40f2-8040-69328a72dff1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:23.206971 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420afc4-6e81-40f2-8040-69328a72dff1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:23.207235 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420afc4-6e81-40f2-8040-69328a72dff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:23.219905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b6eaf-e3ed-4c0f-a8f3-3162c360ece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:23.220585 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b6eaf-e3ed-4c0f-a8f3-3162c360ece0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:23.220895 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b6eaf-e3ed-4c0f-a8f3-3162c360ece0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:23.221175 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b6eaf-e3ed-4c0f-a8f3-3162c360ece0 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:23.221926 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b6eaf-e3ed-4c0f-a8f3-3162c360ece0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:23.222228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b6eaf-e3ed-4c0f-a8f3-3162c360ece0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:23.224218 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908b6eaf-e3ed-4c0f-a8f3-3162c360ece0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:23.226278 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d420afc4-6e81-40f2-8040-69328a72dff1 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:23.227677 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d420afc4-6e81-40f2-8040-69328a72dff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:23.238130 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 167/327] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:23.239335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b6eaf-e3ed-4c0f-a8f3-3162c360ece0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:23.300580 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 161/328] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:23.324695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420afc4-6e81-40f2-8040-69328a72dff1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:23.346686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908b6eaf-e3ed-4c0f-a8f3-3162c360ece0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:23.390436 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83284316-5639-4a86-8a5f-46b25a5a2525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:23.391546 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83284316-5639-4a86-8a5f-46b25a5a2525 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:23.391987 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83284316-5639-4a86-8a5f-46b25a5a2525 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:23.392421 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83284316-5639-4a86-8a5f-46b25a5a2525 None admin] PATH_INFO: `/v3/users/4d2a0035205141d69b0ba650e69816fd` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:23.393818 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83284316-5639-4a86-8a5f-46b25a5a2525 None admin] RBAC: Authorizing `identity:get_user(user_id=4d2a0035205141d69b0ba650e69816fd)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:23.396173 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83284316-5639-4a86-8a5f-46b25a5a2525 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:23.400872 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 168/329] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:23 2022] GET /identity/v3/users/4d2a0035205141d69b0ba650e69816fd => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:23.404319 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83284316-5639-4a86-8a5f-46b25a5a2525 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:23.440058 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420afc4-6e81-40f2-8040-69328a72dff1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:23.484018 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b4467-6811-4fe1-901e-516add2740bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:23.485506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b4467-6811-4fe1-901e-516add2740bb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:23.485506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b4467-6811-4fe1-901e-516add2740bb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:23.485818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b4467-6811-4fe1-901e-516add2740bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:23.501411 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b4467-6811-4fe1-901e-516add2740bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:23.509891 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-0e6b4467-6811-4fe1-901e-516add2740bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:52:23.515953 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 162/330] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:23.517213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b4467-6811-4fe1-901e-516add2740bb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:23.522046 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83284316-5639-4a86-8a5f-46b25a5a2525 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:23.565791 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e3d8c-b613-4c59-81fa-c1726bea6954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:23.566651 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e3d8c-b613-4c59-81fa-c1726bea6954 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:23.566957 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e3d8c-b613-4c59-81fa-c1726bea6954 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:23.567390 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e3d8c-b613-4c59-81fa-c1726bea6954 None admin] PATH_INFO: `/v3/system/users/4d2a0035205141d69b0ba650e69816fd/roles/3f29e38dee7541f59eebc4b335c9237f` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:23.569179 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e3d8c-b613-4c59-81fa-c1726bea6954 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4d2a0035205141d69b0ba650e69816fd, role_id=3f29e38dee7541f59eebc4b335c9237f)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:23.571494 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e3d8c-b613-4c59-81fa-c1726bea6954 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:23.581044 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 169/331] 10.222.0.27 () {58 vars in 1334 bytes} [Tue Sep 27 04:52:23 2022] PUT /identity/v3/system/users/4d2a0035205141d69b0ba650e69816fd/roles/3f29e38dee7541f59eebc4b335c9237f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:52:23.636891 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b4467-6811-4fe1-901e-516add2740bb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:23.677461 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b50fdd-3659-4745-bda3-37ce711ec651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:23.678240 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b50fdd-3659-4745-bda3-37ce711ec651 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:23.678429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b50fdd-3659-4745-bda3-37ce711ec651 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:23.678707 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b50fdd-3659-4745-bda3-37ce711ec651 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:23.679473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b50fdd-3659-4745-bda3-37ce711ec651 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:23.679780 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b50fdd-3659-4745-bda3-37ce711ec651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:23.681322 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b50fdd-3659-4745-bda3-37ce711ec651 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:23.691151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 163/332] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:23.696952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e3d8c-b613-4c59-81fa-c1726bea6954 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:23.808181 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e3d8c-b613-4c59-81fa-c1726bea6954 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:23.842091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc9577-490c-435a-b4f2-8667b333de7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:23.842962 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc9577-490c-435a-b4f2-8667b333de7d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:23.843244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc9577-490c-435a-b4f2-8667b333de7d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:23.843522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc9577-490c-435a-b4f2-8667b333de7d None admin] PATH_INFO: `/v3/users/8d0a7c8fa7c544bc87ed7d82ffac0a96` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:23.844726 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc9577-490c-435a-b4f2-8667b333de7d None admin] RBAC: Authorizing `identity:get_user(user_id=8d0a7c8fa7c544bc87ed7d82ffac0a96)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:23.846208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc9577-490c-435a-b4f2-8667b333de7d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:23.848292 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 170/333] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:23 2022] GET /identity/v3/users/8d0a7c8fa7c544bc87ed7d82ffac0a96 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:23.853990 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b50fdd-3659-4745-bda3-37ce711ec651 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:23.960580 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b50fdd-3659-4745-bda3-37ce711ec651 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:23.995923 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e1179-0c5b-47bc-a774-a466be6f8b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:23.996597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e1179-0c5b-47bc-a774-a466be6f8b6f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:23.996906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e1179-0c5b-47bc-a774-a466be6f8b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:23.997188 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e1179-0c5b-47bc-a774-a466be6f8b6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:23.998023 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e1179-0c5b-47bc-a774-a466be6f8b6f None admin] RBAC: Adding query filter params (role.id=76a348ab64cc49e0b464e3578474c8d6, user.id=8d0a7c8fa7c544bc87ed7d82ffac0a96, scope.system=all) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:23.998335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e1179-0c5b-47bc-a774-a466be6f8b6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:23.999786 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e1179-0c5b-47bc-a774-a466be6f8b6f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:24.012336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 164/334] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Sep 27 04:52:23 2022] GET /identity/v3/role_assignments?user.id=8d0a7c8fa7c544bc87ed7d82ffac0a96&scope.system=all&role.id=76a348ab64cc49e0b464e3578474c8d6 => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:26.206769 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5b644-dac4-47cc-987d-31d0e4fb6e3d None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:26.208397 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5b644-dac4-47cc-987d-31d0e4fb6e3d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:26.209102 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5b644-dac4-47cc-987d-31d0e4fb6e3d None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:26.211542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 171/335] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:26.217238 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f62d9d-2e69-4e28-b6b4-c05c5c3ea522 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:26.218104 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f62d9d-2e69-4e28-b6b4-c05c5c3ea522 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:26.218594 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f62d9d-2e69-4e28-b6b4-c05c5c3ea522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:26.241820 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-17f62d9d-2e69-4e28-b6b4-c05c5c3ea522 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:26.242952 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-17f62d9d-2e69-4e28-b6b4-c05c5c3ea522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:26.243070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337085c7-00e8-41d9-b1b3-81c9a228d467 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:26.243539 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337085c7-00e8-41d9-b1b3-81c9a228d467 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:26.244019 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337085c7-00e8-41d9-b1b3-81c9a228d467 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:26.246777 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 172/336] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:26.253261 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982cc55-868e-431c-9a03-7f410c4eab3f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:26.253785 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982cc55-868e-431c-9a03-7f410c4eab3f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:26.254355 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982cc55-868e-431c-9a03-7f410c4eab3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:26.277558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1982cc55-868e-431c-9a03-7f410c4eab3f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:26.279477 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1982cc55-868e-431c-9a03-7f410c4eab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:26.362340 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 165/337] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:26.390498 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 173/338] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:26.411392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f62d9d-2e69-4e28-b6b4-c05c5c3ea522 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:26.478110 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982cc55-868e-431c-9a03-7f410c4eab3f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:26.537882 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f62d9d-2e69-4e28-b6b4-c05c5c3ea522 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:26.577099 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce439df-0bc3-4e15-8736-8caf646e3189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:26.578151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce439df-0bc3-4e15-8736-8caf646e3189 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:26.578562 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce439df-0bc3-4e15-8736-8caf646e3189 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:26.578994 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce439df-0bc3-4e15-8736-8caf646e3189 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:26.589930 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce439df-0bc3-4e15-8736-8caf646e3189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:26.597105 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-dce439df-0bc3-4e15-8736-8caf646e3189 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:52:26.599691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 166/339] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:26.605395 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce439df-0bc3-4e15-8736-8caf646e3189 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:26.670019 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982cc55-868e-431c-9a03-7f410c4eab3f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:26.709012 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce439df-0bc3-4e15-8736-8caf646e3189 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:26.745944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb3dd8-b265-4c13-a135-a1f7085f067b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:26.746318 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92484345-d943-4e6e-9664-68eee926d160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:26.746621 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb3dd8-b265-4c13-a135-a1f7085f067b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:26.746902 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb3dd8-b265-4c13-a135-a1f7085f067b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:26.747141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92484345-d943-4e6e-9664-68eee926d160 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:26.747247 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb3dd8-b265-4c13-a135-a1f7085f067b None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:26.747420 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92484345-d943-4e6e-9664-68eee926d160 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:26.747692 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92484345-d943-4e6e-9664-68eee926d160 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:26.747916 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb3dd8-b265-4c13-a135-a1f7085f067b None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:26.748221 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb3dd8-b265-4c13-a135-a1f7085f067b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:26.749911 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb3dd8-b265-4c13-a135-a1f7085f067b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:26.759546 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 167/340] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:26.760896 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b903d-e4db-4fd4-8557-6419ae5ab79b None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:26.761486 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b903d-e4db-4fd4-8557-6419ae5ab79b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:26.761933 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b903d-e4db-4fd4-8557-6419ae5ab79b None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:26.764052 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 168/341] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:26.764941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b903d-e4db-4fd4-8557-6419ae5ab79b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:26.781420 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92484345-d943-4e6e-9664-68eee926d160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:26.789324 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-92484345-d943-4e6e-9664-68eee926d160 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:52:26.790812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 174/342] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:52:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:26.792034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d51ab2-4b24-4170-a32c-48250b1f37d9 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:26.792485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d51ab2-4b24-4170-a32c-48250b1f37d9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:26.792777 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d51ab2-4b24-4170-a32c-48250b1f37d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:26.829981 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-72d51ab2-4b24-4170-a32c-48250b1f37d9 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:26.831213 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-72d51ab2-4b24-4170-a32c-48250b1f37d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:26.884959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b903d-e4db-4fd4-8557-6419ae5ab79b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:26.922740 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64697980-b9d9-4410-8552-12389f18202c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:26.923662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64697980-b9d9-4410-8552-12389f18202c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:26.924095 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64697980-b9d9-4410-8552-12389f18202c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:26.924520 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64697980-b9d9-4410-8552-12389f18202c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:27.000519 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64697980-b9d9-4410-8552-12389f18202c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:27.002133 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64697980-b9d9-4410-8552-12389f18202c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:27.007064 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 175/343] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:27.008014 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d51ab2-4b24-4170-a32c-48250b1f37d9 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:27.115136 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 169/344] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:27.115993 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64697980-b9d9-4410-8552-12389f18202c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:27.224534 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64697980-b9d9-4410-8552-12389f18202c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:27.229751 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d51ab2-4b24-4170-a32c-48250b1f37d9 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:27.262000 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fd073-1976-44a2-b677-402b32e8ef0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:27.263080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fd073-1976-44a2-b677-402b32e8ef0d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:27.263505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fd073-1976-44a2-b677-402b32e8ef0d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:27.263920 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fd073-1976-44a2-b677-402b32e8ef0d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:27.274935 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39fd073-1976-44a2-b677-402b32e8ef0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:27.282321 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-f39fd073-1976-44a2-b677-402b32e8ef0d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 27 04:52:27.282462 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010d729-2e8d-40c6-8ed2-2a300e9ad9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:27.283073 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010d729-2e8d-40c6-8ed2-2a300e9ad9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:27.283358 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010d729-2e8d-40c6-8ed2-2a300e9ad9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:27.283638 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010d729-2e8d-40c6-8ed2-2a300e9ad9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:27.284397 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010d729-2e8d-40c6-8ed2-2a300e9ad9a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:27.284703 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010d729-2e8d-40c6-8ed2-2a300e9ad9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:27.284872 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 170/345] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:27.286069 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fd073-1976-44a2-b677-402b32e8ef0d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:27.287178 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010d729-2e8d-40c6-8ed2-2a300e9ad9a8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:27.301101 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 176/346] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:27.302602 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010d729-2e8d-40c6-8ed2-2a300e9ad9a8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:27.401954 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fd073-1976-44a2-b677-402b32e8ef0d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:27.437454 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010d729-2e8d-40c6-8ed2-2a300e9ad9a8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:27.444639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8a028-8b08-49db-9a96-9393e12e035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:27.445880 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8a028-8b08-49db-9a96-9393e12e035a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:27.446378 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8a028-8b08-49db-9a96-9393e12e035a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:27.446837 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8a028-8b08-49db-9a96-9393e12e035a None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:27.448234 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8a028-8b08-49db-9a96-9393e12e035a None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:27.449902 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8a028-8b08-49db-9a96-9393e12e035a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:27.451865 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 171/347] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:27 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:27.452824 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8a028-8b08-49db-9a96-9393e12e035a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:27.479380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4647bb0-83f7-4a90-a555-ecc34557058a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:27.480056 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4647bb0-83f7-4a90-a555-ecc34557058a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:27.480338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4647bb0-83f7-4a90-a555-ecc34557058a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:27.480634 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4647bb0-83f7-4a90-a555-ecc34557058a None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:27.481870 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4647bb0-83f7-4a90-a555-ecc34557058a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:27.482188 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4647bb0-83f7-4a90-a555-ecc34557058a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:27.483828 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4647bb0-83f7-4a90-a555-ecc34557058a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:27.495231 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 177/348] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:27.497059 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae1166-339d-49c6-aeb0-017d1902dfc5 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:27.497543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae1166-339d-49c6-aeb0-017d1902dfc5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:27.498076 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae1166-339d-49c6-aeb0-017d1902dfc5 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:27.500148 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 178/349] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:27.501061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae1166-339d-49c6-aeb0-017d1902dfc5 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:27.575730 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8a028-8b08-49db-9a96-9393e12e035a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:27.627300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858a17f-03ce-4edb-973d-24df4d6ca098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:27.628076 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858a17f-03ce-4edb-973d-24df4d6ca098 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:27.628551 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858a17f-03ce-4edb-973d-24df4d6ca098 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:27.629033 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858a17f-03ce-4edb-973d-24df4d6ca098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:27.633372 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae1166-339d-49c6-aeb0-017d1902dfc5 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:27.679428 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d19d9-5bb2-4e40-8bb5-3c097c162481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:27.680229 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d19d9-5bb2-4e40-8bb5-3c097c162481 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:27.680509 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d19d9-5bb2-4e40-8bb5-3c097c162481 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:27.680841 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d19d9-5bb2-4e40-8bb5-3c097c162481 None admin] PATH_INFO: `/v3/groups/9451e4c016f04e2f8ad654470aed6f79` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:27.688947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d19d9-5bb2-4e40-8bb5-3c097c162481 None admin] RBAC: Authorizing `identity:get_group(group_id=9451e4c016f04e2f8ad654470aed6f79)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:27.690717 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d19d9-5bb2-4e40-8bb5-3c097c162481 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:27.696837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 179/350] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 27 04:52:27 2022] GET /identity/v3/groups/9451e4c016f04e2f8ad654470aed6f79 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:27.696837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b84065-d98c-4636-b834-7b1fb18988bf None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:27.696837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b84065-d98c-4636-b834-7b1fb18988bf None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:27.696837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b84065-d98c-4636-b834-7b1fb18988bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:27.719444 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-88b84065-d98c-4636-b834-7b1fb18988bf None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:27.721084 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-88b84065-d98c-4636-b834-7b1fb18988bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:27.732157 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858a17f-03ce-4edb-973d-24df4d6ca098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:27.733711 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858a17f-03ce-4edb-973d-24df4d6ca098 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:27.814849 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 180/351] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:27.816022 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b84065-d98c-4636-b834-7b1fb18988bf None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:27.854188 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 172/352] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:27.855119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858a17f-03ce-4edb-973d-24df4d6ca098 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:27.931427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b84065-d98c-4636-b834-7b1fb18988bf None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:27.970315 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679e218-a162-40c8-a3cd-26dc6d377194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:27.971588 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679e218-a162-40c8-a3cd-26dc6d377194 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:27.972068 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679e218-a162-40c8-a3cd-26dc6d377194 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:27.972535 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679e218-a162-40c8-a3cd-26dc6d377194 None admin] PATH_INFO: `/v3/users/4d2a0035205141d69b0ba650e69816fd` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:27.974673 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679e218-a162-40c8-a3cd-26dc6d377194 None admin] RBAC: Authorizing `identity:get_user(user_id=4d2a0035205141d69b0ba650e69816fd)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:27.975852 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858a17f-03ce-4edb-973d-24df4d6ca098 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:27.976623 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679e218-a162-40c8-a3cd-26dc6d377194 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:27.978486 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 181/353] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:52:27 2022] GET /identity/v3/users/4d2a0035205141d69b0ba650e69816fd => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:27.979469 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679e218-a162-40c8-a3cd-26dc6d377194 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:28.025558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b120ce-01e0-4016-93b1-2c5c6cb4f1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:28.026350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b120ce-01e0-4016-93b1-2c5c6cb4f1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:28.026634 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b120ce-01e0-4016-93b1-2c5c6cb4f1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:28.026903 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b120ce-01e0-4016-93b1-2c5c6cb4f1e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:28.028564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b120ce-01e0-4016-93b1-2c5c6cb4f1e6 None admin] RBAC: Adding query filter params (group.id=9451e4c016f04e2f8ad654470aed6f79, role.id=76a348ab64cc49e0b464e3578474c8d6, scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:28.028902 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b120ce-01e0-4016-93b1-2c5c6cb4f1e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:28.030365 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b120ce-01e0-4016-93b1-2c5c6cb4f1e6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:28.038208 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 173/354] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 27 04:52:27 2022] GET /identity/v3/role_assignments?group.id=9451e4c016f04e2f8ad654470aed6f79&scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4&role.id=76a348ab64cc49e0b464e3578474c8d6 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:28.041711 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b120ce-01e0-4016-93b1-2c5c6cb4f1e6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:28.142974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679e218-a162-40c8-a3cd-26dc6d377194 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:28.195959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b120ce-01e0-4016-93b1-2c5c6cb4f1e6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:28.199400 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568197a-2220-4295-9423-789ddd26923f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:28.199781 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568197a-2220-4295-9423-789ddd26923f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:28.200058 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568197a-2220-4295-9423-789ddd26923f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:28.200330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568197a-2220-4295-9423-789ddd26923f None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:28.201607 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568197a-2220-4295-9423-789ddd26923f None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:28.203104 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568197a-2220-4295-9423-789ddd26923f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:28.205227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 182/355] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:27 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:28.206095 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568197a-2220-4295-9423-789ddd26923f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:28.242157 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889ba37-66c2-4829-a59d-cb0cf73a30a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:28.243659 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889ba37-66c2-4829-a59d-cb0cf73a30a7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:28.243988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889ba37-66c2-4829-a59d-cb0cf73a30a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:28.244267 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889ba37-66c2-4829-a59d-cb0cf73a30a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:28.262643 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889ba37-66c2-4829-a59d-cb0cf73a30a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:28.274847 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-d889ba37-66c2-4829-a59d-cb0cf73a30a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:52:28.276112 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 174/356] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:28.279129 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbeaaa-4d65-490f-b702-cd13e29f2796 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:28.279416 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbeaaa-4d65-490f-b702-cd13e29f2796 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:28.279991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbeaaa-4d65-490f-b702-cd13e29f2796 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:28.281961 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 175/357] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:28.287569 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbeaaa-4d65-490f-b702-cd13e29f2796 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:28.342986 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568197a-2220-4295-9423-789ddd26923f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:28.383529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1878e-d5c6-4d22-8c69-bb9ffe2acd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:28.384631 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1878e-d5c6-4d22-8c69-bb9ffe2acd6d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:28.385158 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1878e-d5c6-4d22-8c69-bb9ffe2acd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:28.385643 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1878e-d5c6-4d22-8c69-bb9ffe2acd6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:28.386691 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1878e-d5c6-4d22-8c69-bb9ffe2acd6d None admin] RBAC: Adding query filter params (role.id=3f29e38dee7541f59eebc4b335c9237f, user.id=4d2a0035205141d69b0ba650e69816fd, scope.system=all) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:28.387207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1878e-d5c6-4d22-8c69-bb9ffe2acd6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:28.388931 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1878e-d5c6-4d22-8c69-bb9ffe2acd6d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:28.403816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 183/358] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Sep 27 04:52:28 2022] GET /identity/v3/role_assignments?user.id=4d2a0035205141d69b0ba650e69816fd&scope.system=all&role.id=3f29e38dee7541f59eebc4b335c9237f => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:28.409246 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1878e-d5c6-4d22-8c69-bb9ffe2acd6d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:28.539125 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbeaaa-4d65-490f-b702-cd13e29f2796 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:28.585357 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0b615-b178-4771-93e7-7819c4a2688a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:28.586708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0b615-b178-4771-93e7-7819c4a2688a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:28.587317 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0b615-b178-4771-93e7-7819c4a2688a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:28.587780 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0b615-b178-4771-93e7-7819c4a2688a None admin] PATH_INFO: `/v3/groups/9451e4c016f04e2f8ad654470aed6f79` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:28.589320 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0b615-b178-4771-93e7-7819c4a2688a None admin] RBAC: Authorizing `identity:get_group(group_id=9451e4c016f04e2f8ad654470aed6f79)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:28.591046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0b615-b178-4771-93e7-7819c4a2688a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:28.593384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 176/359] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 27 04:52:28 2022] GET /identity/v3/groups/9451e4c016f04e2f8ad654470aed6f79 => generated 226 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:28.594966 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b042e04-2cbb-42c6-9811-8e202daa0c56 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:28.595475 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b042e04-2cbb-42c6-9811-8e202daa0c56 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:28.600819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b042e04-2cbb-42c6-9811-8e202daa0c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:28.601240 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1878e-d5c6-4d22-8c69-bb9ffe2acd6d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:28.620650 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6b042e04-2cbb-42c6-9811-8e202daa0c56 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:28.622369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6b042e04-2cbb-42c6-9811-8e202daa0c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:28.648761 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1470e-8e9e-4dfe-beb4-655c30b09ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:28.649856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1470e-8e9e-4dfe-beb4-655c30b09ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:28.650327 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1470e-8e9e-4dfe-beb4-655c30b09ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:28.650788 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1470e-8e9e-4dfe-beb4-655c30b09ab0 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:28.651838 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1470e-8e9e-4dfe-beb4-655c30b09ab0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:28.652391 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1470e-8e9e-4dfe-beb4-655c30b09ab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:28.654055 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1470e-8e9e-4dfe-beb4-655c30b09ab0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:28.665415 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 184/360] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:28.667088 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9059c1c-128c-4394-907a-bf1d8dcba76b None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:28.667606 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9059c1c-128c-4394-907a-bf1d8dcba76b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:28.668091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9059c1c-128c-4394-907a-bf1d8dcba76b None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:28.670362 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 185/361] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:28.672567 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9059c1c-128c-4394-907a-bf1d8dcba76b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:28.715688 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 177/362] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:28.716904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b042e04-2cbb-42c6-9811-8e202daa0c56 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:28.809671 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9059c1c-128c-4394-907a-bf1d8dcba76b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:28.851996 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b042e04-2cbb-42c6-9811-8e202daa0c56 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:28.859010 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc33868-a8e8-4ce2-ae64-148c4f03af38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:28.859672 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc33868-a8e8-4ce2-ae64-148c4f03af38 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:28.859950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc33868-a8e8-4ce2-ae64-148c4f03af38 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:28.860222 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc33868-a8e8-4ce2-ae64-148c4f03af38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:28.861579 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc33868-a8e8-4ce2-ae64-148c4f03af38 None admin] RBAC: Adding query filter params (group.id=9451e4c016f04e2f8ad654470aed6f79, role.id=20b1a2451e0a42628e0126aa881cac6b, scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:28.861887 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc33868-a8e8-4ce2-ae64-148c4f03af38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:28.864251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc33868-a8e8-4ce2-ae64-148c4f03af38 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:28.870205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 186/363] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 27 04:52:28 2022] GET /identity/v3/role_assignments?group.id=9451e4c016f04e2f8ad654470aed6f79&scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4&role.id=20b1a2451e0a42628e0126aa881cac6b => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:28.871705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491ae34-7385-48c9-ba14-349817c0f769 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:28.871984 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491ae34-7385-48c9-ba14-349817c0f769 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:28.872255 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491ae34-7385-48c9-ba14-349817c0f769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:28.891788 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8c761-270b-4d42-8413-40c8071749bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:28.892484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3491ae34-7385-48c9-ba14-349817c0f769 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:28.892723 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8c761-270b-4d42-8413-40c8071749bc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:28.893173 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8c761-270b-4d42-8413-40c8071749bc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:28.893453 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8c761-270b-4d42-8413-40c8071749bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:28.893722 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3491ae34-7385-48c9-ba14-349817c0f769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:28.993272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 187/364] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:28.994213 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491ae34-7385-48c9-ba14-349817c0f769 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:29.001115 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8c761-270b-4d42-8413-40c8071749bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:29.002615 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8c761-270b-4d42-8413-40c8071749bc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:29.110249 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491ae34-7385-48c9-ba14-349817c0f769 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:29.136276 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 178/365] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:29.137613 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8c761-270b-4d42-8413-40c8071749bc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:29.168385 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cf31b-e1e4-46dd-98de-5d0847b18e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:29.169259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cf31b-e1e4-46dd-98de-5d0847b18e93 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:29.169539 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cf31b-e1e4-46dd-98de-5d0847b18e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:29.169814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cf31b-e1e4-46dd-98de-5d0847b18e93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:29.185156 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cf31b-e1e4-46dd-98de-5d0847b18e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:29.194061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-371cf31b-e1e4-46dd-98de-5d0847b18e93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:52:29.195909 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 188/366] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:52:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:29.196686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cf31b-e1e4-46dd-98de-5d0847b18e93 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:29.268233 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8c761-270b-4d42-8413-40c8071749bc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:29.305484 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b81356-1843-4bd2-bf15-85c1db1ec79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:29.306684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b81356-1843-4bd2-bf15-85c1db1ec79e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:29.307168 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b81356-1843-4bd2-bf15-85c1db1ec79e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:29.307663 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b81356-1843-4bd2-bf15-85c1db1ec79e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:29.309324 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cf31b-e1e4-46dd-98de-5d0847b18e93 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:29.319127 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b81356-1843-4bd2-bf15-85c1db1ec79e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:29.326668 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-a2b81356-1843-4bd2-bf15-85c1db1ec79e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:52:29.328562 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 179/367] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:52:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:29.329626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b81356-1843-4bd2-bf15-85c1db1ec79e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:29.349103 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332ba10-4d2d-4451-94f9-2077c7e60c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:29.350054 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332ba10-4d2d-4451-94f9-2077c7e60c1b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:29.350335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332ba10-4d2d-4451-94f9-2077c7e60c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:29.350606 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332ba10-4d2d-4451-94f9-2077c7e60c1b None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:29.351811 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332ba10-4d2d-4451-94f9-2077c7e60c1b None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:29.353296 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332ba10-4d2d-4451-94f9-2077c7e60c1b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:29.355004 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 189/368] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:29 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:29.356908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332ba10-4d2d-4451-94f9-2077c7e60c1b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:29.443859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b81356-1843-4bd2-bf15-85c1db1ec79e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:29.477551 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a703f6-bf4a-4085-9b2b-9cd2ccff9779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:29.478222 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a703f6-bf4a-4085-9b2b-9cd2ccff9779 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:29.478498 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a703f6-bf4a-4085-9b2b-9cd2ccff9779 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:29.478764 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a703f6-bf4a-4085-9b2b-9cd2ccff9779 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:29.479517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a703f6-bf4a-4085-9b2b-9cd2ccff9779 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:29.479796 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a703f6-bf4a-4085-9b2b-9cd2ccff9779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:29.481741 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a703f6-bf4a-4085-9b2b-9cd2ccff9779 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:29.490466 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 180/369] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:29.491399 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a703f6-bf4a-4085-9b2b-9cd2ccff9779 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:29.493167 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332ba10-4d2d-4451-94f9-2077c7e60c1b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:29.556399 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8516b-8314-4155-a5c9-bff8cb42a8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:29.557456 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8516b-8314-4155-a5c9-bff8cb42a8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:29.557941 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8516b-8314-4155-a5c9-bff8cb42a8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:29.558434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8516b-8314-4155-a5c9-bff8cb42a8e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:29.559405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8516b-8314-4155-a5c9-bff8cb42a8e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:29.559935 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8516b-8314-4155-a5c9-bff8cb42a8e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:29.561570 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8516b-8314-4155-a5c9-bff8cb42a8e5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:29.574030 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 190/370] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:29.575163 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8516b-8314-4155-a5c9-bff8cb42a8e5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:29.621096 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a703f6-bf4a-4085-9b2b-9cd2ccff9779 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:29.667971 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f62b4-868d-4840-8c38-373f21b691e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:29.668861 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f62b4-868d-4840-8c38-373f21b691e4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:29.669145 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f62b4-868d-4840-8c38-373f21b691e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:29.669418 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f62b4-868d-4840-8c38-373f21b691e4 None admin] PATH_INFO: `/v3/groups/9451e4c016f04e2f8ad654470aed6f79` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:29.670586 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f62b4-868d-4840-8c38-373f21b691e4 None admin] RBAC: Authorizing `identity:get_group(group_id=9451e4c016f04e2f8ad654470aed6f79)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:29.672016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f62b4-868d-4840-8c38-373f21b691e4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:29.674012 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 181/371] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 27 04:52:29 2022] GET /identity/v3/groups/9451e4c016f04e2f8ad654470aed6f79 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:29.675369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f62b4-868d-4840-8c38-373f21b691e4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:29.705365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8516b-8314-4155-a5c9-bff8cb42a8e5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:29.746621 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc85f21-4e53-4be8-b07c-e08dae9846c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:29.747644 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc85f21-4e53-4be8-b07c-e08dae9846c7 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:29.748149 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc85f21-4e53-4be8-b07c-e08dae9846c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:29.748690 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc85f21-4e53-4be8-b07c-e08dae9846c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:29.792973 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f62b4-868d-4840-8c38-373f21b691e4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:29.831500 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f25aee-1027-4e7d-919d-007ae950aba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:29.833651 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc85f21-4e53-4be8-b07c-e08dae9846c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:29.833816 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f25aee-1027-4e7d-919d-007ae950aba4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:29.834319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f25aee-1027-4e7d-919d-007ae950aba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:29.834796 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f25aee-1027-4e7d-919d-007ae950aba4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:29.835126 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc85f21-4e53-4be8-b07c-e08dae9846c7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:29.911133 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f25aee-1027-4e7d-919d-007ae950aba4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:29.913004 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f25aee-1027-4e7d-919d-007ae950aba4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:29.951423 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 191/372] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:29.952733 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc85f21-4e53-4be8-b07c-e08dae9846c7 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:30.028545 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 182/373] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:30.029755 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f25aee-1027-4e7d-919d-007ae950aba4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:30.091113 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc85f21-4e53-4be8-b07c-e08dae9846c7 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:30.141983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d261f56-93be-4534-beee-5630f73879c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:30.143049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d261f56-93be-4534-beee-5630f73879c3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:30.143325 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d261f56-93be-4534-beee-5630f73879c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:30.143599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d261f56-93be-4534-beee-5630f73879c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:30.144431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d261f56-93be-4534-beee-5630f73879c3 None admin] RBAC: Adding query filter params (group.id=9451e4c016f04e2f8ad654470aed6f79, role.id=76a348ab64cc49e0b464e3578474c8d6, scope.project.id=128e459def144365b3b01282148ec980) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:30.144867 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d261f56-93be-4534-beee-5630f73879c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:30.146952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d261f56-93be-4534-beee-5630f73879c3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:30.153089 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 192/374] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 27 04:52:29 2022] GET /identity/v3/role_assignments?group.id=9451e4c016f04e2f8ad654470aed6f79&scope.project.id=128e459def144365b3b01282148ec980&role.id=76a348ab64cc49e0b464e3578474c8d6 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:30.154016 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d261f56-93be-4534-beee-5630f73879c3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:30.157992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f25aee-1027-4e7d-919d-007ae950aba4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:30.202003 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87504add-6dfd-4078-8579-1f8f2ad295fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:30.203356 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87504add-6dfd-4078-8579-1f8f2ad295fa None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:30.203884 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87504add-6dfd-4078-8579-1f8f2ad295fa None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:30.204691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87504add-6dfd-4078-8579-1f8f2ad295fa None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:30.206264 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87504add-6dfd-4078-8579-1f8f2ad295fa None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:30.208609 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87504add-6dfd-4078-8579-1f8f2ad295fa None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:30.210924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 183/375] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:30 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:30.217258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87504add-6dfd-4078-8579-1f8f2ad295fa None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:30.266304 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d261f56-93be-4534-beee-5630f73879c3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:30.302559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caf1d7-178e-450d-be0c-db5e2cdd416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:30.303500 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caf1d7-178e-450d-be0c-db5e2cdd416e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:30.303775 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caf1d7-178e-450d-be0c-db5e2cdd416e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:30.304044 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caf1d7-178e-450d-be0c-db5e2cdd416e None admin] PATH_INFO: `/v3/projects/c063435f154b48b086fd2d4eed2a41ea` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:30.305344 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caf1d7-178e-450d-be0c-db5e2cdd416e None admin] RBAC: Authorizing `identity:get_project(project_id=c063435f154b48b086fd2d4eed2a41ea)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:30.306838 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caf1d7-178e-450d-be0c-db5e2cdd416e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:30.312941 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 193/376] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:30 2022] GET /identity/v3/projects/c063435f154b48b086fd2d4eed2a41ea => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:30.314586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caf1d7-178e-450d-be0c-db5e2cdd416e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:30.422311 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caf1d7-178e-450d-be0c-db5e2cdd416e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:30.460737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd14bd-8297-4f13-974a-285e51de676c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:30.462399 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd14bd-8297-4f13-974a-285e51de676c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:30.462896 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd14bd-8297-4f13-974a-285e51de676c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:30.463375 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87504add-6dfd-4078-8579-1f8f2ad295fa None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:30.463813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd14bd-8297-4f13-974a-285e51de676c None admin] PATH_INFO: `/v3/groups/3dae919a677849f1a3f33a233cc51498` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:30.469568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd14bd-8297-4f13-974a-285e51de676c None admin] RBAC: Authorizing `identity:get_group(group_id=3dae919a677849f1a3f33a233cc51498)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:30.471039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd14bd-8297-4f13-974a-285e51de676c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:30.476937 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 194/377] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 27 04:52:30 2022] GET /identity/v3/groups/3dae919a677849f1a3f33a233cc51498 => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:30.479215 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd14bd-8297-4f13-974a-285e51de676c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:30.508919 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877fba5-e155-4949-9f8e-7ec0d6f77aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:30.510287 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877fba5-e155-4949-9f8e-7ec0d6f77aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:30.510785 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877fba5-e155-4949-9f8e-7ec0d6f77aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:30.511255 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877fba5-e155-4949-9f8e-7ec0d6f77aa9 None admin] PATH_INFO: `/v3/groups/9451e4c016f04e2f8ad654470aed6f79` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:30.512929 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877fba5-e155-4949-9f8e-7ec0d6f77aa9 None admin] RBAC: Authorizing `identity:get_group(group_id=9451e4c016f04e2f8ad654470aed6f79)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:30.514585 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877fba5-e155-4949-9f8e-7ec0d6f77aa9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:30.516467 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 184/378] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 27 04:52:30 2022] GET /identity/v3/groups/9451e4c016f04e2f8ad654470aed6f79 => generated 226 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:30.523285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877fba5-e155-4949-9f8e-7ec0d6f77aa9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:30.583089 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd14bd-8297-4f13-974a-285e51de676c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:30.618866 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8ad1b-cfa7-407e-a310-6accdc4856fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:30.619527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8ad1b-cfa7-407e-a310-6accdc4856fb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:30.619804 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8ad1b-cfa7-407e-a310-6accdc4856fb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:30.620077 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8ad1b-cfa7-407e-a310-6accdc4856fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:30.621200 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8ad1b-cfa7-407e-a310-6accdc4856fb None admin] RBAC: Adding query filter params (group.id=3dae919a677849f1a3f33a233cc51498, role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=c063435f154b48b086fd2d4eed2a41ea) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:30.621513 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8ad1b-cfa7-407e-a310-6accdc4856fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:30.626487 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8ad1b-cfa7-407e-a310-6accdc4856fb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:30.633237 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 195/379] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 27 04:52:30 2022] GET /identity/v3/role_assignments?group.id=3dae919a677849f1a3f33a233cc51498&scope.project.id=c063435f154b48b086fd2d4eed2a41ea&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:30.680821 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877fba5-e155-4949-9f8e-7ec0d6f77aa9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:30.727138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fb8f6-6a43-4f67-ba53-91239e32b973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:30.728194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb8f6-6a43-4f67-ba53-91239e32b973 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:30.728669 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb8f6-6a43-4f67-ba53-91239e32b973 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:30.729179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb8f6-6a43-4f67-ba53-91239e32b973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:30.730232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fb8f6-6a43-4f67-ba53-91239e32b973 None admin] RBAC: Adding query filter params (group.id=9451e4c016f04e2f8ad654470aed6f79, role.id=20b1a2451e0a42628e0126aa881cac6b, scope.project.id=128e459def144365b3b01282148ec980) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:30.730770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fb8f6-6a43-4f67-ba53-91239e32b973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:30.732445 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fb8f6-6a43-4f67-ba53-91239e32b973 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:30.740422 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 185/380] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 27 04:52:30 2022] GET /identity/v3/role_assignments?group.id=9451e4c016f04e2f8ad654470aed6f79&scope.project.id=128e459def144365b3b01282148ec980&role.id=20b1a2451e0a42628e0126aa881cac6b => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:30.874410 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bea3dc-ae4e-4151-b06c-e5f8f02c3894 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:30.874779 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bea3dc-ae4e-4151-b06c-e5f8f02c3894 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:30.874981 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bea3dc-ae4e-4151-b06c-e5f8f02c3894 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:30.876924 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 196/381] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:30.883315 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812b800-186d-4ec1-b503-f82dc647f292 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:30.883594 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812b800-186d-4ec1-b503-f82dc647f292 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:30.883877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812b800-186d-4ec1-b503-f82dc647f292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:30.906632 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c812b800-186d-4ec1-b503-f82dc647f292 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:30.907846 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c812b800-186d-4ec1-b503-f82dc647f292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:31.010343 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 186/382] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:31.036137 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bea3dc-ae4e-4151-b06c-e5f8f02c3894 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:31.156379 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bea3dc-ae4e-4151-b06c-e5f8f02c3894 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:31.199254 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1d82d-c5b3-408b-9e5d-5b28940f15f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:31.200087 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1d82d-c5b3-408b-9e5d-5b28940f15f8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:31.200411 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1d82d-c5b3-408b-9e5d-5b28940f15f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:31.200812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1d82d-c5b3-408b-9e5d-5b28940f15f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:31.217022 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1d82d-c5b3-408b-9e5d-5b28940f15f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:31.224196 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-fbe1d82d-c5b3-408b-9e5d-5b28940f15f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:52:31.225613 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 197/383] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:31.231643 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812b800-186d-4ec1-b503-f82dc647f292 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:31.376328 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812b800-186d-4ec1-b503-f82dc647f292 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:31.415738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9419214-b9c5-4ebb-ad8e-b317c2f94d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:31.416752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9419214-b9c5-4ebb-ad8e-b317c2f94d9d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:31.417257 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9419214-b9c5-4ebb-ad8e-b317c2f94d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:31.417725 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9419214-b9c5-4ebb-ad8e-b317c2f94d9d None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:31.418665 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9419214-b9c5-4ebb-ad8e-b317c2f94d9d None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:31.419163 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9419214-b9c5-4ebb-ad8e-b317c2f94d9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:31.420818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9419214-b9c5-4ebb-ad8e-b317c2f94d9d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:31.432542 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 187/384] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:31.438504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1d82d-c5b3-408b-9e5d-5b28940f15f8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:31.614578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1d82d-c5b3-408b-9e5d-5b28940f15f8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:31.673608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266175b-c963-40b4-b15c-19389f6c733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:31.675022 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266175b-c963-40b4-b15c-19389f6c733f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:31.675173 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266175b-c963-40b4-b15c-19389f6c733f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:31.675434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266175b-c963-40b4-b15c-19389f6c733f None admin] PATH_INFO: `/v3/groups/9451e4c016f04e2f8ad654470aed6f79` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:31.677413 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266175b-c963-40b4-b15c-19389f6c733f None admin] RBAC: Authorizing `identity:get_group(group_id=9451e4c016f04e2f8ad654470aed6f79)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:31.678879 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266175b-c963-40b4-b15c-19389f6c733f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:31.680833 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 198/385] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 27 04:52:31 2022] GET /identity/v3/groups/9451e4c016f04e2f8ad654470aed6f79 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:31.689711 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9419214-b9c5-4ebb-ad8e-b317c2f94d9d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:31.835995 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5e848-831f-4dff-b2fe-70ab9c209bcb None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:31.836446 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5e848-831f-4dff-b2fe-70ab9c209bcb None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:31.836589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5e848-831f-4dff-b2fe-70ab9c209bcb None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:31.838746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 199/386] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:31.845910 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5eea0-d6b4-4365-81a9-99b9f24e86ab None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:31.846260 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5eea0-d6b4-4365-81a9-99b9f24e86ab None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:31.846486 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5eea0-d6b4-4365-81a9-99b9f24e86ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:31.885859 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-91a5eea0-d6b4-4365-81a9-99b9f24e86ab None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:31.887075 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-91a5eea0-d6b4-4365-81a9-99b9f24e86ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:31.936737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9419214-b9c5-4ebb-ad8e-b317c2f94d9d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:32.017833 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697bd43-23aa-489b-89a1-e50837a3f264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:32.019018 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697bd43-23aa-489b-89a1-e50837a3f264 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:32.019200 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697bd43-23aa-489b-89a1-e50837a3f264 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:32.019445 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697bd43-23aa-489b-89a1-e50837a3f264 None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:32.021723 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697bd43-23aa-489b-89a1-e50837a3f264 None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:32.023196 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697bd43-23aa-489b-89a1-e50837a3f264 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:32.028708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 188/387] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:31 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:32.040009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697bd43-23aa-489b-89a1-e50837a3f264 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:32.074869 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 200/388] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:32.166389 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5eea0-d6b4-4365-81a9-99b9f24e86ab None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:32.183973 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697bd43-23aa-489b-89a1-e50837a3f264 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:32.237120 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f979f6f-9f62-4bee-8b82-380592ee67c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:32.239753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f979f6f-9f62-4bee-8b82-380592ee67c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:32.240429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f979f6f-9f62-4bee-8b82-380592ee67c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:32.240885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f979f6f-9f62-4bee-8b82-380592ee67c9 None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4/groups/9451e4c016f04e2f8ad654470aed6f79/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:32.244434 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f979f6f-9f62-4bee-8b82-380592ee67c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4, group_id=9451e4c016f04e2f8ad654470aed6f79, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:32.248383 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f979f6f-9f62-4bee-8b82-380592ee67c9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:32.269044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 189/389] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Sep 27 04:52:32 2022] PUT /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4/groups/9451e4c016f04e2f8ad654470aed6f79/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:52:32.390121 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5eea0-d6b4-4365-81a9-99b9f24e86ab None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:32.444573 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2f201-d93f-45ac-b16b-e23972fc1db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:32.445338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2f201-d93f-45ac-b16b-e23972fc1db6 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:32.446347 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2f201-d93f-45ac-b16b-e23972fc1db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:32.446347 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2f201-d93f-45ac-b16b-e23972fc1db6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:32.463396 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2f201-d93f-45ac-b16b-e23972fc1db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:32.471796 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-86a2f201-d93f-45ac-b16b-e23972fc1db6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:52:32.477639 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 201/390] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:52:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:32.486148 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f979f6f-9f62-4bee-8b82-380592ee67c9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:32.653117 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f979f6f-9f62-4bee-8b82-380592ee67c9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:32.689568 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffcd97-3eea-4f03-b437-3296ac780f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:32.690700 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffcd97-3eea-4f03-b437-3296ac780f6d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:32.691209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffcd97-3eea-4f03-b437-3296ac780f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:32.691697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffcd97-3eea-4f03-b437-3296ac780f6d None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:32.693103 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffcd97-3eea-4f03-b437-3296ac780f6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:32.693626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffcd97-3eea-4f03-b437-3296ac780f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:32.696152 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffcd97-3eea-4f03-b437-3296ac780f6d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:32.707980 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 190/391] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:32.713773 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2f201-d93f-45ac-b16b-e23972fc1db6 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:32.825834 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2f201-d93f-45ac-b16b-e23972fc1db6 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:32.880073 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7f235-f161-4c36-891a-5d5e922387de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:32.880968 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7f235-f161-4c36-891a-5d5e922387de None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:32.881249 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7f235-f161-4c36-891a-5d5e922387de None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:32.881519 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7f235-f161-4c36-891a-5d5e922387de None admin] PATH_INFO: `/v3/groups/9451e4c016f04e2f8ad654470aed6f79` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:32.882702 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7f235-f161-4c36-891a-5d5e922387de None admin] RBAC: Authorizing `identity:get_group(group_id=9451e4c016f04e2f8ad654470aed6f79)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:32.884141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7f235-f161-4c36-891a-5d5e922387de None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:32.886073 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 202/392] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 27 04:52:32 2022] GET /identity/v3/groups/9451e4c016f04e2f8ad654470aed6f79 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:32.891421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffcd97-3eea-4f03-b437-3296ac780f6d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:33.008689 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffcd97-3eea-4f03-b437-3296ac780f6d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:33.052324 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684d51d-1d90-4fb1-bcfe-ca8b6cd26a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:33.053882 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684d51d-1d90-4fb1-bcfe-ca8b6cd26a3d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:33.054353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684d51d-1d90-4fb1-bcfe-ca8b6cd26a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:33.054819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684d51d-1d90-4fb1-bcfe-ca8b6cd26a3d None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:33.056960 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684d51d-1d90-4fb1-bcfe-ca8b6cd26a3d None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:33.059715 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684d51d-1d90-4fb1-bcfe-ca8b6cd26a3d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:33.062221 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 191/393] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:32 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:33.068598 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7f235-f161-4c36-891a-5d5e922387de None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:33.183409 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7f235-f161-4c36-891a-5d5e922387de None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:33.218656 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c37a32-378c-4a7e-aabb-6e870d3af2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:33.219562 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c37a32-378c-4a7e-aabb-6e870d3af2cd None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:33.219837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c37a32-378c-4a7e-aabb-6e870d3af2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:33.220107 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c37a32-378c-4a7e-aabb-6e870d3af2cd None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4/groups/9451e4c016f04e2f8ad654470aed6f79/roles/20b1a2451e0a42628e0126aa881cac6b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:33.222456 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c37a32-378c-4a7e-aabb-6e870d3af2cd None admin] RBAC: Authorizing `identity:create_grant(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4, group_id=9451e4c016f04e2f8ad654470aed6f79, role_id=20b1a2451e0a42628e0126aa881cac6b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:33.224851 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c37a32-378c-4a7e-aabb-6e870d3af2cd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:33.241239 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 203/394] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Sep 27 04:52:33 2022] PUT /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4/groups/9451e4c016f04e2f8ad654470aed6f79/roles/20b1a2451e0a42628e0126aa881cac6b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:52:33.622580 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707e11c-713f-444b-bfe6-0671e516b2a7 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:33.622959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707e11c-713f-444b-bfe6-0671e516b2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:33.623150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707e11c-713f-444b-bfe6-0671e516b2a7 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:33.624923 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 192/395] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:33.630959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e7b1e-b645-4e65-958e-ab34230f9488 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:33.631448 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e7b1e-b645-4e65-958e-ab34230f9488 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:33.631522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e7b1e-b645-4e65-958e-ab34230f9488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:33.653186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-053e7b1e-b645-4e65-958e-ab34230f9488 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:33.654409 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-053e7b1e-b645-4e65-958e-ab34230f9488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:33.743113 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 204/396] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:33.769407 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707e11c-713f-444b-bfe6-0671e516b2a7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:33.893245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707e11c-713f-444b-bfe6-0671e516b2a7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:33.931962 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b0f6d-2934-49ea-90f7-ec901e6f8cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:33.933155 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b0f6d-2934-49ea-90f7-ec901e6f8cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:33.933646 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b0f6d-2934-49ea-90f7-ec901e6f8cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:33.934109 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b0f6d-2934-49ea-90f7-ec901e6f8cc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:33.950620 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b0f6d-2934-49ea-90f7-ec901e6f8cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:33.959097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-f17b0f6d-2934-49ea-90f7-ec901e6f8cc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:52:33.963586 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 193/397] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:52:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:33.966905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e7b1e-b645-4e65-958e-ab34230f9488 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:34.074482 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e7b1e-b645-4e65-958e-ab34230f9488 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:34.097011 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119c8ef-e8ee-490b-8201-c212d59c4e45 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:34.097311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119c8ef-e8ee-490b-8201-c212d59c4e45 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:34.097569 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119c8ef-e8ee-490b-8201-c212d59c4e45 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:34.099999 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 194/398] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:52:34.105617 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef85033-46c9-4c0d-bd39-84977515bd50 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:34.105902 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef85033-46c9-4c0d-bd39-84977515bd50 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:34.106182 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef85033-46c9-4c0d-bd39-84977515bd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:34.125260 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba225cfe-8b16-4e34-97d4-0c44f9aeffbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:34.126009 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba225cfe-8b16-4e34-97d4-0c44f9aeffbb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:34.126284 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba225cfe-8b16-4e34-97d4-0c44f9aeffbb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:34.126572 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba225cfe-8b16-4e34-97d4-0c44f9aeffbb None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:34.127314 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba225cfe-8b16-4e34-97d4-0c44f9aeffbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:34.127614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba225cfe-8b16-4e34-97d4-0c44f9aeffbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:34.129577 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba225cfe-8b16-4e34-97d4-0c44f9aeffbb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:34.137876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4ef85033-46c9-4c0d-bd39-84977515bd50 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:34.139066 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4ef85033-46c9-4c0d-bd39-84977515bd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:34.151265 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 205/399] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:34.158508 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba225cfe-8b16-4e34-97d4-0c44f9aeffbb None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:34.279444 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 195/400] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:34.317197 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3a57c-d78a-4e2d-8143-108a1d3433d5 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:34.317707 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3a57c-d78a-4e2d-8143-108a1d3433d5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:34.318099 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3a57c-d78a-4e2d-8143-108a1d3433d5 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:34.320779 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 196/401] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:34.321665 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3a57c-d78a-4e2d-8143-108a1d3433d5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:34.336950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba225cfe-8b16-4e34-97d4-0c44f9aeffbb None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:34.378202 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ad2f1-55d7-4c67-9c9e-94b434ea8846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:34.379670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ad2f1-55d7-4c67-9c9e-94b434ea8846 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:34.380039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ad2f1-55d7-4c67-9c9e-94b434ea8846 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:34.380478 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ad2f1-55d7-4c67-9c9e-94b434ea8846 None admin] PATH_INFO: `/v3/groups/9451e4c016f04e2f8ad654470aed6f79` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:34.382087 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ad2f1-55d7-4c67-9c9e-94b434ea8846 None admin] RBAC: Authorizing `identity:get_group(group_id=9451e4c016f04e2f8ad654470aed6f79)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:34.383978 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ad2f1-55d7-4c67-9c9e-94b434ea8846 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:34.388879 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 206/402] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 27 04:52:34 2022] GET /identity/v3/groups/9451e4c016f04e2f8ad654470aed6f79 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:34.390181 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a3cfc-1ec7-4672-97c9-06270c382a13 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:34.390653 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a3cfc-1ec7-4672-97c9-06270c382a13 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:34.390997 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a3cfc-1ec7-4672-97c9-06270c382a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:34.408581 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-228a3cfc-1ec7-4672-97c9-06270c382a13 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:34.409799 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-228a3cfc-1ec7-4672-97c9-06270c382a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:34.440342 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3a57c-d78a-4e2d-8143-108a1d3433d5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:34.475772 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97e807-8271-413e-b79d-2ae9fe3f19b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:34.476571 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e807-8271-413e-b79d-2ae9fe3f19b7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:34.476932 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e807-8271-413e-b79d-2ae9fe3f19b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:34.477211 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97e807-8271-413e-b79d-2ae9fe3f19b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:34.479533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 207/403] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:34.480489 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a3cfc-1ec7-4672-97c9-06270c382a13 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:34.500588 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97e807-8271-413e-b79d-2ae9fe3f19b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:34.516822 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-ed97e807-8271-413e-b79d-2ae9fe3f19b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:52:34.517080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 197/404] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:34.523655 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97e807-8271-413e-b79d-2ae9fe3f19b7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:34.583387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a3cfc-1ec7-4672-97c9-06270c382a13 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:34.616909 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45517cc-7a2d-4652-981a-ba8ab9a5988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:34.617773 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45517cc-7a2d-4652-981a-ba8ab9a5988e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:34.618052 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45517cc-7a2d-4652-981a-ba8ab9a5988e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:34.618330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45517cc-7a2d-4652-981a-ba8ab9a5988e None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:34.619624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45517cc-7a2d-4652-981a-ba8ab9a5988e None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:34.621413 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45517cc-7a2d-4652-981a-ba8ab9a5988e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:34.627996 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 208/405] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:34 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:34.629475 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45517cc-7a2d-4652-981a-ba8ab9a5988e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:34.647850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97e807-8271-413e-b79d-2ae9fe3f19b7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:34.694117 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267ce19-d457-49b2-871b-8c96e42917a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:34.694727 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267ce19-d457-49b2-871b-8c96e42917a2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:34.695016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267ce19-d457-49b2-871b-8c96e42917a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:34.695297 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267ce19-d457-49b2-871b-8c96e42917a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:34.696049 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267ce19-d457-49b2-871b-8c96e42917a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:34.696360 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267ce19-d457-49b2-871b-8c96e42917a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:34.697795 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267ce19-d457-49b2-871b-8c96e42917a2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:34.713178 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 198/406] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:34.713178 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267ce19-d457-49b2-871b-8c96e42917a2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:34.749550 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45517cc-7a2d-4652-981a-ba8ab9a5988e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:34.794109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefb7cb-ce72-4422-abc0-503ac1bb0b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:34.795437 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefb7cb-ce72-4422-abc0-503ac1bb0b73 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:34.796296 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefb7cb-ce72-4422-abc0-503ac1bb0b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:34.796776 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefb7cb-ce72-4422-abc0-503ac1bb0b73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:34.809976 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefb7cb-ce72-4422-abc0-503ac1bb0b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:34.813987 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267ce19-d457-49b2-871b-8c96e42917a2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:34.820191 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-bcefb7cb-ce72-4422-abc0-503ac1bb0b73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:52:34.822236 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 209/407] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:52:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:34.823242 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefb7cb-ce72-4422-abc0-503ac1bb0b73 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:34.853655 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24675dad-050f-45bc-b367-636b8f70b495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:34.854707 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24675dad-050f-45bc-b367-636b8f70b495 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:34.854986 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24675dad-050f-45bc-b367-636b8f70b495 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:34.855260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24675dad-050f-45bc-b367-636b8f70b495 None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980/groups/9451e4c016f04e2f8ad654470aed6f79/roles/20b1a2451e0a42628e0126aa881cac6b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:34.858045 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24675dad-050f-45bc-b367-636b8f70b495 None admin] RBAC: Authorizing `identity:create_grant(project_id=128e459def144365b3b01282148ec980, group_id=9451e4c016f04e2f8ad654470aed6f79, role_id=20b1a2451e0a42628e0126aa881cac6b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:34.859665 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24675dad-050f-45bc-b367-636b8f70b495 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:34.884846 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 199/408] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Sep 27 04:52:34 2022] PUT /identity/v3/projects/128e459def144365b3b01282148ec980/groups/9451e4c016f04e2f8ad654470aed6f79/roles/20b1a2451e0a42628e0126aa881cac6b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:52:34.884846 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24675dad-050f-45bc-b367-636b8f70b495 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:34.984128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefb7cb-ce72-4422-abc0-503ac1bb0b73 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:35.006003 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24675dad-050f-45bc-b367-636b8f70b495 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:35.045929 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0ed16-7544-4e30-a77b-d678a43ba9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:35.046633 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0ed16-7544-4e30-a77b-d678a43ba9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:35.046969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0ed16-7544-4e30-a77b-d678a43ba9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:35.047421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0ed16-7544-4e30-a77b-d678a43ba9e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:35.048185 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0ed16-7544-4e30-a77b-d678a43ba9e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:35.048492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0ed16-7544-4e30-a77b-d678a43ba9e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:35.049935 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0ed16-7544-4e30-a77b-d678a43ba9e7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:35.060459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 200/409] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:35.067114 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0ed16-7544-4e30-a77b-d678a43ba9e7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:35.082923 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d292f-5e24-45ee-8c1e-9d207c3d3314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:35.084241 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d292f-5e24-45ee-8c1e-9d207c3d3314 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:35.084757 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d292f-5e24-45ee-8c1e-9d207c3d3314 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:35.085296 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d292f-5e24-45ee-8c1e-9d207c3d3314 None admin] PATH_INFO: `/v3/groups/9451e4c016f04e2f8ad654470aed6f79` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:35.086888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d292f-5e24-45ee-8c1e-9d207c3d3314 None admin] RBAC: Authorizing `identity:get_group(group_id=9451e4c016f04e2f8ad654470aed6f79)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:35.088675 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d292f-5e24-45ee-8c1e-9d207c3d3314 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:35.095451 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 210/410] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 27 04:52:34 2022] GET /identity/v3/groups/9451e4c016f04e2f8ad654470aed6f79 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:35.096826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d292f-5e24-45ee-8c1e-9d207c3d3314 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:35.184036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0ed16-7544-4e30-a77b-d678a43ba9e7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:35.227861 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1647e-918d-445b-a3b0-d7d18063d156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:35.228913 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1647e-918d-445b-a3b0-d7d18063d156 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:35.229691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1647e-918d-445b-a3b0-d7d18063d156 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:35.229974 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1647e-918d-445b-a3b0-d7d18063d156 None admin] PATH_INFO: `/v3/groups/3dae919a677849f1a3f33a233cc51498` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:35.231377 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1647e-918d-445b-a3b0-d7d18063d156 None admin] RBAC: Authorizing `identity:get_group(group_id=3dae919a677849f1a3f33a233cc51498)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:35.233071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1647e-918d-445b-a3b0-d7d18063d156 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:35.236013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 201/411] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 27 04:52:35 2022] GET /identity/v3/groups/3dae919a677849f1a3f33a233cc51498 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:35.242853 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1647e-918d-445b-a3b0-d7d18063d156 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:35.268253 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d292f-5e24-45ee-8c1e-9d207c3d3314 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:35.307830 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7661c7-7b67-44b2-baba-ec7e97596d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:35.308695 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7661c7-7b67-44b2-baba-ec7e97596d13 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:35.309004 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7661c7-7b67-44b2-baba-ec7e97596d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:35.309276 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7661c7-7b67-44b2-baba-ec7e97596d13 None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:35.310483 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7661c7-7b67-44b2-baba-ec7e97596d13 None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:35.311990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7661c7-7b67-44b2-baba-ec7e97596d13 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:35.314114 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 211/412] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:35 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:35.319947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7661c7-7b67-44b2-baba-ec7e97596d13 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:35.368984 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1647e-918d-445b-a3b0-d7d18063d156 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:35.437242 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7661c7-7b67-44b2-baba-ec7e97596d13 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:35.450330 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d98e7-d587-4061-8b6e-bcf96e80dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:35.451281 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d98e7-d587-4061-8b6e-bcf96e80dd14 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:35.451483 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d98e7-d587-4061-8b6e-bcf96e80dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:35.451761 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d98e7-d587-4061-8b6e-bcf96e80dd14 None admin] PATH_INFO: `/v3/projects/c063435f154b48b086fd2d4eed2a41ea` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:35.457813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d98e7-d587-4061-8b6e-bcf96e80dd14 None admin] RBAC: Authorizing `identity:get_project(project_id=c063435f154b48b086fd2d4eed2a41ea)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:35.459073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d98e7-d587-4061-8b6e-bcf96e80dd14 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:35.461443 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 202/413] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:35 2022] GET /identity/v3/projects/c063435f154b48b086fd2d4eed2a41ea => generated 344 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:35.466735 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d98e7-d587-4061-8b6e-bcf96e80dd14 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:35.478035 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19830317-5e60-4e88-acef-e41f7dcf9a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:35.478949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19830317-5e60-4e88-acef-e41f7dcf9a97 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:35.479229 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19830317-5e60-4e88-acef-e41f7dcf9a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:35.479502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19830317-5e60-4e88-acef-e41f7dcf9a97 None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980/groups/9451e4c016f04e2f8ad654470aed6f79/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:35.482270 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19830317-5e60-4e88-acef-e41f7dcf9a97 None admin] RBAC: Authorizing `identity:create_grant(project_id=128e459def144365b3b01282148ec980, group_id=9451e4c016f04e2f8ad654470aed6f79, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:35.484070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19830317-5e60-4e88-acef-e41f7dcf9a97 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:35.502383 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 212/414] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Sep 27 04:52:35 2022] PUT /identity/v3/projects/128e459def144365b3b01282148ec980/groups/9451e4c016f04e2f8ad654470aed6f79/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:52:35.505463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a40810-919e-4cf1-8810-4e36c5940514 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:35.505977 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a40810-919e-4cf1-8810-4e36c5940514 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:35.506675 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a40810-919e-4cf1-8810-4e36c5940514 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:35.509908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 213/415] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:35.515905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2255f98-ad34-4563-8fdb-a2a766648613 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:35.516191 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2255f98-ad34-4563-8fdb-a2a766648613 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:35.516465 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2255f98-ad34-4563-8fdb-a2a766648613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:35.536544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a2255f98-ad34-4563-8fdb-a2a766648613 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:35.537915 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a2255f98-ad34-4563-8fdb-a2a766648613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:35.606746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d98e7-d587-4061-8b6e-bcf96e80dd14 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:35.623968 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 214/416] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:35.654374 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aeea2-4354-4de8-b1e8-2d4e57e006bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:35.655107 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2255f98-ad34-4563-8fdb-a2a766648613 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:35.655289 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aeea2-4354-4de8-b1e8-2d4e57e006bc None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:35.655545 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aeea2-4354-4de8-b1e8-2d4e57e006bc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:35.655819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aeea2-4354-4de8-b1e8-2d4e57e006bc None admin] PATH_INFO: `/v3/projects/c063435f154b48b086fd2d4eed2a41ea/groups/3dae919a677849f1a3f33a233cc51498/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:35.661956 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9aeea2-4354-4de8-b1e8-2d4e57e006bc None admin] RBAC: Authorizing `identity:create_grant(project_id=c063435f154b48b086fd2d4eed2a41ea, group_id=3dae919a677849f1a3f33a233cc51498, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:35.663335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9aeea2-4354-4de8-b1e8-2d4e57e006bc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:35.694585 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 203/417] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Sep 27 04:52:35 2022] PUT /identity/v3/projects/c063435f154b48b086fd2d4eed2a41ea/groups/3dae919a677849f1a3f33a233cc51498/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:52:35.770656 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2255f98-ad34-4563-8fdb-a2a766648613 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:35.812502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcb1a9-9efb-4dbd-aa0c-7e15ada9b421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:35.813710 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb1a9-9efb-4dbd-aa0c-7e15ada9b421 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:35.814217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb1a9-9efb-4dbd-aa0c-7e15ada9b421 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:35.814703 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebcb1a9-9efb-4dbd-aa0c-7e15ada9b421 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:35.827429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebcb1a9-9efb-4dbd-aa0c-7e15ada9b421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:35.835768 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-7ebcb1a9-9efb-4dbd-aa0c-7e15ada9b421 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:52:35.837743 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 215/418] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:35.844836 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aeea2-4354-4de8-b1e8-2d4e57e006bc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:35.979101 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aeea2-4354-4de8-b1e8-2d4e57e006bc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:36.021508 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f07701-29fc-49bf-8b8f-74e119e9e3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:36.022168 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f07701-29fc-49bf-8b8f-74e119e9e3ee None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:36.022451 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f07701-29fc-49bf-8b8f-74e119e9e3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:36.022737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f07701-29fc-49bf-8b8f-74e119e9e3ee None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:36.023482 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f07701-29fc-49bf-8b8f-74e119e9e3ee None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:36.023790 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f07701-29fc-49bf-8b8f-74e119e9e3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:36.025201 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f07701-29fc-49bf-8b8f-74e119e9e3ee None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:36.035638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 204/419] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:36.040908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcb1a9-9efb-4dbd-aa0c-7e15ada9b421 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:36.151833 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebcb1a9-9efb-4dbd-aa0c-7e15ada9b421 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:36.185596 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf6fe8-214d-4c87-a3a5-3914cb24b6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:36.186245 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6fe8-214d-4c87-a3a5-3914cb24b6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:36.186526 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6fe8-214d-4c87-a3a5-3914cb24b6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:36.186802 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6fe8-214d-4c87-a3a5-3914cb24b6e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:36.272348 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf6fe8-214d-4c87-a3a5-3914cb24b6e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:36.273769 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf6fe8-214d-4c87-a3a5-3914cb24b6e5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:36.292887 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4965c-200e-441b-8d32-cce463472e79 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:36.293177 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4965c-200e-441b-8d32-cce463472e79 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:36.293442 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4965c-200e-441b-8d32-cce463472e79 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:36.295407 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 205/420] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:52:36.306546 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afa539-c729-48a2-af52-52b33aa61fae None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:36.306839 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afa539-c729-48a2-af52-52b33aa61fae None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:36.307121 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afa539-c729-48a2-af52-52b33aa61fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:36.336628 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-23afa539-c729-48a2-af52-52b33aa61fae None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:36.337848 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-23afa539-c729-48a2-af52-52b33aa61fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:36.390078 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 216/421] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 04:52:36.396252 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf6fe8-214d-4c87-a3a5-3914cb24b6e5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:36.484862 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 206/422] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:36.524194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afa539-c729-48a2-af52-52b33aa61fae None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:36.549115 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf6fe8-214d-4c87-a3a5-3914cb24b6e5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:36.627159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000ed41-6d75-421e-b42e-bbaff63c8bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:36.628373 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000ed41-6d75-421e-b42e-bbaff63c8bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:36.628818 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000ed41-6d75-421e-b42e-bbaff63c8bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:36.629363 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000ed41-6d75-421e-b42e-bbaff63c8bf9 None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:36.632457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000ed41-6d75-421e-b42e-bbaff63c8bf9 None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:36.635324 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000ed41-6d75-421e-b42e-bbaff63c8bf9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:36.637966 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 217/423] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:36 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:36.644349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000ed41-6d75-421e-b42e-bbaff63c8bf9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:36.783342 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000ed41-6d75-421e-b42e-bbaff63c8bf9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:36.797813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afa539-c729-48a2-af52-52b33aa61fae None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:36.832344 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5341beb-5325-4dc4-99cb-b205492af7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:36.834136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5341beb-5325-4dc4-99cb-b205492af7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:36.834768 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5341beb-5325-4dc4-99cb-b205492af7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:36.835425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5341beb-5325-4dc4-99cb-b205492af7c5 None admin] PATH_INFO: `/v3/groups/9451e4c016f04e2f8ad654470aed6f79` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:36.837359 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5341beb-5325-4dc4-99cb-b205492af7c5 None admin] RBAC: Authorizing `identity:get_group(group_id=9451e4c016f04e2f8ad654470aed6f79)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:36.838960 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5341beb-5325-4dc4-99cb-b205492af7c5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:36.841167 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 218/424] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 27 04:52:36 2022] GET /identity/v3/groups/9451e4c016f04e2f8ad654470aed6f79 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:36.846973 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5341beb-5325-4dc4-99cb-b205492af7c5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:36.946489 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad938587-0dc0-489a-93fc-e044ffc21837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:36.947521 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad938587-0dc0-489a-93fc-e044ffc21837 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:36.947628 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad938587-0dc0-489a-93fc-e044ffc21837 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:36.947868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad938587-0dc0-489a-93fc-e044ffc21837 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:36.960403 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad938587-0dc0-489a-93fc-e044ffc21837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:36.969738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-ad938587-0dc0-489a-93fc-e044ffc21837 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:52:36.975244 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 207/425] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:52:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 449 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:36.979192 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad938587-0dc0-489a-93fc-e044ffc21837 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:36.991765 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5341beb-5325-4dc4-99cb-b205492af7c5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:37.107093 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bc96b-ed2b-4971-8afa-a2699a366f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:37.108134 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bc96b-ed2b-4971-8afa-a2699a366f6a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:37.108615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bc96b-ed2b-4971-8afa-a2699a366f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:37.109099 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922bc96b-ed2b-4971-8afa-a2699a366f6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:37.110523 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bc96b-ed2b-4971-8afa-a2699a366f6a None admin] RBAC: Adding query filter params (group.id=9451e4c016f04e2f8ad654470aed6f79, role.id=76a348ab64cc49e0b464e3578474c8d6, scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:37.112890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bc96b-ed2b-4971-8afa-a2699a366f6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:37.116457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922bc96b-ed2b-4971-8afa-a2699a366f6a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:37.137719 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 219/426] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 27 04:52:36 2022] GET /identity/v3/role_assignments?group.id=9451e4c016f04e2f8ad654470aed6f79&scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4&role.id=76a348ab64cc49e0b464e3578474c8d6 => generated 611 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:37.255659 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad938587-0dc0-489a-93fc-e044ffc21837 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:37.343343 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bff520-7e7c-4002-95f6-0b048bf25efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:37.344028 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff520-7e7c-4002-95f6-0b048bf25efd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:37.344304 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff520-7e7c-4002-95f6-0b048bf25efd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:37.344571 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bff520-7e7c-4002-95f6-0b048bf25efd None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:37.345370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bff520-7e7c-4002-95f6-0b048bf25efd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:37.345672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bff520-7e7c-4002-95f6-0b048bf25efd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:37.347047 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bff520-7e7c-4002-95f6-0b048bf25efd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:37.365440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 208/427] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:37.371789 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bc96b-ed2b-4971-8afa-a2699a366f6a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:37.506622 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922bc96b-ed2b-4971-8afa-a2699a366f6a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:37.549003 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011f1d7-6bda-4ea1-a1b1-b8aa5172040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:37.550039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011f1d7-6bda-4ea1-a1b1-b8aa5172040c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:37.550512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011f1d7-6bda-4ea1-a1b1-b8aa5172040c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:37.551006 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011f1d7-6bda-4ea1-a1b1-b8aa5172040c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:37.625722 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011f1d7-6bda-4ea1-a1b1-b8aa5172040c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:37.627550 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011f1d7-6bda-4ea1-a1b1-b8aa5172040c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:37.731513 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 220/428] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:37.737403 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bff520-7e7c-4002-95f6-0b048bf25efd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:37.859176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bff520-7e7c-4002-95f6-0b048bf25efd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:37.898693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b38f3-2592-4760-9d32-e25069bba8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:37.899484 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b38f3-2592-4760-9d32-e25069bba8bd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:37.899764 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b38f3-2592-4760-9d32-e25069bba8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:37.900038 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b38f3-2592-4760-9d32-e25069bba8bd None admin] PATH_INFO: `/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:37.901325 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b38f3-2592-4760-9d32-e25069bba8bd None admin] RBAC: Authorizing `identity:get_project(project_id=319894bc10cb4c39a6b3bbce2f9a8cb4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:37.902759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b38f3-2592-4760-9d32-e25069bba8bd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:37.905900 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 209/429] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:37 2022] GET /identity/v3/projects/319894bc10cb4c39a6b3bbce2f9a8cb4 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:37.912212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011f1d7-6bda-4ea1-a1b1-b8aa5172040c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:38.019450 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011f1d7-6bda-4ea1-a1b1-b8aa5172040c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:38.024757 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e855f5-d00b-4d40-b783-b892980b97c8 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:38.025249 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e855f5-d00b-4d40-b783-b892980b97c8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:38.025354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e855f5-d00b-4d40-b783-b892980b97c8 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:38.027226 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 210/430] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:38.032535 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac35541-46bd-45cf-bec3-ba78a29301a5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:38.032854 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac35541-46bd-45cf-bec3-ba78a29301a5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:38.033138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac35541-46bd-45cf-bec3-ba78a29301a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:38.058353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-cac35541-46bd-45cf-bec3-ba78a29301a5 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:38.059730 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cac35541-46bd-45cf-bec3-ba78a29301a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:38.074218 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6918a-3249-4ef3-8d4c-7eb1e76fae73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:38.075414 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6918a-3249-4ef3-8d4c-7eb1e76fae73 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:38.075892 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6918a-3249-4ef3-8d4c-7eb1e76fae73 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:38.076391 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6918a-3249-4ef3-8d4c-7eb1e76fae73 None admin] PATH_INFO: `/v3/groups/9451e4c016f04e2f8ad654470aed6f79` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:38.077853 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6918a-3249-4ef3-8d4c-7eb1e76fae73 None admin] RBAC: Authorizing `identity:get_group(group_id=9451e4c016f04e2f8ad654470aed6f79)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:38.079512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6918a-3249-4ef3-8d4c-7eb1e76fae73 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:38.081686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 221/431] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 27 04:52:37 2022] GET /identity/v3/groups/9451e4c016f04e2f8ad654470aed6f79 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:38.089803 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6918a-3249-4ef3-8d4c-7eb1e76fae73 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:38.147160 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 211/432] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:38.172427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac35541-46bd-45cf-bec3-ba78a29301a5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:38.210219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6918a-3249-4ef3-8d4c-7eb1e76fae73 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:38.252602 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8983e75-52b9-4fda-aa03-9df30bbf14aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:38.253289 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8983e75-52b9-4fda-aa03-9df30bbf14aa None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:38.253565 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8983e75-52b9-4fda-aa03-9df30bbf14aa None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:38.253837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8983e75-52b9-4fda-aa03-9df30bbf14aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:38.255061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8983e75-52b9-4fda-aa03-9df30bbf14aa None admin] RBAC: Adding query filter params (group.id=9451e4c016f04e2f8ad654470aed6f79, role.id=20b1a2451e0a42628e0126aa881cac6b, scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:38.255454 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8983e75-52b9-4fda-aa03-9df30bbf14aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:38.257839 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8983e75-52b9-4fda-aa03-9df30bbf14aa None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:38.265472 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 222/433] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 27 04:52:38 2022] GET /identity/v3/role_assignments?group.id=9451e4c016f04e2f8ad654470aed6f79&scope.project.id=319894bc10cb4c39a6b3bbce2f9a8cb4&role.id=20b1a2451e0a42628e0126aa881cac6b => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:38.325949 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac35541-46bd-45cf-bec3-ba78a29301a5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:38.373267 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb6044-107d-40bb-99d4-197d0acdc99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:38.374112 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb6044-107d-40bb-99d4-197d0acdc99f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:38.374400 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb6044-107d-40bb-99d4-197d0acdc99f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:38.374674 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb6044-107d-40bb-99d4-197d0acdc99f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:38.388768 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb6044-107d-40bb-99d4-197d0acdc99f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:38.397707 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-87cb6044-107d-40bb-99d4-197d0acdc99f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:52:38.399344 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 212/434] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:52:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:38.410792 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8983e75-52b9-4fda-aa03-9df30bbf14aa None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:38.526042 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8983e75-52b9-4fda-aa03-9df30bbf14aa None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:38.560629 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e49de-240e-433e-82d5-27894f2d9983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:38.561324 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e49de-240e-433e-82d5-27894f2d9983 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:38.561600 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e49de-240e-433e-82d5-27894f2d9983 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:38.561872 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e49de-240e-433e-82d5-27894f2d9983 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:38.562679 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e49de-240e-433e-82d5-27894f2d9983 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:38.562990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e49de-240e-433e-82d5-27894f2d9983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:38.564371 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e49de-240e-433e-82d5-27894f2d9983 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:38.577643 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 223/435] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:38.579614 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb6044-107d-40bb-99d4-197d0acdc99f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:38.630829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96024e4b-2d7f-4b5d-89f8-30689d5271ff None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:38.631118 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96024e4b-2d7f-4b5d-89f8-30689d5271ff None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:38.631396 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96024e4b-2d7f-4b5d-89f8-30689d5271ff None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:38.633206 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 224/436] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:38.634972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ae00a-be12-459e-bf2b-136386e36d1d None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:38.635251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ae00a-be12-459e-bf2b-136386e36d1d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:38.635525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ae00a-be12-459e-bf2b-136386e36d1d None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:38.639021 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 225/437] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:38.640116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb05e3-977a-4cad-9c69-3fb8ffd4d561 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:38.640423 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb05e3-977a-4cad-9c69-3fb8ffd4d561 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:38.640701 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb05e3-977a-4cad-9c69-3fb8ffd4d561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:38.660826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-63eb05e3-977a-4cad-9c69-3fb8ffd4d561 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:38.662168 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-63eb05e3-977a-4cad-9c69-3fb8ffd4d561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:38.689809 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb6044-107d-40bb-99d4-197d0acdc99f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:38.729370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a681a69-3f60-49f2-9349-6534c10c3284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:38.730020 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a681a69-3f60-49f2-9349-6534c10c3284 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:38.730293 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a681a69-3f60-49f2-9349-6534c10c3284 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:38.730561 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a681a69-3f60-49f2-9349-6534c10c3284 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:38.733084 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 226/438] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:38.734359 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1e185-ad3a-400c-b6b8-bb3004a05d7f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:38.734647 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1e185-ad3a-400c-b6b8-bb3004a05d7f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:38.734928 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1e185-ad3a-400c-b6b8-bb3004a05d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:38.752402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3ed1e185-ad3a-400c-b6b8-bb3004a05d7f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:38.753614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3ed1e185-ad3a-400c-b6b8-bb3004a05d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:38.796746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a681a69-3f60-49f2-9349-6534c10c3284 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:38.798159 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a681a69-3f60-49f2-9349-6534c10c3284 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:38.815636 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 227/439] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:38.816495 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1e185-ad3a-400c-b6b8-bb3004a05d7f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:38.896818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 213/440] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:38.896818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a681a69-3f60-49f2-9349-6534c10c3284 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:38.909066 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1e185-ad3a-400c-b6b8-bb3004a05d7f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:38.942612 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7170837-9c66-42eb-bf4a-ee70933aff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:38.943387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7170837-9c66-42eb-bf4a-ee70933aff40 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:38.943660 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7170837-9c66-42eb-bf4a-ee70933aff40 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:38.943925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7170837-9c66-42eb-bf4a-ee70933aff40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:38.953435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7170837-9c66-42eb-bf4a-ee70933aff40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:38.960472 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-b7170837-9c66-42eb-bf4a-ee70933aff40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 27 04:52:38.961911 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 228/441] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:38.962608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7170837-9c66-42eb-bf4a-ee70933aff40 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:38.984495 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a681a69-3f60-49f2-9349-6534c10c3284 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:39.017721 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1e067-d179-4a48-bd48-8e52c93843f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:39.018505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1e067-d179-4a48-bd48-8e52c93843f7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:39.018784 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1e067-d179-4a48-bd48-8e52c93843f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:39.019048 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1e067-d179-4a48-bd48-8e52c93843f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:39.028742 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1e067-d179-4a48-bd48-8e52c93843f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:39.036193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-6fa1e067-d179-4a48-bd48-8e52c93843f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:52:39.037552 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 214/442] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:52:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:39.038135 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1e067-d179-4a48-bd48-8e52c93843f7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:39.058736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7170837-9c66-42eb-bf4a-ee70933aff40 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:39.090274 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedbc12-beb6-44ef-a4a3-cacd779ff7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:39.091120 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedbc12-beb6-44ef-a4a3-cacd779ff7fc None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:39.091398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedbc12-beb6-44ef-a4a3-cacd779ff7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:39.091677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedbc12-beb6-44ef-a4a3-cacd779ff7fc None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:39.092873 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aedbc12-beb6-44ef-a4a3-cacd779ff7fc None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:39.094327 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aedbc12-beb6-44ef-a4a3-cacd779ff7fc None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:39.095988 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 229/443] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:38 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:39.096729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedbc12-beb6-44ef-a4a3-cacd779ff7fc None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:39.132490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1e067-d179-4a48-bd48-8e52c93843f7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:39.172580 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e4b49-94b9-49a7-9f07-61aabfc9a456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:39.173601 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e4b49-94b9-49a7-9f07-61aabfc9a456 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:39.174046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e4b49-94b9-49a7-9f07-61aabfc9a456 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:39.174494 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e4b49-94b9-49a7-9f07-61aabfc9a456 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:39.175789 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e4b49-94b9-49a7-9f07-61aabfc9a456 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:39.176291 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e4b49-94b9-49a7-9f07-61aabfc9a456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:39.178292 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e4b49-94b9-49a7-9f07-61aabfc9a456 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:39.189165 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 215/444] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:52:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:39.190043 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e4b49-94b9-49a7-9f07-61aabfc9a456 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:39.212368 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedbc12-beb6-44ef-a4a3-cacd779ff7fc None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:39.243923 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00059e2-a48d-4e7c-90f3-8dd84fd71c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:39.244580 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00059e2-a48d-4e7c-90f3-8dd84fd71c19 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:39.244886 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00059e2-a48d-4e7c-90f3-8dd84fd71c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:39.245160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00059e2-a48d-4e7c-90f3-8dd84fd71c19 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:39.246153 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00059e2-a48d-4e7c-90f3-8dd84fd71c19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:39.246480 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00059e2-a48d-4e7c-90f3-8dd84fd71c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:39.247804 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00059e2-a48d-4e7c-90f3-8dd84fd71c19 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:39.256269 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 230/445] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:39.257063 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00059e2-a48d-4e7c-90f3-8dd84fd71c19 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:39.287713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e4b49-94b9-49a7-9f07-61aabfc9a456 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:39.319294 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5c3d4-024c-4ef9-a808-375d4b2e5a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:39.320079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5c3d4-024c-4ef9-a808-375d4b2e5a3d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:39.320358 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5c3d4-024c-4ef9-a808-375d4b2e5a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:39.320631 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5c3d4-024c-4ef9-a808-375d4b2e5a3d None admin] PATH_INFO: `/v3/groups/9451e4c016f04e2f8ad654470aed6f79` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:39.321831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5c3d4-024c-4ef9-a808-375d4b2e5a3d None admin] RBAC: Authorizing `identity:get_group(group_id=9451e4c016f04e2f8ad654470aed6f79)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:39.323262 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5c3d4-024c-4ef9-a808-375d4b2e5a3d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:39.325051 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 216/446] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 27 04:52:39 2022] GET /identity/v3/groups/9451e4c016f04e2f8ad654470aed6f79 => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:39.325625 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5c3d4-024c-4ef9-a808-375d4b2e5a3d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:39.352702 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00059e2-a48d-4e7c-90f3-8dd84fd71c19 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:39.384336 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ae9b0-7640-428e-9676-f5cce4ce54ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:39.385000 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ae9b0-7640-428e-9676-f5cce4ce54ad None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:39.385281 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ae9b0-7640-428e-9676-f5cce4ce54ad None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:39.385556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ae9b0-7640-428e-9676-f5cce4ce54ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:39.418611 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5c3d4-024c-4ef9-a808-375d4b2e5a3d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:39.448715 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ae9b0-7640-428e-9676-f5cce4ce54ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:39.450199 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ae9b0-7640-428e-9676-f5cce4ce54ad None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:39.450475 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7e855-03bb-47ac-9314-490e15ee229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:39.451112 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7e855-03bb-47ac-9314-490e15ee229d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:39.451411 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7e855-03bb-47ac-9314-490e15ee229d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:39.451666 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7e855-03bb-47ac-9314-490e15ee229d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:39.514712 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7e855-03bb-47ac-9314-490e15ee229d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:39.516149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7e855-03bb-47ac-9314-490e15ee229d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:39.541908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 231/447] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:39.542727 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ae9b0-7640-428e-9676-f5cce4ce54ad None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:39.607733 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 217/448] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:39.608478 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7e855-03bb-47ac-9314-490e15ee229d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:39.635896 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ae9b0-7640-428e-9676-f5cce4ce54ad None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:39.668020 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dd04a-ded9-4c82-bc60-fdb7df3e58ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:39.668659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd04a-ded9-4c82-bc60-fdb7df3e58ad None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:39.668967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd04a-ded9-4c82-bc60-fdb7df3e58ad None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:39.669240 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd04a-ded9-4c82-bc60-fdb7df3e58ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:39.670057 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dd04a-ded9-4c82-bc60-fdb7df3e58ad None admin] RBAC: Adding query filter params (group.id=9451e4c016f04e2f8ad654470aed6f79, role.id=20b1a2451e0a42628e0126aa881cac6b, scope.project.id=128e459def144365b3b01282148ec980) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:39.670356 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dd04a-ded9-4c82-bc60-fdb7df3e58ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:39.671775 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dd04a-ded9-4c82-bc60-fdb7df3e58ad None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:39.678590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 232/449] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 27 04:52:39 2022] GET /identity/v3/role_assignments?group.id=9451e4c016f04e2f8ad654470aed6f79&scope.project.id=128e459def144365b3b01282148ec980&role.id=20b1a2451e0a42628e0126aa881cac6b => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:39.678786 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dd04a-ded9-4c82-bc60-fdb7df3e58ad None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:39.722455 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7e855-03bb-47ac-9314-490e15ee229d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:39.760145 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a245e-1eca-4980-b1b9-3a4190f7ed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:39.761046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a245e-1eca-4980-b1b9-3a4190f7ed51 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:39.761327 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a245e-1eca-4980-b1b9-3a4190f7ed51 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:39.761757 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a245e-1eca-4980-b1b9-3a4190f7ed51 None admin] PATH_INFO: `/v3/projects/128e459def144365b3b01282148ec980` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:39.763586 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a245e-1eca-4980-b1b9-3a4190f7ed51 None admin] RBAC: Authorizing `identity:get_project(project_id=128e459def144365b3b01282148ec980)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:39.765384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a245e-1eca-4980-b1b9-3a4190f7ed51 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:39.767347 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 218/450] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:39 2022] GET /identity/v3/projects/128e459def144365b3b01282148ec980 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:39.773961 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a245e-1eca-4980-b1b9-3a4190f7ed51 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:39.797890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dd04a-ded9-4c82-bc60-fdb7df3e58ad None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:39.832784 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50154d80-fa4b-4d52-bd67-74dc49a609e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:39.833874 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50154d80-fa4b-4d52-bd67-74dc49a609e4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:39.834157 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50154d80-fa4b-4d52-bd67-74dc49a609e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:39.834431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50154d80-fa4b-4d52-bd67-74dc49a609e4 None admin] PATH_INFO: `/v3/projects/c063435f154b48b086fd2d4eed2a41ea` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:39.835723 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50154d80-fa4b-4d52-bd67-74dc49a609e4 None admin] RBAC: Authorizing `identity:get_project(project_id=c063435f154b48b086fd2d4eed2a41ea)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:39.837240 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50154d80-fa4b-4d52-bd67-74dc49a609e4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:39.839192 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 233/451] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:52:39 2022] GET /identity/v3/projects/c063435f154b48b086fd2d4eed2a41ea => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:39.844607 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50154d80-fa4b-4d52-bd67-74dc49a609e4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:39.882480 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a245e-1eca-4980-b1b9-3a4190f7ed51 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:39.920588 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e8274-6c97-4b5b-a4fc-b1a5a2494d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:39.921473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8274-6c97-4b5b-a4fc-b1a5a2494d63 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:39.921746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8274-6c97-4b5b-a4fc-b1a5a2494d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:39.922037 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8274-6c97-4b5b-a4fc-b1a5a2494d63 None admin] PATH_INFO: `/v3/groups/9451e4c016f04e2f8ad654470aed6f79` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:39.923203 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e8274-6c97-4b5b-a4fc-b1a5a2494d63 None admin] RBAC: Authorizing `identity:get_group(group_id=9451e4c016f04e2f8ad654470aed6f79)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:39.924637 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e8274-6c97-4b5b-a4fc-b1a5a2494d63 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:39.929102 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 219/452] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 27 04:52:39 2022] GET /identity/v3/groups/9451e4c016f04e2f8ad654470aed6f79 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:39.932506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e8274-6c97-4b5b-a4fc-b1a5a2494d63 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:39.949051 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50154d80-fa4b-4d52-bd67-74dc49a609e4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:39.982589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0ea7e-4c56-4a44-a060-68da7c18e823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:39.983444 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0ea7e-4c56-4a44-a060-68da7c18e823 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:39.983720 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0ea7e-4c56-4a44-a060-68da7c18e823 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:39.983988 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0ea7e-4c56-4a44-a060-68da7c18e823 None admin] PATH_INFO: `/v3/groups/3dae919a677849f1a3f33a233cc51498` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:39.985187 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0ea7e-4c56-4a44-a060-68da7c18e823 None admin] RBAC: Authorizing `identity:get_group(group_id=3dae919a677849f1a3f33a233cc51498)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:39.986636 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0ea7e-4c56-4a44-a060-68da7c18e823 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:39.989929 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 234/453] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Sep 27 04:52:39 2022] GET /identity/v3/groups/3dae919a677849f1a3f33a233cc51498 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:39.994250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0ea7e-4c56-4a44-a060-68da7c18e823 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:40.032405 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e8274-6c97-4b5b-a4fc-b1a5a2494d63 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:40.064140 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef51dd-56c0-4530-b8e3-ffc9413e3888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:40.064801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef51dd-56c0-4530-b8e3-ffc9413e3888 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:40.065093 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef51dd-56c0-4530-b8e3-ffc9413e3888 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:40.065443 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef51dd-56c0-4530-b8e3-ffc9413e3888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:40.066282 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef51dd-56c0-4530-b8e3-ffc9413e3888 None admin] RBAC: Adding query filter params (group.id=9451e4c016f04e2f8ad654470aed6f79, role.id=76a348ab64cc49e0b464e3578474c8d6, scope.project.id=128e459def144365b3b01282148ec980) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:40.067141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef51dd-56c0-4530-b8e3-ffc9413e3888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:40.068567 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef51dd-56c0-4530-b8e3-ffc9413e3888 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:40.074285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 220/454] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 27 04:52:39 2022] GET /identity/v3/role_assignments?group.id=9451e4c016f04e2f8ad654470aed6f79&scope.project.id=128e459def144365b3b01282148ec980&role.id=76a348ab64cc49e0b464e3578474c8d6 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:40.089141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0ea7e-4c56-4a44-a060-68da7c18e823 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:40.124482 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebb218-e052-4564-8167-3613dfef3a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:40.125174 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebb218-e052-4564-8167-3613dfef3a99 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:40.125453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebb218-e052-4564-8167-3613dfef3a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:40.125725 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebb218-e052-4564-8167-3613dfef3a99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:40.126568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebb218-e052-4564-8167-3613dfef3a99 None admin] RBAC: Adding query filter params (group.id=3dae919a677849f1a3f33a233cc51498, role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=c063435f154b48b086fd2d4eed2a41ea) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:40.126880 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebb218-e052-4564-8167-3613dfef3a99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:40.128376 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebb218-e052-4564-8167-3613dfef3a99 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:40.135995 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 235/455] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Sep 27 04:52:39 2022] GET /identity/v3/role_assignments?group.id=3dae919a677849f1a3f33a233cc51498&scope.project.id=c063435f154b48b086fd2d4eed2a41ea&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:43.131954 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24db0-6b4c-4945-a820-650b61a0e179 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:43.132486 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24db0-6b4c-4945-a820-650b61a0e179 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:43.132762 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca24db0-6b4c-4945-a820-650b61a0e179 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:43.135143 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 221/456] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:43.150745 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c798a9-3490-412a-a489-7e8c2d6bc3b0 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:43.151661 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c798a9-3490-412a-a489-7e8c2d6bc3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:43.152124 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c798a9-3490-412a-a489-7e8c2d6bc3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:43.177818 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-39c798a9-3490-412a-a489-7e8c2d6bc3b0 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:43.179336 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-39c798a9-3490-412a-a489-7e8c2d6bc3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:43.258033 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 236/457] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:43.293782 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca24db0-6b4c-4945-a820-650b61a0e179 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:43.419726 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac52ac3-2bba-4b51-9a6f-f0cff8000c4e None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:43.420364 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac52ac3-2bba-4b51-9a6f-f0cff8000c4e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:43.420875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac52ac3-2bba-4b51-9a6f-f0cff8000c4e None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:43.423237 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 237/458] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:43.427558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca24db0-6b4c-4945-a820-650b61a0e179 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:43.429404 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866f036-da80-4533-922b-3828a2cf50b3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:43.429902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866f036-da80-4533-922b-3828a2cf50b3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:43.430388 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866f036-da80-4533-922b-3828a2cf50b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:43.453609 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7866f036-da80-4533-922b-3828a2cf50b3 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:43.455337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7866f036-da80-4533-922b-3828a2cf50b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:43.488373 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9eb50d-550b-4eed-b760-c4e0ae72c19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:43.489536 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eb50d-550b-4eed-b760-c4e0ae72c19f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:43.490008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eb50d-550b-4eed-b760-c4e0ae72c19f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:43.490497 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9eb50d-550b-4eed-b760-c4e0ae72c19f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:43.502811 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9eb50d-550b-4eed-b760-c4e0ae72c19f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:43.505707 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9eb50d-550b-4eed-b760-c4e0ae72c19f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:43.529191 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-cd9eb50d-550b-4eed-b760-c4e0ae72c19f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:43.538720 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 222/459] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:43.541905 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9eb50d-550b-4eed-b760-c4e0ae72c19f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:43.580925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 238/460] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:43.624847 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866f036-da80-4533-922b-3828a2cf50b3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:43.703531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9eb50d-550b-4eed-b760-c4e0ae72c19f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:43.758745 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866f036-da80-4533-922b-3828a2cf50b3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:43.793683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ec625-d51f-4ef9-93d7-e38873cdaf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:43.794293 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ec625-d51f-4ef9-93d7-e38873cdaf74 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:43.794576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ec625-d51f-4ef9-93d7-e38873cdaf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:43.794841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ec625-d51f-4ef9-93d7-e38873cdaf74 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:43.795564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ec625-d51f-4ef9-93d7-e38873cdaf74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:43.795831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f58e3-6109-4b92-a733-183636c93048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:43.795943 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ec625-d51f-4ef9-93d7-e38873cdaf74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:43.796996 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f58e3-6109-4b92-a733-183636c93048 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:43.797264 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ec625-d51f-4ef9-93d7-e38873cdaf74 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:43.797658 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f58e3-6109-4b92-a733-183636c93048 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:43.798128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f58e3-6109-4b92-a733-183636c93048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:43.808716 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f58e3-6109-4b92-a733-183636c93048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:43.810477 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f58e3-6109-4b92-a733-183636c93048 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:43.819530 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 223/461] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:43.824481 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ec625-d51f-4ef9-93d7-e38873cdaf74 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:43.829858 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-fc1f58e3-6109-4b92-a733-183636c93048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:43.831541 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 239/462] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:43.837129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f58e3-6109-4b92-a733-183636c93048 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:43.936889 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ec625-d51f-4ef9-93d7-e38873cdaf74 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:43.949966 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f58e3-6109-4b92-a733-183636c93048 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:43.971256 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabc494-b6e5-4280-9eab-3e0edc85cf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:43.977129 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabc494-b6e5-4280-9eab-3e0edc85cf72 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:43.977602 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabc494-b6e5-4280-9eab-3e0edc85cf72 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:43.978024 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabc494-b6e5-4280-9eab-3e0edc85cf72 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:43.978893 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabc494-b6e5-4280-9eab-3e0edc85cf72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:43.980498 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabc494-b6e5-4280-9eab-3e0edc85cf72 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:43.985391 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2968eb-7564-4270-b392-16b010c2a910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:43.986057 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2968eb-7564-4270-b392-16b010c2a910 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:43.986340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2968eb-7564-4270-b392-16b010c2a910 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:43.986613 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2968eb-7564-4270-b392-16b010c2a910 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:43.987335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2968eb-7564-4270-b392-16b010c2a910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:43.987638 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2968eb-7564-4270-b392-16b010c2a910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:43.991153 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2968eb-7564-4270-b392-16b010c2a910 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:44.017080 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 240/464] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:44.017080 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced23abc-0beb-475c-b546-11cc57296f15 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:44.017080 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced23abc-0beb-475c-b546-11cc57296f15 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:44.017080 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced23abc-0beb-475c-b546-11cc57296f15 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:44.017510 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 241/465] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:44.017649 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 224/465] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:52:43 2022] POST /identity/v3/users => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:52:44.018149 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced23abc-0beb-475c-b546-11cc57296f15 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:44.025306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac5c0f-5bbe-4d00-bf54-38365831fe62 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:44.025869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac5c0f-5bbe-4d00-bf54-38365831fe62 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:44.026290 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac5c0f-5bbe-4d00-bf54-38365831fe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:44.060413 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-cdac5c0f-5bbe-4d00-bf54-38365831fe62 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:44.062025 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cdac5c0f-5bbe-4d00-bf54-38365831fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:44.134614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced23abc-0beb-475c-b546-11cc57296f15 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:44.147094 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 225/466] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 27 04:52:44.148567 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d96c4a-cba9-471a-b438-c950123a9dc2 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:44.148906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d96c4a-cba9-471a-b438-c950123a9dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:44.149187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d96c4a-cba9-471a-b438-c950123a9dc2 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:44.155306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 226/467] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:44.157273 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2333f4b-2e5e-4486-8242-6ac14a8cda43 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:44.157565 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2333f4b-2e5e-4486-8242-6ac14a8cda43 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:44.157840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2333f4b-2e5e-4486-8242-6ac14a8cda43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:44.182621 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f2333f4b-2e5e-4486-8242-6ac14a8cda43 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:44.183969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f2333f4b-2e5e-4486-8242-6ac14a8cda43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:44.199361 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b69c28-4c2a-419f-86f8-34662f206bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:44.200112 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b69c28-4c2a-419f-86f8-34662f206bc4 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:44.200400 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b69c28-4c2a-419f-86f8-34662f206bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:44.200678 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b69c28-4c2a-419f-86f8-34662f206bc4 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:44.201485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b69c28-4c2a-419f-86f8-34662f206bc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:44.202997 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b69c28-4c2a-419f-86f8-34662f206bc4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:44.236919 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 242/468] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:52:44 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:52:44.240595 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b69c28-4c2a-419f-86f8-34662f206bc4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:44.293154 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 227/469] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:44.321659 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2333f4b-2e5e-4486-8242-6ac14a8cda43 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:44.378275 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b69c28-4c2a-419f-86f8-34662f206bc4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:44.416528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83994962-7c78-4493-9257-d5b545b92a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:44.417368 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83994962-7c78-4493-9257-d5b545b92a0e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:44.417722 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83994962-7c78-4493-9257-d5b545b92a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:44.417996 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83994962-7c78-4493-9257-d5b545b92a0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:44.429890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83994962-7c78-4493-9257-d5b545b92a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:44.431447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83994962-7c78-4493-9257-d5b545b92a0e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:44.437664 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2333f4b-2e5e-4486-8242-6ac14a8cda43 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:44.451037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-83994962-7c78-4493-9257-d5b545b92a0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:44.452247 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 243/470] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:44.459670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83994962-7c78-4493-9257-d5b545b92a0e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:44.481900 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686909d-5274-4005-a41a-c86daf6da88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:44.482941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686909d-5274-4005-a41a-c86daf6da88c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:44.483430 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686909d-5274-4005-a41a-c86daf6da88c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:44.484389 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686909d-5274-4005-a41a-c86daf6da88c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:44.499592 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686909d-5274-4005-a41a-c86daf6da88c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:44.501451 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686909d-5274-4005-a41a-c86daf6da88c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:44.521788 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-e686909d-5274-4005-a41a-c86daf6da88c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:44.523364 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 228/471] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:44.529748 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686909d-5274-4005-a41a-c86daf6da88c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:44.591340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83994962-7c78-4493-9257-d5b545b92a0e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:44.627136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b06a7-b949-44b8-a8dd-3a17d816311d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:44.627806 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b06a7-b949-44b8-a8dd-3a17d816311d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:44.628087 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b06a7-b949-44b8-a8dd-3a17d816311d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:44.628366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b06a7-b949-44b8-a8dd-3a17d816311d None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:44.629199 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b06a7-b949-44b8-a8dd-3a17d816311d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:44.629510 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b06a7-b949-44b8-a8dd-3a17d816311d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:44.630904 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b06a7-b949-44b8-a8dd-3a17d816311d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:44.642324 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686909d-5274-4005-a41a-c86daf6da88c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:44.643887 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 244/472] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:44.649574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496d6a4-5caf-4454-a406-6a222a4c8e2b None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:44.649864 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496d6a4-5caf-4454-a406-6a222a4c8e2b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:44.650147 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496d6a4-5caf-4454-a406-6a222a4c8e2b None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:44.652203 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 245/473] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:44.653718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496d6a4-5caf-4454-a406-6a222a4c8e2b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:44.681814 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c265fc-aae6-4e78-9fbc-b9185186b8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:44.682473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c265fc-aae6-4e78-9fbc-b9185186b8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:44.682748 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c265fc-aae6-4e78-9fbc-b9185186b8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:44.683017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c265fc-aae6-4e78-9fbc-b9185186b8e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:44.683732 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c265fc-aae6-4e78-9fbc-b9185186b8e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:44.684031 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c265fc-aae6-4e78-9fbc-b9185186b8e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:44.685417 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c265fc-aae6-4e78-9fbc-b9185186b8e2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:44.697784 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 229/474] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:44.699134 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341dcb-37c9-4bbd-bddf-e4c0db2ca581 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:44.699422 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341dcb-37c9-4bbd-bddf-e4c0db2ca581 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:44.699694 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13341dcb-37c9-4bbd-bddf-e4c0db2ca581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:44.716868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-13341dcb-37c9-4bbd-bddf-e4c0db2ca581 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:44.718047 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-13341dcb-37c9-4bbd-bddf-e4c0db2ca581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:44.760424 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496d6a4-5caf-4454-a406-6a222a4c8e2b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:44.784902 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 230/475] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:44.786363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341dcb-37c9-4bbd-bddf-e4c0db2ca581 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:44.796367 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4845a11-88f1-4f3b-bb15-5c7141789d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:44.797068 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4845a11-88f1-4f3b-bb15-5c7141789d85 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:44.797353 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4845a11-88f1-4f3b-bb15-5c7141789d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:44.797625 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4845a11-88f1-4f3b-bb15-5c7141789d85 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:44.798330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4845a11-88f1-4f3b-bb15-5c7141789d85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:44.799794 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4845a11-88f1-4f3b-bb15-5c7141789d85 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:44.833194 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 246/476] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:52:44 2022] POST /identity/v3/users => generated 248 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:52:44.834184 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4845a11-88f1-4f3b-bb15-5c7141789d85 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:44.904516 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13341dcb-37c9-4bbd-bddf-e4c0db2ca581 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:44.949638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ed15e-b439-41a7-951c-4640cce37a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:44.950312 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ed15e-b439-41a7-951c-4640cce37a9d None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:44.950586 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ed15e-b439-41a7-951c-4640cce37a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:44.950854 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ed15e-b439-41a7-951c-4640cce37a9d None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:44.951571 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ed15e-b439-41a7-951c-4640cce37a9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:44.953086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ed15e-b439-41a7-951c-4640cce37a9d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:45.000835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 231/477] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:52:44 2022] POST /identity/v3/users => generated 249 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:52:45.028604 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4845a11-88f1-4f3b-bb15-5c7141789d85 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:45.081081 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2d00a-7a11-425b-99a1-4074fe676a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:45.081837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2d00a-7a11-425b-99a1-4074fe676a7c None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:45.082317 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2d00a-7a11-425b-99a1-4074fe676a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:45.082736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2d00a-7a11-425b-99a1-4074fe676a7c None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:45.083759 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2d00a-7a11-425b-99a1-4074fe676a7c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:45.085401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2d00a-7a11-425b-99a1-4074fe676a7c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:45.093624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.sql.core [None req-6ed2d00a-7a11-425b-99a1-4074fe676a7c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 27 04:52:45.093624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 27 04:52:45.093624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [parameters: {'id': '400c6080747041c38ffde6df33102af7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 27 04:52:45.093624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80022) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 27 04:52:45.110428 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-6ed2d00a-7a11-425b-99a1-4074fe676a7c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 27 04:52:45.112234 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 247/478] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Sep 27 04:52:44 2022] POST /identity/v3/roles => generated 144 bytes in 278 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:45.117997 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ed15e-b439-41a7-951c-4640cce37a9d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:45.235963 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ed15e-b439-41a7-951c-4640cce37a9d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:45.274032 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f83a4d-bcdb-47de-ae05-d388d8edc7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:45.274886 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83a4d-bcdb-47de-ae05-d388d8edc7bf None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:45.275141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83a4d-bcdb-47de-ae05-d388d8edc7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:45.275400 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f83a4d-bcdb-47de-ae05-d388d8edc7bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:45.287638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f83a4d-bcdb-47de-ae05-d388d8edc7bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:45.295607 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-81f83a4d-bcdb-47de-ae05-d388d8edc7bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 27 04:52:45.297463 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 232/479] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:52:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:45.303533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2d00a-7a11-425b-99a1-4074fe676a7c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:45.417625 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2d00a-7a11-425b-99a1-4074fe676a7c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:45.454423 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441618d8-af3a-4a93-8937-d8efc35c3e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:45.455102 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441618d8-af3a-4a93-8937-d8efc35c3e13 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:45.455379 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441618d8-af3a-4a93-8937-d8efc35c3e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:45.455652 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441618d8-af3a-4a93-8937-d8efc35c3e13 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:45.456453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441618d8-af3a-4a93-8937-d8efc35c3e13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:45.456763 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441618d8-af3a-4a93-8937-d8efc35c3e13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:45.459214 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441618d8-af3a-4a93-8937-d8efc35c3e13 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:45.468334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 248/480] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:46.962101 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe82d3-6220-420c-9d10-4010c8b25ca1 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:46.962619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe82d3-6220-420c-9d10-4010c8b25ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:46.962619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe82d3-6220-420c-9d10-4010c8b25ca1 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:46.964748 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 233/481] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:46.969966 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2f551-03e1-4324-88b7-e14c7a80e3dd None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:46.970379 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2f551-03e1-4324-88b7-e14c7a80e3dd None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:46.970544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2f551-03e1-4324-88b7-e14c7a80e3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:46.993032 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-5aa2f551-03e1-4324-88b7-e14c7a80e3dd None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:46.994309 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5aa2f551-03e1-4324-88b7-e14c7a80e3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:47.035099 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577a9c2-443d-4f17-b93f-bcec637e8c70 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:47.035443 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577a9c2-443d-4f17-b93f-bcec637e8c70 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:47.035721 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577a9c2-443d-4f17-b93f-bcec637e8c70 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:47.037879 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 234/482] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:52:47.043215 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7b58d-0d86-4b3e-b92f-e969a9da8743 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:47.043499 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7b58d-0d86-4b3e-b92f-e969a9da8743 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:47.043776 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7b58d-0d86-4b3e-b92f-e969a9da8743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:47.060973 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-dab7b58d-0d86-4b3e-b92f-e969a9da8743 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:47.062264 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-dab7b58d-0d86-4b3e-b92f-e969a9da8743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:47.110109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 249/483] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:47.141452 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 235/484] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:47.164908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2f551-03e1-4324-88b7-e14c7a80e3dd None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:47.176505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7b58d-0d86-4b3e-b92f-e969a9da8743 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:47.277596 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7b58d-0d86-4b3e-b92f-e969a9da8743 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:47.312168 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111ea12-4b04-4f43-bdf9-5ff05c078114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:47.313175 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111ea12-4b04-4f43-bdf9-5ff05c078114 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:47.313454 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111ea12-4b04-4f43-bdf9-5ff05c078114 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:47.313719 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111ea12-4b04-4f43-bdf9-5ff05c078114 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:47.324427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111ea12-4b04-4f43-bdf9-5ff05c078114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:47.331423 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-3111ea12-4b04-4f43-bdf9-5ff05c078114 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:52:47.333153 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 236/485] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:52:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:47.338851 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111ea12-4b04-4f43-bdf9-5ff05c078114 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:47.366410 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2f551-03e1-4324-88b7-e14c7a80e3dd None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:47.438463 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111ea12-4b04-4f43-bdf9-5ff05c078114 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:47.450753 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771f331-d44b-4774-adb2-05ffb1063bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:47.451886 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771f331-d44b-4774-adb2-05ffb1063bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:47.452400 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771f331-d44b-4774-adb2-05ffb1063bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:47.452912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771f331-d44b-4774-adb2-05ffb1063bc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:47.473026 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba1fbc-a212-46f0-83ba-c0d5252f158b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:47.473774 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba1fbc-a212-46f0-83ba-c0d5252f158b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:47.474048 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba1fbc-a212-46f0-83ba-c0d5252f158b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:47.474318 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba1fbc-a212-46f0-83ba-c0d5252f158b None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:47.475066 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba1fbc-a212-46f0-83ba-c0d5252f158b None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:47.475367 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba1fbc-a212-46f0-83ba-c0d5252f158b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:47.480321 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba1fbc-a212-46f0-83ba-c0d5252f158b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:47.481415 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771f331-d44b-4774-adb2-05ffb1063bc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:47.488655 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-6771f331-d44b-4774-adb2-05ffb1063bc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:52:47.489462 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 237/486] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:52:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:47.490828 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 250/487] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:52:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:47.491007 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba1fbc-a212-46f0-83ba-c0d5252f158b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:47.510659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771f331-d44b-4774-adb2-05ffb1063bc0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:47.599682 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba1fbc-a212-46f0-83ba-c0d5252f158b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:47.639535 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e9261-faf9-4c81-9367-111915d6fd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:47.640353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e9261-faf9-4c81-9367-111915d6fd35 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:47.640657 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e9261-faf9-4c81-9367-111915d6fd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:47.640937 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e9261-faf9-4c81-9367-111915d6fd35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:47.664425 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e9261-faf9-4c81-9367-111915d6fd35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:47.666288 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e9261-faf9-4c81-9367-111915d6fd35 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:47.690186 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-b65e9261-faf9-4c81-9367-111915d6fd35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:47.699251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 238/488] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:47.703584 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e9261-faf9-4c81-9367-111915d6fd35 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:47.711603 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771f331-d44b-4774-adb2-05ffb1063bc0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:47.783990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b90e9-4a30-441e-a18e-4ed76a059c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:47.785190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b90e9-4a30-441e-a18e-4ed76a059c6d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:47.785715 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b90e9-4a30-441e-a18e-4ed76a059c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:47.786228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b90e9-4a30-441e-a18e-4ed76a059c6d None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:47.787169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b90e9-4a30-441e-a18e-4ed76a059c6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:47.788655 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b90e9-4a30-441e-a18e-4ed76a059c6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:47.790551 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b90e9-4a30-441e-a18e-4ed76a059c6d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:47.806026 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 251/489] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:52:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:47.811566 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b90e9-4a30-441e-a18e-4ed76a059c6d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:47.888440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e9261-faf9-4c81-9367-111915d6fd35 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:47.953108 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc2141-0e39-4021-9216-91821a967870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:47.953771 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc2141-0e39-4021-9216-91821a967870 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:47.954047 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc2141-0e39-4021-9216-91821a967870 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:47.954320 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc2141-0e39-4021-9216-91821a967870 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:47.955098 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc2141-0e39-4021-9216-91821a967870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:47.955401 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc2141-0e39-4021-9216-91821a967870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:47.956781 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc2141-0e39-4021-9216-91821a967870 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:47.982158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 239/490] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:47.984150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dc01e-3c15-4df8-96b5-f94a858e3cf5 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:47.984444 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dc01e-3c15-4df8-96b5-f94a858e3cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:47.985015 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dc01e-3c15-4df8-96b5-f94a858e3cf5 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:47.987530 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 240/491] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:47.991399 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dc01e-3c15-4df8-96b5-f94a858e3cf5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:47.992962 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b90e9-4a30-441e-a18e-4ed76a059c6d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:48.026952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba9423-eb95-4566-a95c-257862c9998b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:48.027763 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba9423-eb95-4566-a95c-257862c9998b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:48.028037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba9423-eb95-4566-a95c-257862c9998b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:48.028311 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba9423-eb95-4566-a95c-257862c9998b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:48.039205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba9423-eb95-4566-a95c-257862c9998b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:48.040663 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba9423-eb95-4566-a95c-257862c9998b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:48.057624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-75ba9423-eb95-4566-a95c-257862c9998b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:48.063478 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 252/492] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:48.064876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dfbe3-8d48-480e-8838-816a32521d97 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:48.065137 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dfbe3-8d48-480e-8838-816a32521d97 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:48.065420 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dfbe3-8d48-480e-8838-816a32521d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:48.083328 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-430dfbe3-8d48-480e-8838-816a32521d97 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:48.084518 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-430dfbe3-8d48-480e-8838-816a32521d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:48.124680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dc01e-3c15-4df8-96b5-f94a858e3cf5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:48.163283 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 253/493] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:48.164108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dfbe3-8d48-480e-8838-816a32521d97 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:48.184000 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bb6e2-00a1-4836-842c-c98b79fa0c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:48.185167 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bb6e2-00a1-4836-842c-c98b79fa0c3e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:48.185745 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bb6e2-00a1-4836-842c-c98b79fa0c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:48.186025 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bb6e2-00a1-4836-842c-c98b79fa0c3e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:48.200207 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bb6e2-00a1-4836-842c-c98b79fa0c3e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:48.201684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bb6e2-00a1-4836-842c-c98b79fa0c3e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:48.222334 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-3d9bb6e2-00a1-4836-842c-c98b79fa0c3e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 27 04:52:48.229183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 241/494] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:48.230159 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bb6e2-00a1-4836-842c-c98b79fa0c3e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:48.292027 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dfbe3-8d48-480e-8838-816a32521d97 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:48.324962 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb827570-9a2c-41f8-a3cb-481128856d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:48.325614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb827570-9a2c-41f8-a3cb-481128856d7a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:48.325891 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb827570-9a2c-41f8-a3cb-481128856d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:48.326161 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb827570-9a2c-41f8-a3cb-481128856d7a None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:48.326868 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb827570-9a2c-41f8-a3cb-481128856d7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:48.327198 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb827570-9a2c-41f8-a3cb-481128856d7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:48.328531 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb827570-9a2c-41f8-a3cb-481128856d7a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:48.332579 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bb6e2-00a1-4836-842c-c98b79fa0c3e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:48.341072 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 254/495] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:48.341786 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb827570-9a2c-41f8-a3cb-481128856d7a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:48.372435 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce4f85-aa77-4dbb-8ddb-7747e5182667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:48.373258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce4f85-aa77-4dbb-8ddb-7747e5182667 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:48.373574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce4f85-aa77-4dbb-8ddb-7747e5182667 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:48.373830 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce4f85-aa77-4dbb-8ddb-7747e5182667 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:48.384360 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce4f85-aa77-4dbb-8ddb-7747e5182667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:48.391299 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-69ce4f85-aa77-4dbb-8ddb-7747e5182667 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:52:48.398134 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 242/496] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:52:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:48.398134 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3795bc-7560-4f82-a9b8-0f0bb4635dec None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:48.398134 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3795bc-7560-4f82-a9b8-0f0bb4635dec None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:48.398134 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3795bc-7560-4f82-a9b8-0f0bb4635dec None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:48.401199 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 243/497] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:48.401912 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3795bc-7560-4f82-a9b8-0f0bb4635dec None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:48.446740 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb827570-9a2c-41f8-a3cb-481128856d7a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:48.481945 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6afaf-82c5-415d-ad58-4c426cd9c0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:48.482966 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6afaf-82c5-415d-ad58-4c426cd9c0ce None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:48.483254 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6afaf-82c5-415d-ad58-4c426cd9c0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:48.483528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6afaf-82c5-415d-ad58-4c426cd9c0ce None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:48.484356 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6afaf-82c5-415d-ad58-4c426cd9c0ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:48.484661 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6afaf-82c5-415d-ad58-4c426cd9c0ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:48.486132 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6afaf-82c5-415d-ad58-4c426cd9c0ce None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:48.507313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3795bc-7560-4f82-a9b8-0f0bb4635dec None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:48.527535 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 255/498] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Sep 27 04:52:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:48.527535 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6afaf-82c5-415d-ad58-4c426cd9c0ce None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:48.546596 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5b24e-717f-4ac5-a1d7-94919e5b2c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:48.547646 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5b24e-717f-4ac5-a1d7-94919e5b2c97 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:48.548095 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5b24e-717f-4ac5-a1d7-94919e5b2c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:48.548534 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5b24e-717f-4ac5-a1d7-94919e5b2c97 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:48.556484 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5b24e-717f-4ac5-a1d7-94919e5b2c97 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:48.558158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5b24e-717f-4ac5-a1d7-94919e5b2c97 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:48.571792 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-4af5b24e-717f-4ac5-a1d7-94919e5b2c97 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:52:48.573039 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 244/499] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 27 04:52:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:48.574285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9193d-7f54-41c4-941f-1b1e1d90cd38 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:48.574568 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9193d-7f54-41c4-941f-1b1e1d90cd38 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:48.574839 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9193d-7f54-41c4-941f-1b1e1d90cd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:48.592268 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-11d9193d-7f54-41c4-941f-1b1e1d90cd38 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:48.593597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-11d9193d-7f54-41c4-941f-1b1e1d90cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:48.627908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6afaf-82c5-415d-ad58-4c426cd9c0ce None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:48.657349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 245/500] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:48.658041 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9193d-7f54-41c4-941f-1b1e1d90cd38 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:48.665431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b86db8-3171-4576-8e45-639b68373d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:48.666113 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b86db8-3171-4576-8e45-639b68373d89 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:48.666400 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b86db8-3171-4576-8e45-639b68373d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:48.666677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b86db8-3171-4576-8e45-639b68373d89 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:48.667420 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b86db8-3171-4576-8e45-639b68373d89 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:48.667725 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b86db8-3171-4576-8e45-639b68373d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:48.669120 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b86db8-3171-4576-8e45-639b68373d89 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:48.681415 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 256/501] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:52:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:48.681415 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b86db8-3171-4576-8e45-639b68373d89 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:48.755938 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9193d-7f54-41c4-941f-1b1e1d90cd38 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:48.774441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b86db8-3171-4576-8e45-639b68373d89 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:48.787981 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714424bf-3a6e-41a1-bd17-e5ed406585aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:48.788621 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714424bf-3a6e-41a1-bd17-e5ed406585aa None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:48.788926 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714424bf-3a6e-41a1-bd17-e5ed406585aa None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:48.789200 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714424bf-3a6e-41a1-bd17-e5ed406585aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:48.806404 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb9b5c-a18c-48b1-a710-7cfd6d570793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:48.807059 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb9b5c-a18c-48b1-a710-7cfd6d570793 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:48.807343 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb9b5c-a18c-48b1-a710-7cfd6d570793 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:48.807618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb9b5c-a18c-48b1-a710-7cfd6d570793 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:48.808438 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb9b5c-a18c-48b1-a710-7cfd6d570793 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:48.808746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb9b5c-a18c-48b1-a710-7cfd6d570793 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:48.810192 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb9b5c-a18c-48b1-a710-7cfd6d570793 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:48.827117 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 257/502] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 27 04:52:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:48.828336 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb99c43-98ea-47b0-b06a-99459f09d189 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:48.828623 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb99c43-98ea-47b0-b06a-99459f09d189 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:48.828938 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb99c43-98ea-47b0-b06a-99459f09d189 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:48.830708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 258/503] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:48.831512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb99c43-98ea-47b0-b06a-99459f09d189 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:48.858365 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714424bf-3a6e-41a1-bd17-e5ed406585aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:48.859838 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714424bf-3a6e-41a1-bd17-e5ed406585aa None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:48.927238 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb99c43-98ea-47b0-b06a-99459f09d189 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:48.952886 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 246/504] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:48.953767 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714424bf-3a6e-41a1-bd17-e5ed406585aa None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:48.958915 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b0826-4423-4ee6-8847-d3e811b32cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:48.959706 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b0826-4423-4ee6-8847-d3e811b32cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:48.959988 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b0826-4423-4ee6-8847-d3e811b32cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:48.960267 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b0826-4423-4ee6-8847-d3e811b32cc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:48.970123 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b0826-4423-4ee6-8847-d3e811b32cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:48.977866 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-3b8b0826-4423-4ee6-8847-d3e811b32cc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:52:48.979059 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 259/505] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:52:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:48.979824 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b0826-4423-4ee6-8847-d3e811b32cc3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:49.049215 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714424bf-3a6e-41a1-bd17-e5ed406585aa None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:49.074933 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b0826-4423-4ee6-8847-d3e811b32cc3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:49.081439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334acd6a-f82f-48f2-ae83-4bff8e38cd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:49.082269 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334acd6a-f82f-48f2-ae83-4bff8e38cd75 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:49.082553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334acd6a-f82f-48f2-ae83-4bff8e38cd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:49.082830 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334acd6a-f82f-48f2-ae83-4bff8e38cd75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:49.092669 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334acd6a-f82f-48f2-ae83-4bff8e38cd75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:49.094140 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334acd6a-f82f-48f2-ae83-4bff8e38cd75 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:49.106661 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969daea-4d6e-4bd5-a144-d8dbac66975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:49.107295 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969daea-4d6e-4bd5-a144-d8dbac66975b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:49.107578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969daea-4d6e-4bd5-a144-d8dbac66975b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:49.107853 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969daea-4d6e-4bd5-a144-d8dbac66975b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:49.111275 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-334acd6a-f82f-48f2-ae83-4bff8e38cd75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:49.112457 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 247/506] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:49.114389 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff3550-cb4d-492c-93a0-717fed480b83 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:49.114676 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff3550-cb4d-492c-93a0-717fed480b83 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:49.114951 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff3550-cb4d-492c-93a0-717fed480b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:49.131801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-75ff3550-cb4d-492c-93a0-717fed480b83 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:49.133009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-75ff3550-cb4d-492c-93a0-717fed480b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:49.172614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969daea-4d6e-4bd5-a144-d8dbac66975b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:49.174121 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969daea-4d6e-4bd5-a144-d8dbac66975b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:49.195635 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 248/507] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:49.196461 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff3550-cb4d-492c-93a0-717fed480b83 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:49.270211 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 260/508] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:49.271042 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969daea-4d6e-4bd5-a144-d8dbac66975b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:49.290981 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff3550-cb4d-492c-93a0-717fed480b83 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:49.323746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf00e6-50c0-4670-a64f-e4263eedb660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:49.324470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf00e6-50c0-4670-a64f-e4263eedb660 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:49.324750 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf00e6-50c0-4670-a64f-e4263eedb660 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:49.325056 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf00e6-50c0-4670-a64f-e4263eedb660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:49.334798 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf00e6-50c0-4670-a64f-e4263eedb660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:49.336249 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf00e6-50c0-4670-a64f-e4263eedb660 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:49.352534 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-fdcf00e6-50c0-4670-a64f-e4263eedb660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:49.353729 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 249/509] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:49.354492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf00e6-50c0-4670-a64f-e4263eedb660 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:49.364110 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969daea-4d6e-4bd5-a144-d8dbac66975b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:49.397451 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b549c-66c5-4239-9d9a-e406d4a93ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:49.398107 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b549c-66c5-4239-9d9a-e406d4a93ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:49.398389 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b549c-66c5-4239-9d9a-e406d4a93ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:49.398663 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b549c-66c5-4239-9d9a-e406d4a93ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:49.399402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b549c-66c5-4239-9d9a-e406d4a93ef2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:49.399707 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b549c-66c5-4239-9d9a-e406d4a93ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:49.401106 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b549c-66c5-4239-9d9a-e406d4a93ef2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:49.408589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 261/510] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:52:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:49.409395 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b549c-66c5-4239-9d9a-e406d4a93ef2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:49.448381 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf00e6-50c0-4670-a64f-e4263eedb660 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:49.481340 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8698f9-e64e-46bf-8a82-2bb873f57cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:49.481995 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8698f9-e64e-46bf-8a82-2bb873f57cbc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:49.482276 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8698f9-e64e-46bf-8a82-2bb873f57cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:49.482553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8698f9-e64e-46bf-8a82-2bb873f57cbc None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:49.483270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8698f9-e64e-46bf-8a82-2bb873f57cbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:49.483575 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8698f9-e64e-46bf-8a82-2bb873f57cbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:49.484977 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8698f9-e64e-46bf-8a82-2bb873f57cbc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:49.496292 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 250/511] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:49.496928 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8698f9-e64e-46bf-8a82-2bb873f57cbc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:49.503696 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b549c-66c5-4239-9d9a-e406d4a93ef2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:49.536171 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d05afb-35e2-420b-b465-8033fb78165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:49.536974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05afb-35e2-420b-b465-8033fb78165f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:49.537257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05afb-35e2-420b-b465-8033fb78165f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:49.537533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05afb-35e2-420b-b465-8033fb78165f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:49.547606 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d05afb-35e2-420b-b465-8033fb78165f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:49.549069 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d05afb-35e2-420b-b465-8033fb78165f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:49.565159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-00d05afb-35e2-420b-b465-8033fb78165f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:49.566850 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 262/512] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:49.567621 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d05afb-35e2-420b-b465-8033fb78165f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:49.592024 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8698f9-e64e-46bf-8a82-2bb873f57cbc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:49.623371 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305292ef-33de-418a-8f31-a2b8dc3fa5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:49.624161 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305292ef-33de-418a-8f31-a2b8dc3fa5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:49.624441 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305292ef-33de-418a-8f31-a2b8dc3fa5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:49.624717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305292ef-33de-418a-8f31-a2b8dc3fa5f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:49.636209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305292ef-33de-418a-8f31-a2b8dc3fa5f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:49.637683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305292ef-33de-418a-8f31-a2b8dc3fa5f2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:49.654404 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-305292ef-33de-418a-8f31-a2b8dc3fa5f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:49.655599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 251/513] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:49.656346 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305292ef-33de-418a-8f31-a2b8dc3fa5f2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:49.662108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d05afb-35e2-420b-b465-8033fb78165f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:49.698925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a16e90-2444-436e-b14b-91b459704bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:49.699581 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a16e90-2444-436e-b14b-91b459704bbf None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:49.699864 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a16e90-2444-436e-b14b-91b459704bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:49.700136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a16e90-2444-436e-b14b-91b459704bbf None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:49.700877 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a16e90-2444-436e-b14b-91b459704bbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:49.701184 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a16e90-2444-436e-b14b-91b459704bbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:49.702591 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a16e90-2444-436e-b14b-91b459704bbf None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:49.714919 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 263/514] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:49.715718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a16e90-2444-436e-b14b-91b459704bbf None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:49.757454 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305292ef-33de-418a-8f31-a2b8dc3fa5f2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:49.789517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74824a-86c5-4477-87ae-20276ada6481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:49.790304 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74824a-86c5-4477-87ae-20276ada6481 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:49.790582 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74824a-86c5-4477-87ae-20276ada6481 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:49.790853 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74824a-86c5-4477-87ae-20276ada6481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:49.800941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74824a-86c5-4477-87ae-20276ada6481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:49.802528 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74824a-86c5-4477-87ae-20276ada6481 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:49.809155 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a16e90-2444-436e-b14b-91b459704bbf None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:49.818925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-cd74824a-86c5-4477-87ae-20276ada6481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:49.820089 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 252/515] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:49.820871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74824a-86c5-4477-87ae-20276ada6481 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:49.842905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a464a6-fe4f-4f26-bec4-39549e9fccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:49.843637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a464a6-fe4f-4f26-bec4-39549e9fccf5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:49.843917 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a464a6-fe4f-4f26-bec4-39549e9fccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:49.844244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a464a6-fe4f-4f26-bec4-39549e9fccf5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:49.851690 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a464a6-fe4f-4f26-bec4-39549e9fccf5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:49.853190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a464a6-fe4f-4f26-bec4-39549e9fccf5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:49.866670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-60a464a6-fe4f-4f26-bec4-39549e9fccf5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 04:52:49.867914 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 264/516] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:49.868671 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a464a6-fe4f-4f26-bec4-39549e9fccf5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:49.914920 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74824a-86c5-4477-87ae-20276ada6481 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:49.947300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c6820-695a-4296-b31b-c8feb8635cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:49.947959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c6820-695a-4296-b31b-c8feb8635cef None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:49.948239 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c6820-695a-4296-b31b-c8feb8635cef None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:49.948515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c6820-695a-4296-b31b-c8feb8635cef None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:49.949271 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c6820-695a-4296-b31b-c8feb8635cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:49.949578 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c6820-695a-4296-b31b-c8feb8635cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:49.950943 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c6820-695a-4296-b31b-c8feb8635cef None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:49.962405 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 253/517] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:49.962522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a464a6-fe4f-4f26-bec4-39549e9fccf5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:49.963194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c6820-695a-4296-b31b-c8feb8635cef None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:49.996334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0ed1b-69a7-4f26-bd8f-8441efdff7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:49.997125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0ed1b-69a7-4f26-bd8f-8441efdff7bc None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:49.997407 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0ed1b-69a7-4f26-bd8f-8441efdff7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:49.997682 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0ed1b-69a7-4f26-bd8f-8441efdff7bc None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:49.998394 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0ed1b-69a7-4f26-bd8f-8441efdff7bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:49.998700 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0ed1b-69a7-4f26-bd8f-8441efdff7bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:50.000083 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0ed1b-69a7-4f26-bd8f-8441efdff7bc None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:50.011606 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 265/518] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:50.013499 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0ed1b-69a7-4f26-bd8f-8441efdff7bc None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:50.057512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c6820-695a-4296-b31b-c8feb8635cef None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:50.089455 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d108ec-ad66-4673-97f8-7bbfdf8a8f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:50.090237 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d108ec-ad66-4673-97f8-7bbfdf8a8f0b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:50.090516 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d108ec-ad66-4673-97f8-7bbfdf8a8f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:50.090796 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d108ec-ad66-4673-97f8-7bbfdf8a8f0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:50.097228 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d108ec-ad66-4673-97f8-7bbfdf8a8f0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:50.099192 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d108ec-ad66-4673-97f8-7bbfdf8a8f0b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:50.106987 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0ed1b-69a7-4f26-bd8f-8441efdff7bc None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:50.111736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-92d108ec-ad66-4673-97f8-7bbfdf8a8f0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:52:50.112927 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 254/519] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:50.113856 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d108ec-ad66-4673-97f8-7bbfdf8a8f0b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:50.138766 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4e5cf-96cf-4653-861d-c5b1b10bc42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:50.139415 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4e5cf-96cf-4653-861d-c5b1b10bc42d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:50.139694 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4e5cf-96cf-4653-861d-c5b1b10bc42d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:50.139961 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4e5cf-96cf-4653-861d-c5b1b10bc42d None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:50.140664 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4e5cf-96cf-4653-861d-c5b1b10bc42d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:50.140995 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4e5cf-96cf-4653-861d-c5b1b10bc42d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:50.142354 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4e5cf-96cf-4653-861d-c5b1b10bc42d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:50.154158 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 266/520] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:50.154906 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4e5cf-96cf-4653-861d-c5b1b10bc42d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:50.208858 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d108ec-ad66-4673-97f8-7bbfdf8a8f0b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:50.241862 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af67c91-a397-4448-9dc2-274b2a1b6dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:50.242520 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af67c91-a397-4448-9dc2-274b2a1b6dbb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:50.242813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af67c91-a397-4448-9dc2-274b2a1b6dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:50.243071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af67c91-a397-4448-9dc2-274b2a1b6dbb None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:50.243889 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af67c91-a397-4448-9dc2-274b2a1b6dbb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:50.244191 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af67c91-a397-4448-9dc2-274b2a1b6dbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:50.245633 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af67c91-a397-4448-9dc2-274b2a1b6dbb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:50.248097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4e5cf-96cf-4653-861d-c5b1b10bc42d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:50.280444 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549d91f-4c20-483a-bf3a-a1295a5b589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:50.281138 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549d91f-4c20-483a-bf3a-a1295a5b589f None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:50.281420 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549d91f-4c20-483a-bf3a-a1295a5b589f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:50.281694 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549d91f-4c20-483a-bf3a-a1295a5b589f None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:50.282386 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549d91f-4c20-483a-bf3a-a1295a5b589f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:50.282600 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 255/521] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Sep 27 04:52:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:50.283462 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af67c91-a397-4448-9dc2-274b2a1b6dbb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:50.283820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549d91f-4c20-483a-bf3a-a1295a5b589f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:50.304568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 267/522] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:52:50 2022] POST /identity/v3/users => generated 247 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:52:50.305406 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549d91f-4c20-483a-bf3a-a1295a5b589f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:50.401164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af67c91-a397-4448-9dc2-274b2a1b6dbb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:50.411720 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549d91f-4c20-483a-bf3a-a1295a5b589f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:50.437073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eea8a6-03ec-4120-99bd-26c0266fdfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:50.437890 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eea8a6-03ec-4120-99bd-26c0266fdfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:50.438164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eea8a6-03ec-4120-99bd-26c0266fdfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:50.438451 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eea8a6-03ec-4120-99bd-26c0266fdfc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:50.446984 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eea8a6-03ec-4120-99bd-26c0266fdfc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:50.447447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2ad7d-aaae-49a6-bcae-fd8ed5e16fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:50.448116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2ad7d-aaae-49a6-bcae-fd8ed5e16fdd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:50.448398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2ad7d-aaae-49a6-bcae-fd8ed5e16fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:50.448492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eea8a6-03ec-4120-99bd-26c0266fdfc9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:50.448703 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2ad7d-aaae-49a6-bcae-fd8ed5e16fdd None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:50.449487 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2ad7d-aaae-49a6-bcae-fd8ed5e16fdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:50.449803 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2ad7d-aaae-49a6-bcae-fd8ed5e16fdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:50.451596 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d2ad7d-aaae-49a6-bcae-fd8ed5e16fdd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:50.463275 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-49eea8a6-03ec-4120-99bd-26c0266fdfc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:52:50.469761 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 256/523] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:50.469761 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eea8a6-03ec-4120-99bd-26c0266fdfc9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:50.471651 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 268/524] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:52:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:50.476921 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2ad7d-aaae-49a6-bcae-fd8ed5e16fdd None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:50.571917 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eea8a6-03ec-4120-99bd-26c0266fdfc9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:50.580416 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2ad7d-aaae-49a6-bcae-fd8ed5e16fdd None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:50.604955 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2976ff-b6a4-43e9-b8df-4a6fea48598e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:50.605754 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2976ff-b6a4-43e9-b8df-4a6fea48598e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:50.606033 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2976ff-b6a4-43e9-b8df-4a6fea48598e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:50.606306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2976ff-b6a4-43e9-b8df-4a6fea48598e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:50.614849 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2976ff-b6a4-43e9-b8df-4a6fea48598e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:50.614977 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016ad68-e7e4-40d2-8894-2d0e43bf49f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:50.615661 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016ad68-e7e4-40d2-8894-2d0e43bf49f3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:50.615947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016ad68-e7e4-40d2-8894-2d0e43bf49f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:50.616220 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016ad68-e7e4-40d2-8894-2d0e43bf49f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:50.616395 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2976ff-b6a4-43e9-b8df-4a6fea48598e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:50.629981 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-7c2976ff-b6a4-43e9-b8df-4a6fea48598e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 04:52:50.635763 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 257/525] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:52:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:50.635763 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2976ff-b6a4-43e9-b8df-4a6fea48598e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:50.682199 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016ad68-e7e4-40d2-8894-2d0e43bf49f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:50.683596 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016ad68-e7e4-40d2-8894-2d0e43bf49f3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:50.733486 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2976ff-b6a4-43e9-b8df-4a6fea48598e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:50.766788 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3fe0d-55a4-46b1-95d8-9324abade0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:50.767456 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fe0d-55a4-46b1-95d8-9324abade0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:50.767738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fe0d-55a4-46b1-95d8-9324abade0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:50.768016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3fe0d-55a4-46b1-95d8-9324abade0d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:50.768834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3fe0d-55a4-46b1-95d8-9324abade0d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:50.769138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3fe0d-55a4-46b1-95d8-9324abade0d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:50.771143 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3fe0d-55a4-46b1-95d8-9324abade0d8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:50.781899 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 269/526] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:50.782984 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016ad68-e7e4-40d2-8894-2d0e43bf49f3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:50.790228 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 258/527] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:52:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:50.791044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3fe0d-55a4-46b1-95d8-9324abade0d8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:50.885218 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016ad68-e7e4-40d2-8894-2d0e43bf49f3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:50.888419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3fe0d-55a4-46b1-95d8-9324abade0d8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:50.918770 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915167b-4676-4818-8c45-900910df1057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:50.919419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915167b-4676-4818-8c45-900910df1057 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:50.919697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915167b-4676-4818-8c45-900910df1057 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:50.919971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915167b-4676-4818-8c45-900910df1057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:50.920803 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915167b-4676-4818-8c45-900910df1057 None admin] RBAC: Adding query filter params (role.id=22681aa004f8450f964af121fc87d40a, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=93e04bf8c51c4d89bbb45e96223e7409) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:50.921118 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915167b-4676-4818-8c45-900910df1057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:50.922116 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef91d6-727a-4bd6-871b-f83799d9ac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:50.922559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915167b-4676-4818-8c45-900910df1057 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:50.922786 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef91d6-727a-4bd6-871b-f83799d9ac10 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:50.923067 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef91d6-727a-4bd6-871b-f83799d9ac10 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:50.923342 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef91d6-727a-4bd6-871b-f83799d9ac10 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:50.924175 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef91d6-727a-4bd6-871b-f83799d9ac10 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:50.924494 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef91d6-727a-4bd6-871b-f83799d9ac10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:50.926074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef91d6-727a-4bd6-871b-f83799d9ac10 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:50.928029 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 270/528] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:50 2022] GET /identity/v3/role_assignments?user.id=93e04bf8c51c4d89bbb45e96223e7409&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=22681aa004f8450f964af121fc87d40a => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:50.928869 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915167b-4676-4818-8c45-900910df1057 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:50.955455 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 259/529] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Sep 27 04:52:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:50.957434 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef91d6-727a-4bd6-871b-f83799d9ac10 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:51.035797 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915167b-4676-4818-8c45-900910df1057 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:51.067538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef91d6-727a-4bd6-871b-f83799d9ac10 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:51.072925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffca2e2-265e-4e13-a328-dfc739d05088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:51.073767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffca2e2-265e-4e13-a328-dfc739d05088 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:51.074045 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffca2e2-265e-4e13-a328-dfc739d05088 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:51.074321 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffca2e2-265e-4e13-a328-dfc739d05088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:51.085679 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffca2e2-265e-4e13-a328-dfc739d05088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:51.087155 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffca2e2-265e-4e13-a328-dfc739d05088 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:51.105946 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-5ffca2e2-265e-4e13-a328-dfc739d05088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:51.111535 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 271/530] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:51.111535 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffca2e2-265e-4e13-a328-dfc739d05088 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:51.115640 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76764ac6-9b46-475d-9214-250629f4157f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:51.116382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76764ac6-9b46-475d-9214-250629f4157f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:51.116664 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76764ac6-9b46-475d-9214-250629f4157f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:51.117009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76764ac6-9b46-475d-9214-250629f4157f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:51.118780 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76764ac6-9b46-475d-9214-250629f4157f None admin] RBAC: Adding query filter params (role.id=22681aa004f8450f964af121fc87d40a, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=faac84ed9d37420c811bbf6ac7df0b35) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:51.119098 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76764ac6-9b46-475d-9214-250629f4157f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:51.120573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76764ac6-9b46-475d-9214-250629f4157f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:51.136832 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 260/531] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:50 2022] GET /identity/v3/role_assignments?user.id=faac84ed9d37420c811bbf6ac7df0b35&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=22681aa004f8450f964af121fc87d40a => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:51.136832 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76764ac6-9b46-475d-9214-250629f4157f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:51.268376 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76764ac6-9b46-475d-9214-250629f4157f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:51.309699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fbe2f-caf9-4526-8cd6-f4107b616145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:51.310625 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fbe2f-caf9-4526-8cd6-f4107b616145 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:51.311048 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fbe2f-caf9-4526-8cd6-f4107b616145 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:51.311477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fbe2f-caf9-4526-8cd6-f4107b616145 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:51.312360 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fbe2f-caf9-4526-8cd6-f4107b616145 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:51.312835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fbe2f-caf9-4526-8cd6-f4107b616145 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:51.314716 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fbe2f-caf9-4526-8cd6-f4107b616145 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:51.329426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 261/532] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:51.334991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fbe2f-caf9-4526-8cd6-f4107b616145 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:51.336972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffca2e2-265e-4e13-a328-dfc739d05088 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:51.377329 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c4a44-14cc-4b65-a5bf-eb7c70c53505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:51.377640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c4a44-14cc-4b65-a5bf-eb7c70c53505 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:51.377951 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c4a44-14cc-4b65-a5bf-eb7c70c53505 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:51.378368 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c4a44-14cc-4b65-a5bf-eb7c70c53505 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:51.444092 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fbe2f-caf9-4526-8cd6-f4107b616145 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:51.453078 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c4a44-14cc-4b65-a5bf-eb7c70c53505 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:51.454697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c4a44-14cc-4b65-a5bf-eb7c70c53505 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:51.486569 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf77cdc-b76a-462b-ab36-8dbcfc0d6a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:51.487755 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf77cdc-b76a-462b-ab36-8dbcfc0d6a4c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:51.488984 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf77cdc-b76a-462b-ab36-8dbcfc0d6a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:51.489510 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf77cdc-b76a-462b-ab36-8dbcfc0d6a4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:51.496881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf77cdc-b76a-462b-ab36-8dbcfc0d6a4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:51.498594 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf77cdc-b76a-462b-ab36-8dbcfc0d6a4c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:51.513539 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-fbf77cdc-b76a-462b-ab36-8dbcfc0d6a4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:52:51.515512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 262/533] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:51.522349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf77cdc-b76a-462b-ab36-8dbcfc0d6a4c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:51.622323 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf77cdc-b76a-462b-ab36-8dbcfc0d6a4c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:51.651890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 272/534] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:52:51.660892 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63539a9-5aab-46aa-ace9-8574fdda1597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:51.661845 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63539a9-5aab-46aa-ace9-8574fdda1597 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:51.662330 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63539a9-5aab-46aa-ace9-8574fdda1597 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:51.662916 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63539a9-5aab-46aa-ace9-8574fdda1597 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:51.663900 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63539a9-5aab-46aa-ace9-8574fdda1597 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:51.664424 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63539a9-5aab-46aa-ace9-8574fdda1597 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:51.666391 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c4a44-14cc-4b65-a5bf-eb7c70c53505 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:51.667055 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63539a9-5aab-46aa-ace9-8574fdda1597 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:51.679829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 263/535] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:52:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:51.685690 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63539a9-5aab-46aa-ace9-8574fdda1597 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:51.785270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63539a9-5aab-46aa-ace9-8574fdda1597 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:51.819908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9967aff-3b06-4fc9-b525-e2969433cb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:51.820903 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9967aff-3b06-4fc9-b525-e2969433cb07 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:51.821388 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9967aff-3b06-4fc9-b525-e2969433cb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:51.821875 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9967aff-3b06-4fc9-b525-e2969433cb07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:51.822879 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9967aff-3b06-4fc9-b525-e2969433cb07 None admin] RBAC: Adding query filter params (role.id=22681aa004f8450f964af121fc87d40a, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=9ba2cc8ae41b435d830e58327893f527) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:51.823397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9967aff-3b06-4fc9-b525-e2969433cb07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:51.825114 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9967aff-3b06-4fc9-b525-e2969433cb07 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:51.830967 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 264/536] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:51 2022] GET /identity/v3/role_assignments?user.id=9ba2cc8ae41b435d830e58327893f527&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=22681aa004f8450f964af121fc87d40a => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:51.841504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c4a44-14cc-4b65-a5bf-eb7c70c53505 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:51.882124 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750e808-aae7-47fe-aeb2-71965ffb3704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:51.882986 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750e808-aae7-47fe-aeb2-71965ffb3704 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:51.883267 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750e808-aae7-47fe-aeb2-71965ffb3704 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:51.883593 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750e808-aae7-47fe-aeb2-71965ffb3704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:51.895575 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750e808-aae7-47fe-aeb2-71965ffb3704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:51.897117 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750e808-aae7-47fe-aeb2-71965ffb3704 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:51.916876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-4750e808-aae7-47fe-aeb2-71965ffb3704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:51.918337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 273/537] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:51.923838 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9967aff-3b06-4fc9-b525-e2969433cb07 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:52.046664 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9967aff-3b06-4fc9-b525-e2969433cb07 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:52.081313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d0093-d8e5-4f6b-a35f-38542893834c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:52.082170 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d0093-d8e5-4f6b-a35f-38542893834c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:52.082461 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d0093-d8e5-4f6b-a35f-38542893834c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:52.082746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d0093-d8e5-4f6b-a35f-38542893834c None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:52.083471 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d0093-d8e5-4f6b-a35f-38542893834c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:52.083779 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d0093-d8e5-4f6b-a35f-38542893834c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:52.085192 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d0093-d8e5-4f6b-a35f-38542893834c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:52.098550 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 265/538] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:52.104000 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750e808-aae7-47fe-aeb2-71965ffb3704 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:52.224051 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750e808-aae7-47fe-aeb2-71965ffb3704 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:52.272718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6416d3b-e20c-42a4-b16f-7d7a04cac96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:52.273548 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6416d3b-e20c-42a4-b16f-7d7a04cac96f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:52.273829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6416d3b-e20c-42a4-b16f-7d7a04cac96f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:52.274105 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6416d3b-e20c-42a4-b16f-7d7a04cac96f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:52.282465 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6416d3b-e20c-42a4-b16f-7d7a04cac96f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:52.283987 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6416d3b-e20c-42a4-b16f-7d7a04cac96f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:52.298665 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-e6416d3b-e20c-42a4-b16f-7d7a04cac96f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:52:52.299806 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 274/539] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:52.306294 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d0093-d8e5-4f6b-a35f-38542893834c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:52.408529 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d0093-d8e5-4f6b-a35f-38542893834c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:52.443383 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe721ce7-1d1b-4bb6-9cd0-d9428516eeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:52.444104 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe721ce7-1d1b-4bb6-9cd0-d9428516eeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:52.444385 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe721ce7-1d1b-4bb6-9cd0-d9428516eeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:52.444691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe721ce7-1d1b-4bb6-9cd0-d9428516eeb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:52.445517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe721ce7-1d1b-4bb6-9cd0-d9428516eeb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:52.445828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe721ce7-1d1b-4bb6-9cd0-d9428516eeb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:52.447334 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe721ce7-1d1b-4bb6-9cd0-d9428516eeb3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:52.460194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 266/540] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:52:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:52.466013 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6416d3b-e20c-42a4-b16f-7d7a04cac96f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:52.608225 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6416d3b-e20c-42a4-b16f-7d7a04cac96f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:52.656141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30523497-3021-4ed6-a443-954df852f617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:52.656817 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30523497-3021-4ed6-a443-954df852f617 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:52.657095 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30523497-3021-4ed6-a443-954df852f617 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:52.657425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30523497-3021-4ed6-a443-954df852f617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:52.658258 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30523497-3021-4ed6-a443-954df852f617 None admin] RBAC: Adding query filter params (role.id=22681aa004f8450f964af121fc87d40a, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=639126e5b13345cda6490073ec57f4c1) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:52.658569 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30523497-3021-4ed6-a443-954df852f617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:52.660622 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30523497-3021-4ed6-a443-954df852f617 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:52.669400 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 275/541] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:52 2022] GET /identity/v3/role_assignments?user.id=639126e5b13345cda6490073ec57f4c1&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=22681aa004f8450f964af121fc87d40a => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:52.927632 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd1f1a-db9c-4006-a6f8-7d474e22e590 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:52.927918 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd1f1a-db9c-4006-a6f8-7d474e22e590 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:52.928194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd1f1a-db9c-4006-a6f8-7d474e22e590 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:52.930269 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 267/542] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:52.935758 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded4976-063c-452b-a451-67dcf2c95c03 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:52.936051 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded4976-063c-452b-a451-67dcf2c95c03 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:52.936333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded4976-063c-452b-a451-67dcf2c95c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:52.954362 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9ded4976-063c-452b-a451-67dcf2c95c03 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:52.955556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9ded4976-063c-452b-a451-67dcf2c95c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:53.042948 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 276/543] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:53.078693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd1f1a-db9c-4006-a6f8-7d474e22e590 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:53.186506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd1f1a-db9c-4006-a6f8-7d474e22e590 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:53.222267 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80685dcf-fe43-4a5c-b50a-3f91a41767fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:53.223202 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80685dcf-fe43-4a5c-b50a-3f91a41767fa None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:53.223479 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80685dcf-fe43-4a5c-b50a-3f91a41767fa None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:53.223813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80685dcf-fe43-4a5c-b50a-3f91a41767fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:53.235599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80685dcf-fe43-4a5c-b50a-3f91a41767fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:53.244462 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-80685dcf-fe43-4a5c-b50a-3f91a41767fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:52:53.246400 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 268/544] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:52:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:53.251931 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded4976-063c-452b-a451-67dcf2c95c03 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:53.365665 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded4976-063c-452b-a451-67dcf2c95c03 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:53.414275 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8be45-5c99-4158-9757-8552df0220f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:53.414946 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8be45-5c99-4158-9757-8552df0220f4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:53.415271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8be45-5c99-4158-9757-8552df0220f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:53.415612 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8be45-5c99-4158-9757-8552df0220f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:53.416360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8be45-5c99-4158-9757-8552df0220f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:53.416717 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8be45-5c99-4158-9757-8552df0220f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:53.418116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8be45-5c99-4158-9757-8552df0220f4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:53.426577 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 277/545] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:52:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:53.433439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80685dcf-fe43-4a5c-b50a-3f91a41767fa None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:53.543514 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80685dcf-fe43-4a5c-b50a-3f91a41767fa None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:53.578240 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12358d16-2dae-4606-9417-6e1fcc8ef772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:53.579041 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12358d16-2dae-4606-9417-6e1fcc8ef772 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:53.579324 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12358d16-2dae-4606-9417-6e1fcc8ef772 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:53.579603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12358d16-2dae-4606-9417-6e1fcc8ef772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:53.591530 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12358d16-2dae-4606-9417-6e1fcc8ef772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:53.593031 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12358d16-2dae-4606-9417-6e1fcc8ef772 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:53.610626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-12358d16-2dae-4606-9417-6e1fcc8ef772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:53.612022 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 269/546] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:53.617606 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8be45-5c99-4158-9757-8552df0220f4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:53.743092 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8be45-5c99-4158-9757-8552df0220f4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:53.788270 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b69836-c72a-4cef-a1a8-270131404cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:53.789027 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b69836-c72a-4cef-a1a8-270131404cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:53.789312 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b69836-c72a-4cef-a1a8-270131404cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:53.789656 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b69836-c72a-4cef-a1a8-270131404cc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:53.790402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b69836-c72a-4cef-a1a8-270131404cc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:53.790712 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b69836-c72a-4cef-a1a8-270131404cc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:53.792150 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b69836-c72a-4cef-a1a8-270131404cc9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:53.814323 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 278/547] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:53.820546 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12358d16-2dae-4606-9417-6e1fcc8ef772 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:53.929329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12358d16-2dae-4606-9417-6e1fcc8ef772 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:53.964126 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287526e5-9707-45e7-b0e2-616e2ccdd3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:53.965009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287526e5-9707-45e7-b0e2-616e2ccdd3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:53.965297 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287526e5-9707-45e7-b0e2-616e2ccdd3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:53.965575 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287526e5-9707-45e7-b0e2-616e2ccdd3a0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:53.978885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287526e5-9707-45e7-b0e2-616e2ccdd3a0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:53.980385 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287526e5-9707-45e7-b0e2-616e2ccdd3a0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:54.001100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-287526e5-9707-45e7-b0e2-616e2ccdd3a0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:52:54.002706 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 270/548] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:52:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:54.009901 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b69836-c72a-4cef-a1a8-270131404cc9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:54.131086 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b69836-c72a-4cef-a1a8-270131404cc9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:54.173985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38241a10-1730-498b-87f7-6d2868b23448 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:54.174295 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38241a10-1730-498b-87f7-6d2868b23448 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:54.174536 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38241a10-1730-498b-87f7-6d2868b23448 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:54.176484 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 271/549] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:52:54.178863 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bb856-1411-4244-841c-0556f35d3c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:54.179537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb856-1411-4244-841c-0556f35d3c46 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:54.179816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb856-1411-4244-841c-0556f35d3c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:54.180091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bb856-1411-4244-841c-0556f35d3c46 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:54.181031 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bb856-1411-4244-841c-0556f35d3c46 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:54.181340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bb856-1411-4244-841c-0556f35d3c46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:54.181648 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf3705-3425-413d-b6c9-6adfaeb21a20 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:54.181936 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf3705-3425-413d-b6c9-6adfaeb21a20 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:54.182212 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf3705-3425-413d-b6c9-6adfaeb21a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:54.182783 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7bb856-1411-4244-841c-0556f35d3c46 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:54.203059 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 279/550] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Sep 27 04:52:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:54.208991 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bb856-1411-4244-841c-0556f35d3c46 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:54.213832 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-caaf3705-3425-413d-b6c9-6adfaeb21a20 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:54.219371 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-caaf3705-3425-413d-b6c9-6adfaeb21a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:54.305002 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 272/551] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:54.306397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3e9bf-13fa-4f73-918b-173c8242b96e None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:54.306687 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3e9bf-13fa-4f73-918b-173c8242b96e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:54.306968 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3e9bf-13fa-4f73-918b-173c8242b96e None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:54.310138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 273/552] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:54.325713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224e7bf-23e5-45e8-913f-f7b1ff273603 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:54.326045 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224e7bf-23e5-45e8-913f-f7b1ff273603 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:54.326280 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224e7bf-23e5-45e8-913f-f7b1ff273603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:54.346327 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2224e7bf-23e5-45e8-913f-f7b1ff273603 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:54.348038 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2224e7bf-23e5-45e8-913f-f7b1ff273603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:54.371125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bb856-1411-4244-841c-0556f35d3c46 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:54.417506 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a1615-668b-4db8-b96e-6961374edf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:54.418139 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a1615-668b-4db8-b96e-6961374edf51 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:54.418426 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a1615-668b-4db8-b96e-6961374edf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:54.418705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a1615-668b-4db8-b96e-6961374edf51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:54.424933 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 274/553] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:54.425948 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224e7bf-23e5-45e8-913f-f7b1ff273603 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:54.513895 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a1615-668b-4db8-b96e-6961374edf51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:54.516423 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a1615-668b-4db8-b96e-6961374edf51 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:54.551876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224e7bf-23e5-45e8-913f-f7b1ff273603 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:54.593656 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3c4b4-7192-4233-b5f1-0c7ab407574e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:54.594815 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3c4b4-7192-4233-b5f1-0c7ab407574e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:54.595108 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3c4b4-7192-4233-b5f1-0c7ab407574e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:54.595648 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3c4b4-7192-4233-b5f1-0c7ab407574e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:54.608519 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3c4b4-7192-4233-b5f1-0c7ab407574e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:54.616667 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 280/554] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:52:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 04:52:54.617603 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a1615-668b-4db8-b96e-6961374edf51 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:54.617823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-3ca3c4b4-7192-4233-b5f1-0c7ab407574e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:52:54.621077 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 275/555] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:52:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:54.622772 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3c4b4-7192-4233-b5f1-0c7ab407574e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:54.721605 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a1615-668b-4db8-b96e-6961374edf51 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:54.730681 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3c4b4-7192-4233-b5f1-0c7ab407574e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:54.758037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890fdfb-f941-42a8-9fb4-1f801e08e113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:54.758887 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890fdfb-f941-42a8-9fb4-1f801e08e113 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:54.759172 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890fdfb-f941-42a8-9fb4-1f801e08e113 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:54.759445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890fdfb-f941-42a8-9fb4-1f801e08e113 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:54.765813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaf4de-917a-4de1-a465-764bc2a72f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:54.766609 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf4de-917a-4de1-a465-764bc2a72f0a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:54.766889 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf4de-917a-4de1-a465-764bc2a72f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:54.767164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf4de-917a-4de1-a465-764bc2a72f0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:54.770553 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890fdfb-f941-42a8-9fb4-1f801e08e113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:54.777755 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-e890fdfb-f941-42a8-9fb4-1f801e08e113 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:52:54.778662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdaf4de-917a-4de1-a465-764bc2a72f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:54.779310 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 281/556] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:52:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:54.780136 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdaf4de-917a-4de1-a465-764bc2a72f0a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:54.780310 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890fdfb-f941-42a8-9fb4-1f801e08e113 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:54.802448 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-ebdaf4de-917a-4de1-a465-764bc2a72f0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:54.803923 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 276/557] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:54.804892 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab2ace-ae86-496d-918f-78adbd150c33 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:54.805179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab2ace-ae86-496d-918f-78adbd150c33 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:54.805465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab2ace-ae86-496d-918f-78adbd150c33 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:54.810204 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 277/558] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:54.810204 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab2ace-ae86-496d-918f-78adbd150c33 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:54.888365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890fdfb-f941-42a8-9fb4-1f801e08e113 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:54.914752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab2ace-ae86-496d-918f-78adbd150c33 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:54.921550 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32de32-41c5-441b-b82a-ee317655bbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:54.922207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32de32-41c5-441b-b82a-ee317655bbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:54.922512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32de32-41c5-441b-b82a-ee317655bbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:54.922789 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32de32-41c5-441b-b82a-ee317655bbe5 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:54.923527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32de32-41c5-441b-b82a-ee317655bbe5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:54.923833 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32de32-41c5-441b-b82a-ee317655bbe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:54.925249 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32de32-41c5-441b-b82a-ee317655bbe5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:54.933669 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 282/559] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:52:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:54.934452 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32de32-41c5-441b-b82a-ee317655bbe5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:54.955520 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419da86-9993-4e37-be5e-58eb3c426cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:54.956446 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419da86-9993-4e37-be5e-58eb3c426cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:54.957014 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419da86-9993-4e37-be5e-58eb3c426cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:54.957621 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419da86-9993-4e37-be5e-58eb3c426cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:54.958505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419da86-9993-4e37-be5e-58eb3c426cf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:54.958950 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419da86-9993-4e37-be5e-58eb3c426cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:54.960534 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419da86-9993-4e37-be5e-58eb3c426cf6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:54.969721 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 278/560] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:52:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:54.971128 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e91b66-2dd9-46f4-b0f6-50c72030dbb1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:54.971541 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e91b66-2dd9-46f4-b0f6-50c72030dbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:54.971996 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e91b66-2dd9-46f4-b0f6-50c72030dbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:54.991835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-17e91b66-2dd9-46f4-b0f6-50c72030dbb1 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:54.993139 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-17e91b66-2dd9-46f4-b0f6-50c72030dbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:55.040847 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32de32-41c5-441b-b82a-ee317655bbe5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:55.060888 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 279/561] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:55.060888 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e91b66-2dd9-46f4-b0f6-50c72030dbb1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:55.084757 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f89ba-744b-4fcb-8f6a-dd6f0ee4bde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:55.085576 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f89ba-744b-4fcb-8f6a-dd6f0ee4bde2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:55.085766 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f89ba-744b-4fcb-8f6a-dd6f0ee4bde2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:55.086008 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f89ba-744b-4fcb-8f6a-dd6f0ee4bde2 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:55.086727 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f89ba-744b-4fcb-8f6a-dd6f0ee4bde2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:55.087034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f89ba-744b-4fcb-8f6a-dd6f0ee4bde2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:55.088405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f89ba-744b-4fcb-8f6a-dd6f0ee4bde2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:55.100772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 283/562] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:55.101617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f89ba-744b-4fcb-8f6a-dd6f0ee4bde2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:55.164630 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e91b66-2dd9-46f4-b0f6-50c72030dbb1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:55.201009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f27ad-e56f-402b-bda6-a8ee98b768eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:55.201813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f27ad-e56f-402b-bda6-a8ee98b768eb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:55.201976 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f89ba-744b-4fcb-8f6a-dd6f0ee4bde2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:55.202073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f27ad-e56f-402b-bda6-a8ee98b768eb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:55.202354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f27ad-e56f-402b-bda6-a8ee98b768eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:55.213956 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f27ad-e56f-402b-bda6-a8ee98b768eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:55.215419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f27ad-e56f-402b-bda6-a8ee98b768eb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:55.231832 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-b17f27ad-e56f-402b-bda6-a8ee98b768eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:55.232991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 280/563] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:55.233759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f27ad-e56f-402b-bda6-a8ee98b768eb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:55.241435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90431da2-0851-4696-a660-fc039be47187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:55.242232 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90431da2-0851-4696-a660-fc039be47187 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:55.242517 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90431da2-0851-4696-a660-fc039be47187 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:55.242792 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90431da2-0851-4696-a660-fc039be47187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:55.253476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90431da2-0851-4696-a660-fc039be47187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:55.255611 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90431da2-0851-4696-a660-fc039be47187 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:55.272527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-90431da2-0851-4696-a660-fc039be47187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:55.273729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 284/564] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:55.274506 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90431da2-0851-4696-a660-fc039be47187 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:55.333857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f27ad-e56f-402b-bda6-a8ee98b768eb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:55.367615 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3a656-5b82-4535-ae96-24dd1c06be0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:55.368753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3a656-5b82-4535-ae96-24dd1c06be0f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:55.369309 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3a656-5b82-4535-ae96-24dd1c06be0f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:55.369779 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3a656-5b82-4535-ae96-24dd1c06be0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:55.373740 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90431da2-0851-4696-a660-fc039be47187 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:55.382073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3a656-5b82-4535-ae96-24dd1c06be0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:55.389383 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-b7d3a656-5b82-4535-ae96-24dd1c06be0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:52:55.390817 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 281/565] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:52:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:55.391779 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3a656-5b82-4535-ae96-24dd1c06be0f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:55.414069 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef1003-4651-4414-b047-bc3e2ca4b864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:55.414863 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef1003-4651-4414-b047-bc3e2ca4b864 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:55.415144 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef1003-4651-4414-b047-bc3e2ca4b864 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:55.415420 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef1003-4651-4414-b047-bc3e2ca4b864 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:55.422224 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef1003-4651-4414-b047-bc3e2ca4b864 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:55.423673 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef1003-4651-4414-b047-bc3e2ca4b864 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:55.437257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-ceef1003-4651-4414-b047-bc3e2ca4b864 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:52:55.443765 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 285/566] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:55.443765 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef1003-4651-4414-b047-bc3e2ca4b864 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:55.494482 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3a656-5b82-4535-ae96-24dd1c06be0f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:55.529325 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5732ef7-9612-4032-9ab7-176053c92332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:55.529989 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732ef7-9612-4032-9ab7-176053c92332 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:55.530270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732ef7-9612-4032-9ab7-176053c92332 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:55.530550 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5732ef7-9612-4032-9ab7-176053c92332 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:55.531298 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5732ef7-9612-4032-9ab7-176053c92332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:55.531610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5732ef7-9612-4032-9ab7-176053c92332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:55.533027 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5732ef7-9612-4032-9ab7-176053c92332 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:55.544640 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 282/567] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:55.545468 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5732ef7-9612-4032-9ab7-176053c92332 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:55.546376 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef1003-4651-4414-b047-bc3e2ca4b864 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:55.581490 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3da60-f3e5-40bb-96e7-ac1ec348017b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:55.582210 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3da60-f3e5-40bb-96e7-ac1ec348017b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:55.582486 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3da60-f3e5-40bb-96e7-ac1ec348017b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:55.582755 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3da60-f3e5-40bb-96e7-ac1ec348017b None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:55.583461 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3da60-f3e5-40bb-96e7-ac1ec348017b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:55.583758 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3da60-f3e5-40bb-96e7-ac1ec348017b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:55.585158 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3da60-f3e5-40bb-96e7-ac1ec348017b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:55.601453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 286/568] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:55.601453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3da60-f3e5-40bb-96e7-ac1ec348017b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:55.639985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5732ef7-9612-4032-9ab7-176053c92332 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:55.672068 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8837569-bccc-4372-adaf-5748e9c836a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:55.672735 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8837569-bccc-4372-adaf-5748e9c836a7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:55.673043 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8837569-bccc-4372-adaf-5748e9c836a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:55.673320 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8837569-bccc-4372-adaf-5748e9c836a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:55.674072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8837569-bccc-4372-adaf-5748e9c836a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:55.674379 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8837569-bccc-4372-adaf-5748e9c836a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:55.676390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8837569-bccc-4372-adaf-5748e9c836a7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:55.684286 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 283/569] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:52:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:55.685532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7789f0a-f5cf-4ccb-8365-19325ab54f7d None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:55.685819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7789f0a-f5cf-4ccb-8365-19325ab54f7d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:55.686098 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7789f0a-f5cf-4ccb-8365-19325ab54f7d None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:55.691286 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 284/570] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:52:55.691286 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7789f0a-f5cf-4ccb-8365-19325ab54f7d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:55.700782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3da60-f3e5-40bb-96e7-ac1ec348017b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:55.733468 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c259424-c4e2-45db-b8fe-458f71da0e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:55.734122 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c259424-c4e2-45db-b8fe-458f71da0e0a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:55.734404 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c259424-c4e2-45db-b8fe-458f71da0e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:55.734677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c259424-c4e2-45db-b8fe-458f71da0e0a None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:55.735462 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c259424-c4e2-45db-b8fe-458f71da0e0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:55.735767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c259424-c4e2-45db-b8fe-458f71da0e0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:55.737225 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c259424-c4e2-45db-b8fe-458f71da0e0a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:55.749476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 287/571] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:52:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:55.750215 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c259424-c4e2-45db-b8fe-458f71da0e0a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:55.792863 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7789f0a-f5cf-4ccb-8365-19325ab54f7d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:55.824599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57135b-154b-4df3-97e2-0469cc175482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:55.825413 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57135b-154b-4df3-97e2-0469cc175482 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:55.825694 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57135b-154b-4df3-97e2-0469cc175482 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:55.825970 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57135b-154b-4df3-97e2-0469cc175482 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:55.833256 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57135b-154b-4df3-97e2-0469cc175482 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:55.834699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57135b-154b-4df3-97e2-0469cc175482 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:55.843397 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c259424-c4e2-45db-b8fe-458f71da0e0a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:55.848385 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-2d57135b-154b-4df3-97e2-0469cc175482 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 27 04:52:55.849573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 285/572] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:55.850342 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57135b-154b-4df3-97e2-0469cc175482 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:55.876066 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441fcae-9943-46ee-99d7-ce268d7922e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:55.876970 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441fcae-9943-46ee-99d7-ce268d7922e0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:55.877252 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441fcae-9943-46ee-99d7-ce268d7922e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:55.877524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441fcae-9943-46ee-99d7-ce268d7922e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:55.885700 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441fcae-9943-46ee-99d7-ce268d7922e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:55.887146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441fcae-9943-46ee-99d7-ce268d7922e0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:55.900380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-a441fcae-9943-46ee-99d7-ce268d7922e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:52:55.901567 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 288/573] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 27 04:52:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:55.902713 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ada5-2b66-4e8f-b38a-85e7d2b04347 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:55.903000 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ada5-2b66-4e8f-b38a-85e7d2b04347 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:55.903279 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ada5-2b66-4e8f-b38a-85e7d2b04347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:55.919653 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-74a4ada5-2b66-4e8f-b38a-85e7d2b04347 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:55.920881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-74a4ada5-2b66-4e8f-b38a-85e7d2b04347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:55.949699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57135b-154b-4df3-97e2-0469cc175482 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:55.981431 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75581af-9c9d-4c46-b197-937cdc5f028c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:55.982218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75581af-9c9d-4c46-b197-937cdc5f028c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:55.982494 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75581af-9c9d-4c46-b197-937cdc5f028c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:55.982763 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75581af-9c9d-4c46-b197-937cdc5f028c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:55.984766 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 289/574] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:52:55.985612 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4ada5-2b66-4e8f-b38a-85e7d2b04347 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:55.993359 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75581af-9c9d-4c46-b197-937cdc5f028c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:55.994806 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75581af-9c9d-4c46-b197-937cdc5f028c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:56.022314 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-c75581af-9c9d-4c46-b197-937cdc5f028c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:56.023434 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 286/575] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:56.024191 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75581af-9c9d-4c46-b197-937cdc5f028c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:56.084860 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4ada5-2b66-4e8f-b38a-85e7d2b04347 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:56.116551 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75581af-9c9d-4c46-b197-937cdc5f028c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:56.116747 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f482a1-e133-45b5-8b9b-be6a16c2f3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:56.117269 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f482a1-e133-45b5-8b9b-be6a16c2f3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:56.117545 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f482a1-e133-45b5-8b9b-be6a16c2f3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:56.117813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f482a1-e133-45b5-8b9b-be6a16c2f3b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:56.118629 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f482a1-e133-45b5-8b9b-be6a16c2f3b5 None admin] RBAC: Adding query filter params (role.id=22681aa004f8450f964af121fc87d40a, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=bfea15b51919441b921c10d02d11f693) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:56.118932 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f482a1-e133-45b5-8b9b-be6a16c2f3b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:56.120356 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f482a1-e133-45b5-8b9b-be6a16c2f3b5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:56.125780 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 290/576] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:52:55 2022] GET /identity/v3/role_assignments?user.id=bfea15b51919441b921c10d02d11f693&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=22681aa004f8450f964af121fc87d40a => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:56.126537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f482a1-e133-45b5-8b9b-be6a16c2f3b5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:56.152072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dad0d4-9b4a-43a4-99d6-e29d1da95b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:56.152758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dad0d4-9b4a-43a4-99d6-e29d1da95b9c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:56.153073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dad0d4-9b4a-43a4-99d6-e29d1da95b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:56.153346 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dad0d4-9b4a-43a4-99d6-e29d1da95b9c None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:56.154197 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dad0d4-9b4a-43a4-99d6-e29d1da95b9c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:56.154525 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dad0d4-9b4a-43a4-99d6-e29d1da95b9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:56.156008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dad0d4-9b4a-43a4-99d6-e29d1da95b9c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:56.175995 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 287/577] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Sep 27 04:52:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:56.177019 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dad0d4-9b4a-43a4-99d6-e29d1da95b9c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:56.251290 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f482a1-e133-45b5-8b9b-be6a16c2f3b5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:56.283661 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dad0d4-9b4a-43a4-99d6-e29d1da95b9c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:56.286711 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87579918-d5fc-4880-8b8b-b171cfb76b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:56.287396 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87579918-d5fc-4880-8b8b-b171cfb76b8a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:56.287676 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87579918-d5fc-4880-8b8b-b171cfb76b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:56.287947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87579918-d5fc-4880-8b8b-b171cfb76b8a None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:56.288817 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87579918-d5fc-4880-8b8b-b171cfb76b8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:56.289135 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87579918-d5fc-4880-8b8b-b171cfb76b8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:56.290598 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87579918-d5fc-4880-8b8b-b171cfb76b8a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:56.309441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 291/578] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 27 04:52:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:56.310280 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87579918-d5fc-4880-8b8b-b171cfb76b8a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:56.320513 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac9369-3cf7-4817-9b16-a865b9f07b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:56.321339 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac9369-3cf7-4817-9b16-a865b9f07b10 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:56.321620 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac9369-3cf7-4817-9b16-a865b9f07b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:56.321894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac9369-3cf7-4817-9b16-a865b9f07b10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:56.332249 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac9369-3cf7-4817-9b16-a865b9f07b10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:56.339286 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-37ac9369-3cf7-4817-9b16-a865b9f07b10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:52:56.345213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 288/579] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:52:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:56.345213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac9369-3cf7-4817-9b16-a865b9f07b10 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:56.408530 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87579918-d5fc-4880-8b8b-b171cfb76b8a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:56.442733 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a8342-c61e-48fc-b366-22cf715c9e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:56.443094 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac9369-3cf7-4817-9b16-a865b9f07b10 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:56.443390 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a8342-c61e-48fc-b366-22cf715c9e48 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:56.443670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a8342-c61e-48fc-b366-22cf715c9e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:56.443942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a8342-c61e-48fc-b366-22cf715c9e48 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:56.444658 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a8342-c61e-48fc-b366-22cf715c9e48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:56.444989 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a8342-c61e-48fc-b366-22cf715c9e48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:56.446367 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a8342-c61e-48fc-b366-22cf715c9e48 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:56.457741 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 292/580] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:56.458844 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a8342-c61e-48fc-b366-22cf715c9e48 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:56.476486 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e65bc0-f0a2-4c80-8f63-9c0531a77c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:56.477325 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e65bc0-f0a2-4c80-8f63-9c0531a77c5c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:56.477603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e65bc0-f0a2-4c80-8f63-9c0531a77c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:56.477875 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e65bc0-f0a2-4c80-8f63-9c0531a77c5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:56.489532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e65bc0-f0a2-4c80-8f63-9c0531a77c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:56.490994 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e65bc0-f0a2-4c80-8f63-9c0531a77c5c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:56.508471 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-75e65bc0-f0a2-4c80-8f63-9c0531a77c5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:56.509854 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 289/581] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:56.510453 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e65bc0-f0a2-4c80-8f63-9c0531a77c5c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:56.562303 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a8342-c61e-48fc-b366-22cf715c9e48 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:56.594611 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d4ec2-8bae-49fb-850e-cb371a877757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:56.595404 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d4ec2-8bae-49fb-850e-cb371a877757 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:56.595686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d4ec2-8bae-49fb-850e-cb371a877757 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:56.595961 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d4ec2-8bae-49fb-850e-cb371a877757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:56.606791 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e65bc0-f0a2-4c80-8f63-9c0531a77c5c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:56.607070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d4ec2-8bae-49fb-850e-cb371a877757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:56.608529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d4ec2-8bae-49fb-850e-cb371a877757 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:56.625698 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-cb7d4ec2-8bae-49fb-850e-cb371a877757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:56.631833 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 293/582] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:56.631833 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d4ec2-8bae-49fb-850e-cb371a877757 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:56.646002 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aef3b2-54dc-44e6-812c-9aa425ff904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:56.646677 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aef3b2-54dc-44e6-812c-9aa425ff904c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:56.646959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aef3b2-54dc-44e6-812c-9aa425ff904c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:56.647236 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aef3b2-54dc-44e6-812c-9aa425ff904c None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:56.647983 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aef3b2-54dc-44e6-812c-9aa425ff904c None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:56.648291 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aef3b2-54dc-44e6-812c-9aa425ff904c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:56.649707 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aef3b2-54dc-44e6-812c-9aa425ff904c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:56.663174 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 290/583] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:52:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:56.663174 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aef3b2-54dc-44e6-812c-9aa425ff904c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:56.723813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d4ec2-8bae-49fb-850e-cb371a877757 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:56.758406 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aef3b2-54dc-44e6-812c-9aa425ff904c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:56.758611 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b3e57-0dd7-4e8e-a204-d4b4a200b6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:56.759279 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b3e57-0dd7-4e8e-a204-d4b4a200b6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:56.759558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b3e57-0dd7-4e8e-a204-d4b4a200b6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:56.759831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b3e57-0dd7-4e8e-a204-d4b4a200b6c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:56.767172 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b3e57-0dd7-4e8e-a204-d4b4a200b6c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:56.768609 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b3e57-0dd7-4e8e-a204-d4b4a200b6c4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:56.782370 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-a59b3e57-0dd7-4e8e-a204-d4b4a200b6c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 04:52:56.783549 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 294/584] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:52:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:56.785971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b3e57-0dd7-4e8e-a204-d4b4a200b6c4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:56.793198 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec26bff-7a7b-4f88-95e5-f8305872564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:56.793867 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec26bff-7a7b-4f88-95e5-f8305872564b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:56.794148 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec26bff-7a7b-4f88-95e5-f8305872564b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:56.794422 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec26bff-7a7b-4f88-95e5-f8305872564b None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:56.795148 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec26bff-7a7b-4f88-95e5-f8305872564b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:56.795452 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec26bff-7a7b-4f88-95e5-f8305872564b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:56.796831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec26bff-7a7b-4f88-95e5-f8305872564b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:56.814889 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 291/585] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:56.814889 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec26bff-7a7b-4f88-95e5-f8305872564b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:56.884377 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b3e57-0dd7-4e8e-a204-d4b4a200b6c4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:56.912100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec26bff-7a7b-4f88-95e5-f8305872564b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:56.918779 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c721802-d04d-4240-b9ba-1415f426b24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:56.919581 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c721802-d04d-4240-b9ba-1415f426b24e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:56.919916 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c721802-d04d-4240-b9ba-1415f426b24e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:56.920250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c721802-d04d-4240-b9ba-1415f426b24e None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:56.921063 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c721802-d04d-4240-b9ba-1415f426b24e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:56.921429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c721802-d04d-4240-b9ba-1415f426b24e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:56.922859 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c721802-d04d-4240-b9ba-1415f426b24e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:56.935537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 295/586] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:56.936358 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c721802-d04d-4240-b9ba-1415f426b24e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:56.952697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d2644-f13a-4e68-a5db-910bbe0ce497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:56.953685 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d2644-f13a-4e68-a5db-910bbe0ce497 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:56.954062 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d2644-f13a-4e68-a5db-910bbe0ce497 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:56.954435 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d2644-f13a-4e68-a5db-910bbe0ce497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:56.965328 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d2644-f13a-4e68-a5db-910bbe0ce497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:56.966881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d2644-f13a-4e68-a5db-910bbe0ce497 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:56.986187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-834d2644-f13a-4e68-a5db-910bbe0ce497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:56.996155 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 292/587] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:56.996155 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d2644-f13a-4e68-a5db-910bbe0ce497 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:57.036450 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c721802-d04d-4240-b9ba-1415f426b24e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:57.073320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2754e-9af6-40d4-8998-c9228fae3155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:57.073910 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2754e-9af6-40d4-8998-c9228fae3155 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:57.074189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2754e-9af6-40d4-8998-c9228fae3155 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:57.074463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2754e-9af6-40d4-8998-c9228fae3155 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:57.075290 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2754e-9af6-40d4-8998-c9228fae3155 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:57.075593 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2754e-9af6-40d4-8998-c9228fae3155 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:57.077101 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2754e-9af6-40d4-8998-c9228fae3155 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:57.093511 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 296/588] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Sep 27 04:52:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:57.094308 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2754e-9af6-40d4-8998-c9228fae3155 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:57.095674 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d2644-f13a-4e68-a5db-910bbe0ce497 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:57.132679 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78cd2-5f05-42d6-b25a-41ea2d5f8580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:57.133665 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78cd2-5f05-42d6-b25a-41ea2d5f8580 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:57.134046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78cd2-5f05-42d6-b25a-41ea2d5f8580 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:57.134423 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a78cd2-5f05-42d6-b25a-41ea2d5f8580 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:57.141603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a78cd2-5f05-42d6-b25a-41ea2d5f8580 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:57.142955 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a78cd2-5f05-42d6-b25a-41ea2d5f8580 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:57.156386 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-e5a78cd2-5f05-42d6-b25a-41ea2d5f8580 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:52:57.163139 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 293/589] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:57.163139 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78cd2-5f05-42d6-b25a-41ea2d5f8580 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:57.202125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2754e-9af6-40d4-8998-c9228fae3155 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:57.236076 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3821f8-0209-4cdb-997d-1c9b18dbcf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:57.236509 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3821f8-0209-4cdb-997d-1c9b18dbcf10 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:57.236807 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3821f8-0209-4cdb-997d-1c9b18dbcf10 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:57.237088 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3821f8-0209-4cdb-997d-1c9b18dbcf10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:57.244038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3821f8-0209-4cdb-997d-1c9b18dbcf10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:57.245362 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3821f8-0209-4cdb-997d-1c9b18dbcf10 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:57.259490 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-af3821f8-0209-4cdb-997d-1c9b18dbcf10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:52:57.260684 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 297/590] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:57.261554 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3821f8-0209-4cdb-997d-1c9b18dbcf10 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:57.265562 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a78cd2-5f05-42d6-b25a-41ea2d5f8580 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:57.300431 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721db3b5-eaa0-455c-9c43-4e7bc6a5c26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:57.301999 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721db3b5-eaa0-455c-9c43-4e7bc6a5c26d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:57.302353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721db3b5-eaa0-455c-9c43-4e7bc6a5c26d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:57.302642 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721db3b5-eaa0-455c-9c43-4e7bc6a5c26d None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:57.303365 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721db3b5-eaa0-455c-9c43-4e7bc6a5c26d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:57.303673 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721db3b5-eaa0-455c-9c43-4e7bc6a5c26d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:57.305070 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721db3b5-eaa0-455c-9c43-4e7bc6a5c26d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:57.316542 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 294/591] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:57.317429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721db3b5-eaa0-455c-9c43-4e7bc6a5c26d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:57.371569 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3821f8-0209-4cdb-997d-1c9b18dbcf10 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:57.403852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be50fa6-5763-495d-8ba4-e2c10ae5aaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:57.404954 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be50fa6-5763-495d-8ba4-e2c10ae5aaa4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:57.405429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be50fa6-5763-495d-8ba4-e2c10ae5aaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:57.405894 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be50fa6-5763-495d-8ba4-e2c10ae5aaa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:57.413918 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721db3b5-eaa0-455c-9c43-4e7bc6a5c26d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:57.417341 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be50fa6-5763-495d-8ba4-e2c10ae5aaa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:57.419297 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be50fa6-5763-495d-8ba4-e2c10ae5aaa4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:57.435943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-9be50fa6-5763-495d-8ba4-e2c10ae5aaa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:57.441943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 298/592] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:57.441943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be50fa6-5763-495d-8ba4-e2c10ae5aaa4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:57.447662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248051f8-e8a2-40ed-a4f1-82ac192a327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:57.448328 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248051f8-e8a2-40ed-a4f1-82ac192a327f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:57.448610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248051f8-e8a2-40ed-a4f1-82ac192a327f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:57.448910 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248051f8-e8a2-40ed-a4f1-82ac192a327f None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:57.450048 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248051f8-e8a2-40ed-a4f1-82ac192a327f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:57.450048 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248051f8-e8a2-40ed-a4f1-82ac192a327f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:57.451423 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248051f8-e8a2-40ed-a4f1-82ac192a327f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:57.468302 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 295/593] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:52:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:57.468302 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248051f8-e8a2-40ed-a4f1-82ac192a327f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:57.539984 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be50fa6-5763-495d-8ba4-e2c10ae5aaa4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:57.565591 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248051f8-e8a2-40ed-a4f1-82ac192a327f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:57.573355 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcbc31-8a5b-4631-834e-674a0a410436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:57.574062 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcbc31-8a5b-4631-834e-674a0a410436 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:57.574343 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcbc31-8a5b-4631-834e-674a0a410436 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:57.574612 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcbc31-8a5b-4631-834e-674a0a410436 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:57.575385 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcbc31-8a5b-4631-834e-674a0a410436 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:57.575691 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcbc31-8a5b-4631-834e-674a0a410436 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:57.577144 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcbc31-8a5b-4631-834e-674a0a410436 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:57.589849 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 299/594] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:52:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:57.590648 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcbc31-8a5b-4631-834e-674a0a410436 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:57.604704 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d3005-5b6f-4a4f-891c-efeb77e41b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:57.605532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d3005-5b6f-4a4f-891c-efeb77e41b42 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:57.605812 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d3005-5b6f-4a4f-891c-efeb77e41b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:57.606090 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d3005-5b6f-4a4f-891c-efeb77e41b42 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:57.614137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d3005-5b6f-4a4f-891c-efeb77e41b42 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:57.615569 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d3005-5b6f-4a4f-891c-efeb77e41b42 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:57.629266 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-a14d3005-5b6f-4a4f-891c-efeb77e41b42 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 04:52:57.635091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 296/595] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:52:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:57.635091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d3005-5b6f-4a4f-891c-efeb77e41b42 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:57.692707 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcbc31-8a5b-4631-834e-674a0a410436 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:57.727519 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c65550-b509-4b91-ab9b-cf6a3c0c938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:57.728179 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c65550-b509-4b91-ab9b-cf6a3c0c938f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:57.728460 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c65550-b509-4b91-ab9b-cf6a3c0c938f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:57.728733 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c65550-b509-4b91-ab9b-cf6a3c0c938f None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:57.729461 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c65550-b509-4b91-ab9b-cf6a3c0c938f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:57.729765 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c65550-b509-4b91-ab9b-cf6a3c0c938f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:57.730834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d3005-5b6f-4a4f-891c-efeb77e41b42 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:57.731142 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c65550-b509-4b91-ab9b-cf6a3c0c938f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:57.743250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 300/596] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:57.744338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c65550-b509-4b91-ab9b-cf6a3c0c938f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:57.768629 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6109d-79b6-457b-b471-dd11d31e30c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:57.770285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6109d-79b6-457b-b471-dd11d31e30c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:57.770711 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6109d-79b6-457b-b471-dd11d31e30c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:57.770988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6109d-79b6-457b-b471-dd11d31e30c5 None admin] PATH_INFO: `/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/93e04bf8c51c4d89bbb45e96223e7409/roles/22681aa004f8450f964af121fc87d40a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:57.785630 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6109d-79b6-457b-b471-dd11d31e30c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=470fa8cf5f4a443faea9cfc628ff6003, user_id=93e04bf8c51c4d89bbb45e96223e7409, role_id=22681aa004f8450f964af121fc87d40a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:57.790183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6109d-79b6-457b-b471-dd11d31e30c5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:57.807606 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 297/597] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:52:57 2022] PUT /identity/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/93e04bf8c51c4d89bbb45e96223e7409/roles/22681aa004f8450f964af121fc87d40a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:52:57.808552 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6109d-79b6-457b-b471-dd11d31e30c5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:57.860221 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c65550-b509-4b91-ab9b-cf6a3c0c938f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:57.905864 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d85181-0615-4bad-aea1-17298afc88bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:57.906674 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d85181-0615-4bad-aea1-17298afc88bb None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:57.906947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d85181-0615-4bad-aea1-17298afc88bb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:57.907216 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d85181-0615-4bad-aea1-17298afc88bb None admin] PATH_INFO: `/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/faac84ed9d37420c811bbf6ac7df0b35/roles/22681aa004f8450f964af121fc87d40a` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:57.923675 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d85181-0615-4bad-aea1-17298afc88bb None admin] RBAC: Authorizing `identity:create_grant(project_id=470fa8cf5f4a443faea9cfc628ff6003, user_id=faac84ed9d37420c811bbf6ac7df0b35, role_id=22681aa004f8450f964af121fc87d40a)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:57.925254 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d85181-0615-4bad-aea1-17298afc88bb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:57.939946 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6109d-79b6-457b-b471-dd11d31e30c5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:57.946224 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 301/598] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:52:57 2022] PUT /identity/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/faac84ed9d37420c811bbf6ac7df0b35/roles/22681aa004f8450f964af121fc87d40a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:52:57.947176 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d85181-0615-4bad-aea1-17298afc88bb None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:57.996361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa71955-86b4-488e-b154-edabe283247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:57.996361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa71955-86b4-488e-b154-edabe283247b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:57.996361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa71955-86b4-488e-b154-edabe283247b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:57.996361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa71955-86b4-488e-b154-edabe283247b None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:57.996778 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa71955-86b4-488e-b154-edabe283247b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:57.997123 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa71955-86b4-488e-b154-edabe283247b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:57.999784 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa71955-86b4-488e-b154-edabe283247b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:58.027082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 298/599] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Sep 27 04:52:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:58.033747 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa71955-86b4-488e-b154-edabe283247b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:58.083992 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d85181-0615-4bad-aea1-17298afc88bb None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:58.121415 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf3afa-a5a5-4e15-a0cb-b0be50f383e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:58.122228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf3afa-a5a5-4e15-a0cb-b0be50f383e8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:58.122509 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf3afa-a5a5-4e15-a0cb-b0be50f383e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:58.122782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf3afa-a5a5-4e15-a0cb-b0be50f383e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:58.131042 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf3afa-a5a5-4e15-a0cb-b0be50f383e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:58.132578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaf3afa-a5a5-4e15-a0cb-b0be50f383e8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:58.142823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa71955-86b4-488e-b154-edabe283247b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:58.146908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-2aaf3afa-a5a5-4e15-a0cb-b0be50f383e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:52:58.148499 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 302/600] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:58.154255 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf3afa-a5a5-4e15-a0cb-b0be50f383e8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:58.179725 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03843def-8d84-4789-ba59-18d898d3938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:58.180468 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03843def-8d84-4789-ba59-18d898d3938b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:58.180749 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03843def-8d84-4789-ba59-18d898d3938b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:58.181072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03843def-8d84-4789-ba59-18d898d3938b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:58.193466 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03843def-8d84-4789-ba59-18d898d3938b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:58.194963 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03843def-8d84-4789-ba59-18d898d3938b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:58.214702 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-03843def-8d84-4789-ba59-18d898d3938b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:58.216276 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 299/601] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:58.233955 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03843def-8d84-4789-ba59-18d898d3938b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:58.275709 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf3afa-a5a5-4e15-a0cb-b0be50f383e8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:58.310485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc208a0-9023-476a-86d8-bec3010b1f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:58.311151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc208a0-9023-476a-86d8-bec3010b1f4f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:58.311441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc208a0-9023-476a-86d8-bec3010b1f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:58.311718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc208a0-9023-476a-86d8-bec3010b1f4f None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:58.312511 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc208a0-9023-476a-86d8-bec3010b1f4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:58.312841 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc208a0-9023-476a-86d8-bec3010b1f4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:58.314360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc208a0-9023-476a-86d8-bec3010b1f4f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:58.327497 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 303/602] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:52:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:58.334153 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc208a0-9023-476a-86d8-bec3010b1f4f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:58.338877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03843def-8d84-4789-ba59-18d898d3938b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:58.379597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5265fb-1f32-4697-b940-6bbf476fdfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:58.380755 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5265fb-1f32-4697-b940-6bbf476fdfab None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:58.381283 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5265fb-1f32-4697-b940-6bbf476fdfab None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:58.381757 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5265fb-1f32-4697-b940-6bbf476fdfab None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:58.382751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5265fb-1f32-4697-b940-6bbf476fdfab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:58.383256 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5265fb-1f32-4697-b940-6bbf476fdfab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:58.386304 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5265fb-1f32-4697-b940-6bbf476fdfab None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:58.406357 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 300/603] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:52:58.412240 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5265fb-1f32-4697-b940-6bbf476fdfab None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:58.528094 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc208a0-9023-476a-86d8-bec3010b1f4f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:58.543672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5265fb-1f32-4697-b940-6bbf476fdfab None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:58.594405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ebd0c-bfbf-40a5-b884-8ab9eafb57d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:58.595617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ebd0c-bfbf-40a5-b884-8ab9eafb57d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:58.595617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ebd0c-bfbf-40a5-b884-8ab9eafb57d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:58.595905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ebd0c-bfbf-40a5-b884-8ab9eafb57d2 None admin] PATH_INFO: `/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/9ba2cc8ae41b435d830e58327893f527/roles/22681aa004f8450f964af121fc87d40a` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:58.604476 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c92da-4d1e-4416-a284-3a1c3616367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:58.606176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c92da-4d1e-4416-a284-3a1c3616367a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:58.606931 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c92da-4d1e-4416-a284-3a1c3616367a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:58.607686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c92da-4d1e-4416-a284-3a1c3616367a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:58.611353 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ebd0c-bfbf-40a5-b884-8ab9eafb57d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=470fa8cf5f4a443faea9cfc628ff6003, user_id=9ba2cc8ae41b435d830e58327893f527, role_id=22681aa004f8450f964af121fc87d40a)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:58.612994 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ebd0c-bfbf-40a5-b884-8ab9eafb57d2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:58.624590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c92da-4d1e-4416-a284-3a1c3616367a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:58.628517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c92da-4d1e-4416-a284-3a1c3616367a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:58.635036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 304/604] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:52:58 2022] PUT /identity/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/9ba2cc8ae41b435d830e58327893f527/roles/22681aa004f8450f964af121fc87d40a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:52:58.655098 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-007c92da-4d1e-4416-a284-3a1c3616367a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:52:58.658122 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 301/605] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:52:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:58.664922 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ebd0c-bfbf-40a5-b884-8ab9eafb57d2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:58.670606 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017d5a3-26c0-41a8-8f55-dbcdaf66bb17 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:58.671206 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017d5a3-26c0-41a8-8f55-dbcdaf66bb17 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:58.671709 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017d5a3-26c0-41a8-8f55-dbcdaf66bb17 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:58.674272 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 302/606] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:52:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:52:58.687301 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd638299-8532-44dc-8d5b-f1b46515ed7a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:58.687599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd638299-8532-44dc-8d5b-f1b46515ed7a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:58.687851 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd638299-8532-44dc-8d5b-f1b46515ed7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:58.722342 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-dd638299-8532-44dc-8d5b-f1b46515ed7a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:52:58.724423 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-dd638299-8532-44dc-8d5b-f1b46515ed7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:52:58.829833 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ebd0c-bfbf-40a5-b884-8ab9eafb57d2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:58.873153 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c341dd5-2cff-4fc1-9066-87a48b7e6590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:58.873910 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 303/607] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:52:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:52:58.874040 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c341dd5-2cff-4fc1-9066-87a48b7e6590 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:58.874197 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c341dd5-2cff-4fc1-9066-87a48b7e6590 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:58.874427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c341dd5-2cff-4fc1-9066-87a48b7e6590 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:58.875219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c341dd5-2cff-4fc1-9066-87a48b7e6590 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:58.875518 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c341dd5-2cff-4fc1-9066-87a48b7e6590 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:58.877024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c341dd5-2cff-4fc1-9066-87a48b7e6590 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:58.891082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 305/608] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:52:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:58.896150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd638299-8532-44dc-8d5b-f1b46515ed7a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:58.911226 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c341dd5-2cff-4fc1-9066-87a48b7e6590 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:59.014006 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd638299-8532-44dc-8d5b-f1b46515ed7a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:59.060000 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7bfdb-a0ff-43ca-aac5-faefff3a4131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:59.061174 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7bfdb-a0ff-43ca-aac5-faefff3a4131 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:59.061598 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7bfdb-a0ff-43ca-aac5-faefff3a4131 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:59.062015 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7bfdb-a0ff-43ca-aac5-faefff3a4131 None admin] PATH_INFO: `/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/639126e5b13345cda6490073ec57f4c1/roles/22681aa004f8450f964af121fc87d40a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:59.083133 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7bfdb-a0ff-43ca-aac5-faefff3a4131 None admin] RBAC: Authorizing `identity:create_grant(project_id=470fa8cf5f4a443faea9cfc628ff6003, user_id=639126e5b13345cda6490073ec57f4c1, role_id=22681aa004f8450f964af121fc87d40a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:59.085657 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7bfdb-a0ff-43ca-aac5-faefff3a4131 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:59.092979 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c341dd5-2cff-4fc1-9066-87a48b7e6590 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:59.111073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 304/609] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:52:58 2022] PUT /identity/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/639126e5b13345cda6490073ec57f4c1/roles/22681aa004f8450f964af121fc87d40a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:52:59.145415 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb158a48-5672-4b9f-b121-11be41fe96fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:59.146546 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb158a48-5672-4b9f-b121-11be41fe96fa None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:59.146976 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb158a48-5672-4b9f-b121-11be41fe96fa None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:59.147394 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb158a48-5672-4b9f-b121-11be41fe96fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:59.170114 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb158a48-5672-4b9f-b121-11be41fe96fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:52:59.178506 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-eb158a48-5672-4b9f-b121-11be41fe96fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:52:59.180359 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 306/610] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:52:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:52:59.186624 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7bfdb-a0ff-43ca-aac5-faefff3a4131 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:59.339801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7bfdb-a0ff-43ca-aac5-faefff3a4131 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:59.376453 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec0e66-bfa1-4a97-bc39-c5a099db2bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:59.377529 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec0e66-bfa1-4a97-bc39-c5a099db2bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:59.378025 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec0e66-bfa1-4a97-bc39-c5a099db2bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:59.379011 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec0e66-bfa1-4a97-bc39-c5a099db2bd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:59.380057 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec0e66-bfa1-4a97-bc39-c5a099db2bd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:59.380578 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec0e66-bfa1-4a97-bc39-c5a099db2bd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:59.382180 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec0e66-bfa1-4a97-bc39-c5a099db2bd0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:59.391215 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 305/611] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:52:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:59.398109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb158a48-5672-4b9f-b121-11be41fe96fa None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:59.498770 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb158a48-5672-4b9f-b121-11be41fe96fa None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:59.533186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217b6a5-2c90-47b8-94d7-f7f8bc0503b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:59.535388 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b6a5-2c90-47b8-94d7-f7f8bc0503b9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:59.535865 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b6a5-2c90-47b8-94d7-f7f8bc0503b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:59.536333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217b6a5-2c90-47b8-94d7-f7f8bc0503b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:59.547677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217b6a5-2c90-47b8-94d7-f7f8bc0503b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:59.549544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217b6a5-2c90-47b8-94d7-f7f8bc0503b9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:59.568922 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-e217b6a5-2c90-47b8-94d7-f7f8bc0503b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:52:59.570819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 307/612] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:59.576707 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec0e66-bfa1-4a97-bc39-c5a099db2bd0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:59.678274 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec0e66-bfa1-4a97-bc39-c5a099db2bd0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:59.712325 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca96e1-296a-4886-870d-ae6f80ae7c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:59.713463 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca96e1-296a-4886-870d-ae6f80ae7c1b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:59.713940 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca96e1-296a-4886-870d-ae6f80ae7c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:59.714407 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca96e1-296a-4886-870d-ae6f80ae7c1b None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:59.715315 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca96e1-296a-4886-870d-ae6f80ae7c1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:52:59.715865 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca96e1-296a-4886-870d-ae6f80ae7c1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:59.717528 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca96e1-296a-4886-870d-ae6f80ae7c1b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:59.730383 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 306/613] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:52:59.736056 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217b6a5-2c90-47b8-94d7-f7f8bc0503b9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:52:59.840807 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217b6a5-2c90-47b8-94d7-f7f8bc0503b9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:52:59.880504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d116f14-1dac-4a7b-bb57-9eaa8d6a5cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:52:59.881748 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d116f14-1dac-4a7b-bb57-9eaa8d6a5cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:52:59.882225 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d116f14-1dac-4a7b-bb57-9eaa8d6a5cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:52:59.882705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d116f14-1dac-4a7b-bb57-9eaa8d6a5cd1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:52:59.890686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d116f14-1dac-4a7b-bb57-9eaa8d6a5cd1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:52:59.892405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d116f14-1dac-4a7b-bb57-9eaa8d6a5cd1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:52:59.906145 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-4d116f14-1dac-4a7b-bb57-9eaa8d6a5cd1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:52:59.907842 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 308/614] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:52:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:52:59.913679 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca96e1-296a-4886-870d-ae6f80ae7c1b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:00.014689 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca96e1-296a-4886-870d-ae6f80ae7c1b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:00.049600 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d35ae8-cfff-4616-9f1b-44ae47163ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:00.050283 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d35ae8-cfff-4616-9f1b-44ae47163ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:00.050585 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d35ae8-cfff-4616-9f1b-44ae47163ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:00.050859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d35ae8-cfff-4616-9f1b-44ae47163ad5 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:00.051696 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d35ae8-cfff-4616-9f1b-44ae47163ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:00.052004 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d35ae8-cfff-4616-9f1b-44ae47163ad5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:00.053540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d35ae8-cfff-4616-9f1b-44ae47163ad5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:00.072027 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 307/615] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Sep 27 04:52:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:00.077499 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d116f14-1dac-4a7b-bb57-9eaa8d6a5cd1 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:00.178934 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d116f14-1dac-4a7b-bb57-9eaa8d6a5cd1 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:00.214593 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272625a-48f5-49c6-a926-ac757c11c9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:00.215482 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272625a-48f5-49c6-a926-ac757c11c9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:00.215871 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272625a-48f5-49c6-a926-ac757c11c9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:00.216267 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272625a-48f5-49c6-a926-ac757c11c9a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:00.228222 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272625a-48f5-49c6-a926-ac757c11c9a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:00.229649 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272625a-48f5-49c6-a926-ac757c11c9a7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:00.247358 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-4272625a-48f5-49c6-a926-ac757c11c9a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:00.253076 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 309/616] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:00.254651 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d35ae8-cfff-4616-9f1b-44ae47163ad5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:00.364946 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d35ae8-cfff-4616-9f1b-44ae47163ad5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:00.410880 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff180011-9219-4f08-b902-1499f821d8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:00.411563 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff180011-9219-4f08-b902-1499f821d8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:00.411902 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff180011-9219-4f08-b902-1499f821d8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:00.412184 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff180011-9219-4f08-b902-1499f821d8d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:00.412931 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff180011-9219-4f08-b902-1499f821d8d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:00.413234 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff180011-9219-4f08-b902-1499f821d8d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:00.414606 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff180011-9219-4f08-b902-1499f821d8d1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:00.429846 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 308/617] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:00.435372 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272625a-48f5-49c6-a926-ac757c11c9a7 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:00.538425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272625a-48f5-49c6-a926-ac757c11c9a7 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:00.573782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c2f34-0abe-4099-909d-bc34e46b326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:00.574573 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2f34-0abe-4099-909d-bc34e46b326d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:00.574854 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2f34-0abe-4099-909d-bc34e46b326d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:00.575131 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c2f34-0abe-4099-909d-bc34e46b326d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:00.582364 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c2f34-0abe-4099-909d-bc34e46b326d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:00.583907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c2f34-0abe-4099-909d-bc34e46b326d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:00.597567 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-776c2f34-0abe-4099-909d-bc34e46b326d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:00.599043 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 310/618] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:00.604636 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff180011-9219-4f08-b902-1499f821d8d1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:00.714599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff180011-9219-4f08-b902-1499f821d8d1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:00.742751 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e3671-fb89-4eb9-80d2-812de5e47fb3 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:00.743056 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e3671-fb89-4eb9-80d2-812de5e47fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:00.743319 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e3671-fb89-4eb9-80d2-812de5e47fb3 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:00.747616 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 311/619] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:00.756523 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c40b18-c7c5-482b-995e-b248e48766e1 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:00.756852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c40b18-c7c5-482b-995e-b248e48766e1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:00.757114 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c40b18-c7c5-482b-995e-b248e48766e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:00.764262 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0461b90-9b80-4314-92c3-9c8869ef8da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:00.765327 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461b90-9b80-4314-92c3-9c8869ef8da0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:00.765803 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461b90-9b80-4314-92c3-9c8869ef8da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:00.766337 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461b90-9b80-4314-92c3-9c8869ef8da0 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:00.767353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0461b90-9b80-4314-92c3-9c8869ef8da0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:00.767886 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0461b90-9b80-4314-92c3-9c8869ef8da0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:00.770348 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0461b90-9b80-4314-92c3-9c8869ef8da0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:00.783870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 309/620] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:00.789350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0461b90-9b80-4314-92c3-9c8869ef8da0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:00.790778 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-56c40b18-c7c5-482b-995e-b248e48766e1 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:00.792586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-56c40b18-c7c5-482b-995e-b248e48766e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:00.915107 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0461b90-9b80-4314-92c3-9c8869ef8da0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:00.962070 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af717a-f94b-4644-ab0a-ec370b45e0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:00.962978 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af717a-f94b-4644-ab0a-ec370b45e0dc None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:00.963258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af717a-f94b-4644-ab0a-ec370b45e0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:00.963529 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af717a-f94b-4644-ab0a-ec370b45e0dc None admin] PATH_INFO: `/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/bfea15b51919441b921c10d02d11f693/roles/22681aa004f8450f964af121fc87d40a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:00.984810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 312/621] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:53:00.992861 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af717a-f94b-4644-ab0a-ec370b45e0dc None admin] RBAC: Authorizing `identity:create_grant(project_id=470fa8cf5f4a443faea9cfc628ff6003, user_id=bfea15b51919441b921c10d02d11f693, role_id=22681aa004f8450f964af121fc87d40a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:01.000070 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af717a-f94b-4644-ab0a-ec370b45e0dc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:01.010821 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 310/622] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:53:00 2022] PUT /identity/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/bfea15b51919441b921c10d02d11f693/roles/22681aa004f8450f964af121fc87d40a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:53:01.027760 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c40b18-c7c5-482b-995e-b248e48766e1 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:01.139555 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c40b18-c7c5-482b-995e-b248e48766e1 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:01.183813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92aaaea-7401-4739-8ea2-6047fa52a7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:01.184651 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aaaea-7401-4739-8ea2-6047fa52a7cd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:01.184960 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aaaea-7401-4739-8ea2-6047fa52a7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:01.185228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92aaaea-7401-4739-8ea2-6047fa52a7cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:01.198812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92aaaea-7401-4739-8ea2-6047fa52a7cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:01.206178 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-b92aaaea-7401-4739-8ea2-6047fa52a7cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:53:01.212932 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 313/623] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:53:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:01.214380 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af717a-f94b-4644-ab0a-ec370b45e0dc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:01.307453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca808c-cc88-4f8f-9404-d1a2088ff0b9 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:01.307804 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca808c-cc88-4f8f-9404-d1a2088ff0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:01.307994 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca808c-cc88-4f8f-9404-d1a2088ff0b9 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:01.312442 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 314/624] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:53:01.316905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda6a32-0d81-4ad0-aa07-571aae9d7b19 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:01.317191 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda6a32-0d81-4ad0-aa07-571aae9d7b19 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:01.317462 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda6a32-0d81-4ad0-aa07-571aae9d7b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:01.325941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af717a-f94b-4644-ab0a-ec370b45e0dc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:01.336498 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7dda6a32-0d81-4ad0-aa07-571aae9d7b19 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:01.337711 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7dda6a32-0d81-4ad0-aa07-571aae9d7b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:01.363309 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dc607-5740-4914-a1c6-fe092b892cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:01.364356 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dc607-5740-4914-a1c6-fe092b892cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:01.364894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dc607-5740-4914-a1c6-fe092b892cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:01.365386 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dc607-5740-4914-a1c6-fe092b892cc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:01.366752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dc607-5740-4914-a1c6-fe092b892cc0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:01.367258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dc607-5740-4914-a1c6-fe092b892cc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:01.368924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dc607-5740-4914-a1c6-fe092b892cc0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:01.378366 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 311/625] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:53:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:01.392745 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dc607-5740-4914-a1c6-fe092b892cc0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:01.420932 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 315/626] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:53:01.437351 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda6a32-0d81-4ad0-aa07-571aae9d7b19 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:01.517273 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dc607-5740-4914-a1c6-fe092b892cc0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:01.536863 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda6a32-0d81-4ad0-aa07-571aae9d7b19 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:01.553169 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce66740-34db-46f0-8dce-794614f6696c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:01.554319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce66740-34db-46f0-8dce-794614f6696c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:01.554800 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce66740-34db-46f0-8dce-794614f6696c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:01.555274 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce66740-34db-46f0-8dce-794614f6696c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:01.566951 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce66740-34db-46f0-8dce-794614f6696c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:01.569001 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce66740-34db-46f0-8dce-794614f6696c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:01.572193 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99fc5e-981f-496e-83ab-f035af579184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:01.572927 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99fc5e-981f-496e-83ab-f035af579184 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:01.573207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99fc5e-981f-496e-83ab-f035af579184 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:01.573477 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99fc5e-981f-496e-83ab-f035af579184 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:01.584659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99fc5e-981f-496e-83ab-f035af579184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:01.589014 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-0ce66740-34db-46f0-8dce-794614f6696c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:01.590829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 312/627] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:01.594141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-6a99fc5e-981f-496e-83ab-f035af579184 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:53:01.596200 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 316/628] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:53:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:01.596315 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce66740-34db-46f0-8dce-794614f6696c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:01.606932 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99fc5e-981f-496e-83ab-f035af579184 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:01.747493 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99fc5e-981f-496e-83ab-f035af579184 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:01.749220 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce66740-34db-46f0-8dce-794614f6696c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:01.789219 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18515e6-780d-4965-8179-e5eb5ef6add5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:01.789418 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73ce44-9614-4e5f-916d-e3f60c85d3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:01.789943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73ce44-9614-4e5f-916d-e3f60c85d3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:01.790274 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73ce44-9614-4e5f-916d-e3f60c85d3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:01.790553 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73ce44-9614-4e5f-916d-e3f60c85d3e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:01.790983 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18515e6-780d-4965-8179-e5eb5ef6add5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:01.791333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73ce44-9614-4e5f-916d-e3f60c85d3e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:01.791640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73ce44-9614-4e5f-916d-e3f60c85d3e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:01.791850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18515e6-780d-4965-8179-e5eb5ef6add5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:01.792308 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18515e6-780d-4965-8179-e5eb5ef6add5 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:01.793037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73ce44-9614-4e5f-916d-e3f60c85d3e7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:01.793540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18515e6-780d-4965-8179-e5eb5ef6add5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:01.794042 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18515e6-780d-4965-8179-e5eb5ef6add5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:01.795590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18515e6-780d-4965-8179-e5eb5ef6add5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:01.804876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 317/629] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:53:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:01.806517 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e6df3-71af-42fc-8d6d-f0e90e1afa45 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:01.806996 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e6df3-71af-42fc-8d6d-f0e90e1afa45 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:01.808990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e6df3-71af-42fc-8d6d-f0e90e1afa45 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:01.811710 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 318/630] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:01.812431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e6df3-71af-42fc-8d6d-f0e90e1afa45 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:01.813261 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 313/631] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:01.817427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a324e4-5f71-496a-88ad-a150faf29094 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:01.817979 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a324e4-5f71-496a-88ad-a150faf29094 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:01.818465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a324e4-5f71-496a-88ad-a150faf29094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:01.840989 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f5a324e4-5f71-496a-88ad-a150faf29094 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:01.842492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f5a324e4-5f71-496a-88ad-a150faf29094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:01.916839 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 314/632] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:53:01.918138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a324e4-5f71-496a-88ad-a150faf29094 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:01.951890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e6df3-71af-42fc-8d6d-f0e90e1afa45 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:01.986206 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6607c1-74ab-4092-932b-bc672cb97b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:01.987047 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6607c1-74ab-4092-932b-bc672cb97b45 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:01.987325 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6607c1-74ab-4092-932b-bc672cb97b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:01.987591 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6607c1-74ab-4092-932b-bc672cb97b45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:02.002658 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6607c1-74ab-4092-932b-bc672cb97b45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:02.004204 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6607c1-74ab-4092-932b-bc672cb97b45 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:02.022332 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-9a6607c1-74ab-4092-932b-bc672cb97b45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:02.028112 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 319/633] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:02.028980 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6607c1-74ab-4092-932b-bc672cb97b45 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:02.050182 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a324e4-5f71-496a-88ad-a150faf29094 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:02.088077 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed75ba-0ae5-4206-b359-bc5dc61147a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:02.088939 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed75ba-0ae5-4206-b359-bc5dc61147a0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:02.089349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed75ba-0ae5-4206-b359-bc5dc61147a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:02.089754 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed75ba-0ae5-4206-b359-bc5dc61147a0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:02.100240 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed75ba-0ae5-4206-b359-bc5dc61147a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:02.102365 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed75ba-0ae5-4206-b359-bc5dc61147a0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:02.121874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-1fed75ba-0ae5-4206-b359-bc5dc61147a0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 27 04:53:02.123753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 315/634] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:53:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:02.124537 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed75ba-0ae5-4206-b359-bc5dc61147a0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:02.148306 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6607c1-74ab-4092-932b-bc672cb97b45 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:02.192236 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15ec68-990a-4fd7-926a-eed4439ce435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:02.193912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15ec68-990a-4fd7-926a-eed4439ce435 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:02.194666 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15ec68-990a-4fd7-926a-eed4439ce435 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:02.195147 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15ec68-990a-4fd7-926a-eed4439ce435 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:02.210321 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15ec68-990a-4fd7-926a-eed4439ce435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:02.220417 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-4b15ec68-990a-4fd7-926a-eed4439ce435 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:53:02.223330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 320/635] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:53:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:02.224326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15ec68-990a-4fd7-926a-eed4439ce435 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:02.251107 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed75ba-0ae5-4206-b359-bc5dc61147a0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:02.289194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eadac6-0c42-4db0-bfc5-aece61be2f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:02.290102 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eadac6-0c42-4db0-bfc5-aece61be2f31 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:02.290536 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eadac6-0c42-4db0-bfc5-aece61be2f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:02.290825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eadac6-0c42-4db0-bfc5-aece61be2f31 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:02.291537 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eadac6-0c42-4db0-bfc5-aece61be2f31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:02.291849 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eadac6-0c42-4db0-bfc5-aece61be2f31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:02.293280 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eadac6-0c42-4db0-bfc5-aece61be2f31 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:02.305738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 316/636] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:02.306273 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eadac6-0c42-4db0-bfc5-aece61be2f31 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:02.336063 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15ec68-990a-4fd7-926a-eed4439ce435 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:02.370862 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33edf4e-d5af-45ac-93a4-800970eb73a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:02.371788 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33edf4e-d5af-45ac-93a4-800970eb73a7 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:02.372070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33edf4e-d5af-45ac-93a4-800970eb73a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:02.372349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33edf4e-d5af-45ac-93a4-800970eb73a7 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:02.373215 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33edf4e-d5af-45ac-93a4-800970eb73a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:02.373918 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33edf4e-d5af-45ac-93a4-800970eb73a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:02.374954 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33edf4e-d5af-45ac-93a4-800970eb73a7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:02.395601 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 321/637] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Sep 27 04:53:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:02.397682 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a459073-c5f5-4fba-a555-00d44ff76bcc None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:02.398498 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a459073-c5f5-4fba-a555-00d44ff76bcc None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:02.399256 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a459073-c5f5-4fba-a555-00d44ff76bcc None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:02.402174 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 322/638] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:02.403146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a459073-c5f5-4fba-a555-00d44ff76bcc None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:02.408110 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eadac6-0c42-4db0-bfc5-aece61be2f31 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:02.445624 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a362ee7-bf12-4311-a2c6-13fc163e589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:02.446325 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a362ee7-bf12-4311-a2c6-13fc163e589f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:02.446601 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a362ee7-bf12-4311-a2c6-13fc163e589f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:02.446877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a362ee7-bf12-4311-a2c6-13fc163e589f None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:02.447634 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a362ee7-bf12-4311-a2c6-13fc163e589f None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:02.447938 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a362ee7-bf12-4311-a2c6-13fc163e589f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:02.449383 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a362ee7-bf12-4311-a2c6-13fc163e589f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:02.462847 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 317/639] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:53:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:02.462847 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a362ee7-bf12-4311-a2c6-13fc163e589f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:02.510952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a459073-c5f5-4fba-a555-00d44ff76bcc None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:02.544559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a8687-f9e7-44ac-a33f-244422e696bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:02.545316 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a8687-f9e7-44ac-a33f-244422e696bb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:02.545599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a8687-f9e7-44ac-a33f-244422e696bb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:02.545874 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a8687-f9e7-44ac-a33f-244422e696bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:02.553125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a8687-f9e7-44ac-a33f-244422e696bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:02.554570 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a8687-f9e7-44ac-a33f-244422e696bb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:02.557024 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a362ee7-bf12-4311-a2c6-13fc163e589f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:02.568740 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-463a8687-f9e7-44ac-a33f-244422e696bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:53:02.574366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 323/640] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 27 04:53:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:02.574366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aad01-a47a-45be-b463-740c4f7646f2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:02.574366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aad01-a47a-45be-b463-740c4f7646f2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:02.574366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aad01-a47a-45be-b463-740c4f7646f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:02.590363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b825da1-5b7b-4f60-82ae-ac0c458d5873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:02.591009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b825da1-5b7b-4f60-82ae-ac0c458d5873 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:02.591287 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b825da1-5b7b-4f60-82ae-ac0c458d5873 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:02.591726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b825da1-5b7b-4f60-82ae-ac0c458d5873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:02.595081 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f19aad01-a47a-45be-b463-740c4f7646f2 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:02.596264 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f19aad01-a47a-45be-b463-740c4f7646f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:02.659593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b825da1-5b7b-4f60-82ae-ac0c458d5873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:02.661870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b825da1-5b7b-4f60-82ae-ac0c458d5873 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:02.672974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 324/641] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:53:02.672974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19aad01-a47a-45be-b463-740c4f7646f2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:02.762379 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 318/642] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:53:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:53:02.763384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b825da1-5b7b-4f60-82ae-ac0c458d5873 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:02.774017 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19aad01-a47a-45be-b463-740c4f7646f2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:02.807847 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a104f6-6a10-4081-8d74-13aa93cfb9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:02.808610 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a104f6-6a10-4081-8d74-13aa93cfb9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:02.808925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a104f6-6a10-4081-8d74-13aa93cfb9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:02.809197 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a104f6-6a10-4081-8d74-13aa93cfb9c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:02.819238 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a104f6-6a10-4081-8d74-13aa93cfb9c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:02.820683 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a104f6-6a10-4081-8d74-13aa93cfb9c3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:02.839131 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-17a104f6-6a10-4081-8d74-13aa93cfb9c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:02.840677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 325/643] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:02.841537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a104f6-6a10-4081-8d74-13aa93cfb9c3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:02.863384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b825da1-5b7b-4f60-82ae-ac0c458d5873 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:02.898647 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ac4d1-2bb4-4fec-8737-7f02a0df0d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:02.899471 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ac4d1-2bb4-4fec-8737-7f02a0df0d23 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:02.899747 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ac4d1-2bb4-4fec-8737-7f02a0df0d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:02.900017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ac4d1-2bb4-4fec-8737-7f02a0df0d23 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:02.900868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ac4d1-2bb4-4fec-8737-7f02a0df0d23 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:02.901220 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ac4d1-2bb4-4fec-8737-7f02a0df0d23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:02.902641 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ac4d1-2bb4-4fec-8737-7f02a0df0d23 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:02.923736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 319/644] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 27 04:53:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:02.923736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ac4d1-2bb4-4fec-8737-7f02a0df0d23 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:02.945362 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a104f6-6a10-4081-8d74-13aa93cfb9c3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:02.982589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81595f73-782b-46f3-b592-9aa616c3bb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:02.983387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81595f73-782b-46f3-b592-9aa616c3bb03 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:02.983666 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81595f73-782b-46f3-b592-9aa616c3bb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:02.983939 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81595f73-782b-46f3-b592-9aa616c3bb03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:02.997652 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81595f73-782b-46f3-b592-9aa616c3bb03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:03.005067 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-81595f73-782b-46f3-b592-9aa616c3bb03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:53:03.011238 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 326/645] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:53:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:03.011238 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81595f73-782b-46f3-b592-9aa616c3bb03 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:03.034398 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ac4d1-2bb4-4fec-8737-7f02a0df0d23 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:03.067724 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3c9e2-1d75-4fd7-b0c7-a833531e63a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:03.068429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3c9e2-1d75-4fd7-b0c7-a833531e63a4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:03.068702 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3c9e2-1d75-4fd7-b0c7-a833531e63a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:03.068999 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3c9e2-1d75-4fd7-b0c7-a833531e63a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:03.081249 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3c9e2-1d75-4fd7-b0c7-a833531e63a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:03.083085 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3c9e2-1d75-4fd7-b0c7-a833531e63a4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:03.100478 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-daf3c9e2-1d75-4fd7-b0c7-a833531e63a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:03.101890 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 320/646] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:03.102920 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3c9e2-1d75-4fd7-b0c7-a833531e63a4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:03.114443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81595f73-782b-46f3-b592-9aa616c3bb03 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:03.148658 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5f83a-de4a-4120-afb8-daa3d808b57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:03.149356 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5f83a-de4a-4120-afb8-daa3d808b57f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:03.149634 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5f83a-de4a-4120-afb8-daa3d808b57f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:03.149914 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5f83a-de4a-4120-afb8-daa3d808b57f None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:03.150610 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5f83a-de4a-4120-afb8-daa3d808b57f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:03.150972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5f83a-de4a-4120-afb8-daa3d808b57f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:03.152333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5f83a-de4a-4120-afb8-daa3d808b57f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:03.170731 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 327/647] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:03.170731 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5f83a-de4a-4120-afb8-daa3d808b57f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:03.199229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3c9e2-1d75-4fd7-b0c7-a833531e63a4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:03.233916 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e3b9e-d552-4df1-ae5c-b313ff68cff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:03.234573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e3b9e-d552-4df1-ae5c-b313ff68cff7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:03.234856 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e3b9e-d552-4df1-ae5c-b313ff68cff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:03.235127 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e3b9e-d552-4df1-ae5c-b313ff68cff7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:03.270089 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5f83a-de4a-4120-afb8-daa3d808b57f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:03.304076 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e3b9e-d552-4df1-ae5c-b313ff68cff7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:03.305598 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e3b9e-d552-4df1-ae5c-b313ff68cff7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:03.305921 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b0c63-da62-456f-867e-ad933ccd0254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:03.306599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b0c63-da62-456f-867e-ad933ccd0254 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:03.306880 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b0c63-da62-456f-867e-ad933ccd0254 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:03.307154 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b0c63-da62-456f-867e-ad933ccd0254 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:03.307910 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b0c63-da62-456f-867e-ad933ccd0254 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:03.308219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b0c63-da62-456f-867e-ad933ccd0254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:03.309658 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b0c63-da62-456f-867e-ad933ccd0254 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:03.323302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 328/648] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:53:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:03.323302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b0c63-da62-456f-867e-ad933ccd0254 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:03.407802 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 321/649] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:53:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:53:03.408645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e3b9e-d552-4df1-ae5c-b313ff68cff7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:03.422331 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b0c63-da62-456f-867e-ad933ccd0254 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:03.454153 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312d179-5268-41c8-9298-527144bd557b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:03.455015 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312d179-5268-41c8-9298-527144bd557b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:03.455288 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312d179-5268-41c8-9298-527144bd557b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:03.455557 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312d179-5268-41c8-9298-527144bd557b None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:03.456267 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312d179-5268-41c8-9298-527144bd557b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:03.457117 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312d179-5268-41c8-9298-527144bd557b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:03.458542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312d179-5268-41c8-9298-527144bd557b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:03.474814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 329/650] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:03.474814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312d179-5268-41c8-9298-527144bd557b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:03.507969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e3b9e-d552-4df1-ae5c-b313ff68cff7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:03.541119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dffb6-a93e-4974-aaf7-a17b0781541c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:03.541922 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dffb6-a93e-4974-aaf7-a17b0781541c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:03.542197 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dffb6-a93e-4974-aaf7-a17b0781541c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:03.542469 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dffb6-a93e-4974-aaf7-a17b0781541c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:03.549583 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9dffb6-a93e-4974-aaf7-a17b0781541c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:03.551765 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9dffb6-a93e-4974-aaf7-a17b0781541c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:03.569782 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-0e9dffb6-a93e-4974-aaf7-a17b0781541c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 04:53:03.575654 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 322/651] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:53:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:03.575784 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312d179-5268-41c8-9298-527144bd557b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:03.576187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dffb6-a93e-4974-aaf7-a17b0781541c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:03.605672 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e460e0-ef8c-4070-8b10-56dc08289644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:03.606466 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e460e0-ef8c-4070-8b10-56dc08289644 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:03.606742 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e460e0-ef8c-4070-8b10-56dc08289644 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:03.607013 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e460e0-ef8c-4070-8b10-56dc08289644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:03.617838 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e460e0-ef8c-4070-8b10-56dc08289644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:03.619299 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e460e0-ef8c-4070-8b10-56dc08289644 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:03.636743 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-f8e460e0-ef8c-4070-8b10-56dc08289644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:03.637957 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 330/652] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:03.638727 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e460e0-ef8c-4070-8b10-56dc08289644 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:03.673906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9dffb6-a93e-4974-aaf7-a17b0781541c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:03.707598 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74225ea1-f9e1-4ed5-b38d-206e4a8e9c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:03.708482 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74225ea1-f9e1-4ed5-b38d-206e4a8e9c69 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:03.708871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74225ea1-f9e1-4ed5-b38d-206e4a8e9c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:03.709132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74225ea1-f9e1-4ed5-b38d-206e4a8e9c69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:03.718740 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74225ea1-f9e1-4ed5-b38d-206e4a8e9c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:03.720179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74225ea1-f9e1-4ed5-b38d-206e4a8e9c69 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:03.733631 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e460e0-ef8c-4070-8b10-56dc08289644 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:03.736977 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-74225ea1-f9e1-4ed5-b38d-206e4a8e9c69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:03.738965 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 323/653] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:03.739734 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74225ea1-f9e1-4ed5-b38d-206e4a8e9c69 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:03.766878 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23fa32-4136-411a-9476-4b687759e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:03.767661 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23fa32-4136-411a-9476-4b687759e569 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:03.767938 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23fa32-4136-411a-9476-4b687759e569 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:03.768207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23fa32-4136-411a-9476-4b687759e569 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:03.774850 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23fa32-4136-411a-9476-4b687759e569 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:03.776293 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23fa32-4136-411a-9476-4b687759e569 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:03.789378 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-2d23fa32-4136-411a-9476-4b687759e569 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:03.800967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 331/654] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:03.800967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23fa32-4136-411a-9476-4b687759e569 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:03.838335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74225ea1-f9e1-4ed5-b38d-206e4a8e9c69 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:03.871298 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d27b5-3437-4b63-8d6f-395d97365e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:03.871959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d27b5-3437-4b63-8d6f-395d97365e01 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:03.872236 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d27b5-3437-4b63-8d6f-395d97365e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:03.872504 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d27b5-3437-4b63-8d6f-395d97365e01 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:03.873351 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d27b5-3437-4b63-8d6f-395d97365e01 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:03.873650 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d27b5-3437-4b63-8d6f-395d97365e01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:03.875058 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d27b5-3437-4b63-8d6f-395d97365e01 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:03.891980 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 324/655] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Sep 27 04:53:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:03.893244 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce871f-65b1-4ba9-ae3a-1db80f3c66b9 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:03.893525 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce871f-65b1-4ba9-ae3a-1db80f3c66b9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:03.893798 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce871f-65b1-4ba9-ae3a-1db80f3c66b9 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:03.899610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 325/656] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:03.899738 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23fa32-4136-411a-9476-4b687759e569 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:03.899816 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce871f-65b1-4ba9-ae3a-1db80f3c66b9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:03.929368 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c23ef1-c538-494a-9495-c7d568279fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:03.930021 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c23ef1-c538-494a-9495-c7d568279fba None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:03.930306 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c23ef1-c538-494a-9495-c7d568279fba None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:03.930579 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c23ef1-c538-494a-9495-c7d568279fba None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:03.931295 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c23ef1-c538-494a-9495-c7d568279fba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:03.931597 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c23ef1-c538-494a-9495-c7d568279fba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:03.933001 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c23ef1-c538-494a-9495-c7d568279fba None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:03.944277 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 332/657] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:03.945082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c23ef1-c538-494a-9495-c7d568279fba None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:03.994027 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce871f-65b1-4ba9-ae3a-1db80f3c66b9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:04.027339 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dfb2c-84c9-456f-90cf-adcc3e871163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:04.027997 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dfb2c-84c9-456f-90cf-adcc3e871163 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:04.028273 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dfb2c-84c9-456f-90cf-adcc3e871163 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:04.028546 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7dfb2c-84c9-456f-90cf-adcc3e871163 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:04.029309 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dfb2c-84c9-456f-90cf-adcc3e871163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:04.029596 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dfb2c-84c9-456f-90cf-adcc3e871163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:04.030962 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7dfb2c-84c9-456f-90cf-adcc3e871163 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:04.042223 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 326/658] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:04.042996 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dfb2c-84c9-456f-90cf-adcc3e871163 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:04.045320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c23ef1-c538-494a-9495-c7d568279fba None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:04.078937 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b18d8-d271-4bbd-a396-026732798edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:04.079662 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b18d8-d271-4bbd-a396-026732798edb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:04.079948 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b18d8-d271-4bbd-a396-026732798edb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:04.080223 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b18d8-d271-4bbd-a396-026732798edb None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:04.081026 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b18d8-d271-4bbd-a396-026732798edb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:04.081335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b18d8-d271-4bbd-a396-026732798edb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:04.082840 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b18d8-d271-4bbd-a396-026732798edb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:04.093943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 333/659] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:04.095054 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6102a-8803-4a40-b92f-3e295c2163bf None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:04.095340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6102a-8803-4a40-b92f-3e295c2163bf None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:04.095620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6102a-8803-4a40-b92f-3e295c2163bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:04.111764 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-86f6102a-8803-4a40-b92f-3e295c2163bf None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:04.113603 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-86f6102a-8803-4a40-b92f-3e295c2163bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:04.138105 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7dfb2c-84c9-456f-90cf-adcc3e871163 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:04.169757 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ee3ef-d632-461c-9a22-b89778aea418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:04.170395 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ee3ef-d632-461c-9a22-b89778aea418 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:04.170670 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ee3ef-d632-461c-9a22-b89778aea418 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:04.170938 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ee3ef-d632-461c-9a22-b89778aea418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:04.175315 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 334/660] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:53:04.176620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6102a-8803-4a40-b92f-3e295c2163bf None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:04.238923 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ee3ef-d632-461c-9a22-b89778aea418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:04.240375 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ee3ef-d632-461c-9a22-b89778aea418 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:04.268953 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6102a-8803-4a40-b92f-3e295c2163bf None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:04.301437 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85207f09-e4a5-4351-a5ed-dbf3a4aa1164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:04.302218 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85207f09-e4a5-4351-a5ed-dbf3a4aa1164 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:04.302498 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85207f09-e4a5-4351-a5ed-dbf3a4aa1164 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:04.302772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85207f09-e4a5-4351-a5ed-dbf3a4aa1164 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:04.309623 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85207f09-e4a5-4351-a5ed-dbf3a4aa1164 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:04.311071 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85207f09-e4a5-4351-a5ed-dbf3a4aa1164 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:04.324742 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-85207f09-e4a5-4351-a5ed-dbf3a4aa1164 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 27 04:53:04.325923 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 335/661] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:53:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:04.326789 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85207f09-e4a5-4351-a5ed-dbf3a4aa1164 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:04.333795 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 327/662] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:53:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:53:04.334833 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ee3ef-d632-461c-9a22-b89778aea418 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:04.421050 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85207f09-e4a5-4351-a5ed-dbf3a4aa1164 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:04.428613 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ee3ef-d632-461c-9a22-b89778aea418 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:04.452850 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558f564-3b9c-4803-ab85-dea54efcfe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:04.453623 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558f564-3b9c-4803-ab85-dea54efcfe5c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:04.453897 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558f564-3b9c-4803-ab85-dea54efcfe5c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:04.454165 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558f564-3b9c-4803-ab85-dea54efcfe5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:04.460939 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444fa4e-8543-49d1-9658-919d6036da97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:04.461458 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558f564-3b9c-4803-ab85-dea54efcfe5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:04.461592 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444fa4e-8543-49d1-9658-919d6036da97 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:04.461874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444fa4e-8543-49d1-9658-919d6036da97 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:04.462149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444fa4e-8543-49d1-9658-919d6036da97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:04.462898 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558f564-3b9c-4803-ab85-dea54efcfe5c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:04.462998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444fa4e-8543-49d1-9658-919d6036da97 None admin] RBAC: Adding query filter params (role.id=22681aa004f8450f964af121fc87d40a, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=93e04bf8c51c4d89bbb45e96223e7409) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:04.463274 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444fa4e-8543-49d1-9658-919d6036da97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:04.464694 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444fa4e-8543-49d1-9658-919d6036da97 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:04.470288 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 328/663] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:53:04 2022] GET /identity/v3/role_assignments?user.id=93e04bf8c51c4d89bbb45e96223e7409&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=22681aa004f8450f964af121fc87d40a => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:04.471053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444fa4e-8543-49d1-9658-919d6036da97 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:04.475968 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-6558f564-3b9c-4803-ab85-dea54efcfe5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:04.482103 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 336/664] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:04.482103 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558f564-3b9c-4803-ab85-dea54efcfe5c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:04.577906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444fa4e-8543-49d1-9658-919d6036da97 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:04.588781 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558f564-3b9c-4803-ab85-dea54efcfe5c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:04.616176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24088e80-62ff-496b-9885-33c64453185c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:04.617036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24088e80-62ff-496b-9885-33c64453185c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:04.617312 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24088e80-62ff-496b-9885-33c64453185c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:04.617579 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24088e80-62ff-496b-9885-33c64453185c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:04.627264 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeaf3c-2406-4f60-b365-534548425b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:04.627948 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeaf3c-2406-4f60-b365-534548425b58 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:04.628231 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeaf3c-2406-4f60-b365-534548425b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:04.628748 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeaf3c-2406-4f60-b365-534548425b58 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:04.629377 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24088e80-62ff-496b-9885-33c64453185c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:04.629809 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeaf3c-2406-4f60-b365-534548425b58 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:04.630122 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeaf3c-2406-4f60-b365-534548425b58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:04.631595 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeaf3c-2406-4f60-b365-534548425b58 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:04.636879 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-24088e80-62ff-496b-9885-33c64453185c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:53:04.643221 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 329/665] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:53:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:04.643221 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24088e80-62ff-496b-9885-33c64453185c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:04.655593 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 337/666] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Sep 27 04:53:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:04.661034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeaf3c-2406-4f60-b365-534548425b58 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:04.743353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24088e80-62ff-496b-9885-33c64453185c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:04.770109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeaf3c-2406-4f60-b365-534548425b58 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:04.785992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e99ad5-1838-4d0a-a2ec-0ace75e1900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:04.786748 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e99ad5-1838-4d0a-a2ec-0ace75e1900d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:04.787028 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e99ad5-1838-4d0a-a2ec-0ace75e1900d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:04.787299 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e99ad5-1838-4d0a-a2ec-0ace75e1900d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:04.798450 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e99ad5-1838-4d0a-a2ec-0ace75e1900d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:04.799904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e99ad5-1838-4d0a-a2ec-0ace75e1900d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:04.808320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f1232-fc5d-4c65-be50-a33542f30ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:04.809525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f1232-fc5d-4c65-be50-a33542f30ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:04.809941 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f1232-fc5d-4c65-be50-a33542f30ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:04.810351 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f1232-fc5d-4c65-be50-a33542f30ab6 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:04.811262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f1232-fc5d-4c65-be50-a33542f30ab6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:04.811724 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f1232-fc5d-4c65-be50-a33542f30ab6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:04.813329 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f1232-fc5d-4c65-be50-a33542f30ab6 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:04.816840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-17e99ad5-1838-4d0a-a2ec-0ace75e1900d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:04.818053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 330/667] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:04.818818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e99ad5-1838-4d0a-a2ec-0ace75e1900d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:04.829171 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 338/668] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:04.830223 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f1232-fc5d-4c65-be50-a33542f30ab6 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:04.921919 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e99ad5-1838-4d0a-a2ec-0ace75e1900d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:04.938379 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f1232-fc5d-4c65-be50-a33542f30ab6 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:04.955204 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c998a19-20cf-485d-9f03-29b06987fd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:04.955872 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c998a19-20cf-485d-9f03-29b06987fd21 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:04.956151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c998a19-20cf-485d-9f03-29b06987fd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:04.956428 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c998a19-20cf-485d-9f03-29b06987fd21 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:04.957791 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c998a19-20cf-485d-9f03-29b06987fd21 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:04.958100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c998a19-20cf-485d-9f03-29b06987fd21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:04.959458 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c998a19-20cf-485d-9f03-29b06987fd21 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:04.971504 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 331/669] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:53:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:04.971504 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c998a19-20cf-485d-9f03-29b06987fd21 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:04.978582 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71139165-c55f-498a-b330-31c08d6ab286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:04.979298 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71139165-c55f-498a-b330-31c08d6ab286 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:04.979630 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71139165-c55f-498a-b330-31c08d6ab286 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:04.979909 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71139165-c55f-498a-b330-31c08d6ab286 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:05.048116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71139165-c55f-498a-b330-31c08d6ab286 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:05.049524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71139165-c55f-498a-b330-31c08d6ab286 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:05.074169 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c998a19-20cf-485d-9f03-29b06987fd21 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:05.107187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817008b2-c237-4c2f-890b-3b279d9c81f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:05.107845 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817008b2-c237-4c2f-890b-3b279d9c81f3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:05.108120 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817008b2-c237-4c2f-890b-3b279d9c81f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:05.108392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817008b2-c237-4c2f-890b-3b279d9c81f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:05.109131 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817008b2-c237-4c2f-890b-3b279d9c81f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:05.109439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817008b2-c237-4c2f-890b-3b279d9c81f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:05.110791 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817008b2-c237-4c2f-890b-3b279d9c81f3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:05.127696 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 332/670] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:05.127696 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817008b2-c237-4c2f-890b-3b279d9c81f3 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:05.149690 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 339/671] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:53:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:53:05.150514 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71139165-c55f-498a-b330-31c08d6ab286 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:05.228683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817008b2-c237-4c2f-890b-3b279d9c81f3 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:05.248894 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71139165-c55f-498a-b330-31c08d6ab286 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:05.261662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bec872-50e7-477d-8ea4-5a5538a6ae0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:05.262318 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec872-50e7-477d-8ea4-5a5538a6ae0d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:05.262594 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec872-50e7-477d-8ea4-5a5538a6ae0d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:05.262864 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec872-50e7-477d-8ea4-5a5538a6ae0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:05.263685 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bec872-50e7-477d-8ea4-5a5538a6ae0d None admin] RBAC: Adding query filter params (role.id=22681aa004f8450f964af121fc87d40a, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=faac84ed9d37420c811bbf6ac7df0b35) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:05.263993 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bec872-50e7-477d-8ea4-5a5538a6ae0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:05.265449 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bec872-50e7-477d-8ea4-5a5538a6ae0d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:05.281183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 333/672] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:53:05 2022] GET /identity/v3/role_assignments?user.id=faac84ed9d37420c811bbf6ac7df0b35&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=22681aa004f8450f964af121fc87d40a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:05.281183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bec872-50e7-477d-8ea4-5a5538a6ae0d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:05.284080 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c625348-f603-49d0-9a9d-050d18cd5142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:05.284948 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c625348-f603-49d0-9a9d-050d18cd5142 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:05.285301 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c625348-f603-49d0-9a9d-050d18cd5142 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:05.285547 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c625348-f603-49d0-9a9d-050d18cd5142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:05.297695 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c625348-f603-49d0-9a9d-050d18cd5142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:05.299313 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c625348-f603-49d0-9a9d-050d18cd5142 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:05.319080 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-4c625348-f603-49d0-9a9d-050d18cd5142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:05.325227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 340/673] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:05.326169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c625348-f603-49d0-9a9d-050d18cd5142 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:05.391505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bec872-50e7-477d-8ea4-5a5538a6ae0d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:05.428955 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120def0-944e-466b-9842-d960d8ce12ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:05.429817 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120def0-944e-466b-9842-d960d8ce12ba None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:05.430093 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120def0-944e-466b-9842-d960d8ce12ba None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:05.430363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120def0-944e-466b-9842-d960d8ce12ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:05.437762 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c625348-f603-49d0-9a9d-050d18cd5142 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:05.437950 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120def0-944e-466b-9842-d960d8ce12ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:05.439260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120def0-944e-466b-9842-d960d8ce12ba None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:05.453989 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-9120def0-944e-466b-9842-d960d8ce12ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:05.455603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 334/674] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:05.456625 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120def0-944e-466b-9842-d960d8ce12ba None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:05.480129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8ad2c-8bdd-4f98-bb0f-a6b44be425b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:05.480960 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8ad2c-8bdd-4f98-bb0f-a6b44be425b0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:05.481344 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8ad2c-8bdd-4f98-bb0f-a6b44be425b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:05.481624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8ad2c-8bdd-4f98-bb0f-a6b44be425b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:05.492094 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8ad2c-8bdd-4f98-bb0f-a6b44be425b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:05.493593 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8ad2c-8bdd-4f98-bb0f-a6b44be425b0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:05.511520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-36c8ad2c-8bdd-4f98-bb0f-a6b44be425b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:05.513653 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 341/675] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:05.514672 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8ad2c-8bdd-4f98-bb0f-a6b44be425b0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:05.563698 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120def0-944e-466b-9842-d960d8ce12ba None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:05.611795 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849c9a5-5f17-4ada-9b1f-3e7f784cc1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:05.612686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849c9a5-5f17-4ada-9b1f-3e7f784cc1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:05.613517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849c9a5-5f17-4ada-9b1f-3e7f784cc1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:05.613855 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849c9a5-5f17-4ada-9b1f-3e7f784cc1c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:05.614861 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849c9a5-5f17-4ada-9b1f-3e7f784cc1c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:05.615173 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849c9a5-5f17-4ada-9b1f-3e7f784cc1c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:05.617306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849c9a5-5f17-4ada-9b1f-3e7f784cc1c0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:05.621659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8ad2c-8bdd-4f98-bb0f-a6b44be425b0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:05.634705 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 335/676] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:05.635547 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849c9a5-5f17-4ada-9b1f-3e7f784cc1c0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:05.657416 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fde3fe-a7ec-410a-87c5-215e2f8ddb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:05.658075 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fde3fe-a7ec-410a-87c5-215e2f8ddb53 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:05.658350 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fde3fe-a7ec-410a-87c5-215e2f8ddb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:05.658622 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fde3fe-a7ec-410a-87c5-215e2f8ddb53 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:05.659401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fde3fe-a7ec-410a-87c5-215e2f8ddb53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:05.660357 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fde3fe-a7ec-410a-87c5-215e2f8ddb53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:05.661961 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fde3fe-a7ec-410a-87c5-215e2f8ddb53 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:05.674402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 342/677] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:05.675332 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fde3fe-a7ec-410a-87c5-215e2f8ddb53 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:05.763711 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849c9a5-5f17-4ada-9b1f-3e7f784cc1c0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:05.783322 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fde3fe-a7ec-410a-87c5-215e2f8ddb53 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:05.799610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733ef32-a3c7-4577-9419-0fe85d1c10b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:05.801336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733ef32-a3c7-4577-9419-0fe85d1c10b1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:05.801853 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733ef32-a3c7-4577-9419-0fe85d1c10b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:05.802361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733ef32-a3c7-4577-9419-0fe85d1c10b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:05.803723 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733ef32-a3c7-4577-9419-0fe85d1c10b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:05.804268 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733ef32-a3c7-4577-9419-0fe85d1c10b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:05.806303 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733ef32-a3c7-4577-9419-0fe85d1c10b1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:05.818868 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc41545-00b7-449c-bbfb-200a738b3054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:05.819636 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc41545-00b7-449c-bbfb-200a738b3054 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:05.819917 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc41545-00b7-449c-bbfb-200a738b3054 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:05.820184 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc41545-00b7-449c-bbfb-200a738b3054 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:05.823516 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 336/678] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:05.824360 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733ef32-a3c7-4577-9419-0fe85d1c10b1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:05.832662 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc41545-00b7-449c-bbfb-200a738b3054 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:05.834889 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc41545-00b7-449c-bbfb-200a738b3054 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:05.848816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-acc41545-00b7-449c-bbfb-200a738b3054 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:53:05.850365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 343/679] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:53:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:05.851195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc41545-00b7-449c-bbfb-200a738b3054 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:05.923169 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733ef32-a3c7-4577-9419-0fe85d1c10b1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:05.952051 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc41545-00b7-449c-bbfb-200a738b3054 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:05.956991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec18fec-cf33-4a0f-ac2e-24d85b9446cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:05.957642 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec18fec-cf33-4a0f-ac2e-24d85b9446cc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:05.957920 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec18fec-cf33-4a0f-ac2e-24d85b9446cc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:05.958194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec18fec-cf33-4a0f-ac2e-24d85b9446cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:05.959013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec18fec-cf33-4a0f-ac2e-24d85b9446cc None admin] RBAC: Adding query filter params (role.id=22681aa004f8450f964af121fc87d40a, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=9ba2cc8ae41b435d830e58327893f527) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:05.959316 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec18fec-cf33-4a0f-ac2e-24d85b9446cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:05.960737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec18fec-cf33-4a0f-ac2e-24d85b9446cc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:05.977531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 337/680] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:53:05 2022] GET /identity/v3/role_assignments?user.id=9ba2cc8ae41b435d830e58327893f527&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=22681aa004f8450f964af121fc87d40a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:05.978708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec18fec-cf33-4a0f-ac2e-24d85b9446cc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:05.985374 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df9fae-241e-46f0-ab21-958fdca115d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:05.986177 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df9fae-241e-46f0-ab21-958fdca115d0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:05.986454 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df9fae-241e-46f0-ab21-958fdca115d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:05.986723 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df9fae-241e-46f0-ab21-958fdca115d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:06.001349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df9fae-241e-46f0-ab21-958fdca115d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:06.002490 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df9fae-241e-46f0-ab21-958fdca115d0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:06.017103 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-c0df9fae-241e-46f0-ab21-958fdca115d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:06.023455 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 344/681] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:06.024625 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df9fae-241e-46f0-ab21-958fdca115d0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:06.211405 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec18fec-cf33-4a0f-ac2e-24d85b9446cc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:06.231435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df9fae-241e-46f0-ab21-958fdca115d0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:06.256342 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d9daa-0344-4f2a-85f6-1a9d9790e719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:06.257473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d9daa-0344-4f2a-85f6-1a9d9790e719 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:06.258230 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d9daa-0344-4f2a-85f6-1a9d9790e719 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:06.258904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d9daa-0344-4f2a-85f6-1a9d9790e719 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:06.260071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d9daa-0344-4f2a-85f6-1a9d9790e719 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:06.260869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d9daa-0344-4f2a-85f6-1a9d9790e719 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:06.262890 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d9daa-0344-4f2a-85f6-1a9d9790e719 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:06.269079 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f31df-0fc7-4a75-b309-0c99e3e6b0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:06.269796 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f31df-0fc7-4a75-b309-0c99e3e6b0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:06.270073 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f31df-0fc7-4a75-b309-0c99e3e6b0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:06.270344 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f31df-0fc7-4a75-b309-0c99e3e6b0b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:06.271125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f31df-0fc7-4a75-b309-0c99e3e6b0b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:06.271724 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f31df-0fc7-4a75-b309-0c99e3e6b0b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:06.273380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f31df-0fc7-4a75-b309-0c99e3e6b0b3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:06.284306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 338/682] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Sep 27 04:53:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:06.288512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 345/683] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:06.292890 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d9daa-0344-4f2a-85f6-1a9d9790e719 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:06.295187 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f31df-0fc7-4a75-b309-0c99e3e6b0b3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:06.393034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d9daa-0344-4f2a-85f6-1a9d9790e719 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:06.399255 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f31df-0fc7-4a75-b309-0c99e3e6b0b3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:06.429620 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35a8d7-affa-45f7-8508-742fe51c3710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:06.430317 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35a8d7-affa-45f7-8508-742fe51c3710 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:06.430601 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35a8d7-affa-45f7-8508-742fe51c3710 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:06.430873 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35a8d7-affa-45f7-8508-742fe51c3710 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:06.436426 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad14e9-1224-4cca-aef3-bc5d5f6d57d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:06.437370 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad14e9-1224-4cca-aef3-bc5d5f6d57d5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:06.437882 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad14e9-1224-4cca-aef3-bc5d5f6d57d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:06.438332 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad14e9-1224-4cca-aef3-bc5d5f6d57d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:06.439346 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad14e9-1224-4cca-aef3-bc5d5f6d57d5 None admin] RBAC: Adding query filter params (role.id=22681aa004f8450f964af121fc87d40a, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=639126e5b13345cda6490073ec57f4c1) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:06.440242 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad14e9-1224-4cca-aef3-bc5d5f6d57d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:06.441943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad14e9-1224-4cca-aef3-bc5d5f6d57d5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:06.452458 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 346/684] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:53:06 2022] GET /identity/v3/role_assignments?user.id=639126e5b13345cda6490073ec57f4c1&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=22681aa004f8450f964af121fc87d40a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:06.558317 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35a8d7-affa-45f7-8508-742fe51c3710 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:06.559793 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35a8d7-affa-45f7-8508-742fe51c3710 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:06.701625 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 339/685] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 04:53:06.710312 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad14e9-1224-4cca-aef3-bc5d5f6d57d5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:06.821602 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad14e9-1224-4cca-aef3-bc5d5f6d57d5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:06.863518 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909f704-74c3-4051-870c-ebf256c33770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:06.864331 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909f704-74c3-4051-870c-ebf256c33770 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:06.864611 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909f704-74c3-4051-870c-ebf256c33770 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:06.864912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909f704-74c3-4051-870c-ebf256c33770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:06.876251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909f704-74c3-4051-870c-ebf256c33770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:06.877772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909f704-74c3-4051-870c-ebf256c33770 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:06.905345 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-c909f704-74c3-4051-870c-ebf256c33770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:06.906567 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 347/686] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:06.912744 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35a8d7-affa-45f7-8508-742fe51c3710 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:07.002693 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d62f2-a6bb-4883-ac4d-0ccb4781a1a0 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:07.003003 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d62f2-a6bb-4883-ac4d-0ccb4781a1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:07.003245 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d62f2-a6bb-4883-ac4d-0ccb4781a1a0 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:07.005936 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 348/687] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:07.012391 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46597d-d9d6-4138-a7fb-e5301b73149d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:07.012956 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46597d-d9d6-4138-a7fb-e5301b73149d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:07.013424 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46597d-d9d6-4138-a7fb-e5301b73149d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:07.045608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4b46597d-d9d6-4138-a7fb-e5301b73149d None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:07.046819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4b46597d-d9d6-4138-a7fb-e5301b73149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:07.092072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35a8d7-affa-45f7-8508-742fe51c3710 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:07.138831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd2cbc-0eed-45ea-9f36-a86baaf75d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:07.139508 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd2cbc-0eed-45ea-9f36-a86baaf75d95 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:07.139787 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd2cbc-0eed-45ea-9f36-a86baaf75d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:07.140066 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd2cbc-0eed-45ea-9f36-a86baaf75d95 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:07.140806 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd2cbc-0eed-45ea-9f36-a86baaf75d95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:07.141123 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd2cbc-0eed-45ea-9f36-a86baaf75d95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:07.142504 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd2cbc-0eed-45ea-9f36-a86baaf75d95 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:07.167594 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 340/688] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:07.176812 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd2cbc-0eed-45ea-9f36-a86baaf75d95 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:07.177135 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 349/689] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:53:07.194454 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46597d-d9d6-4138-a7fb-e5301b73149d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:07.294969 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46597d-d9d6-4138-a7fb-e5301b73149d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:07.329214 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd2cbc-0eed-45ea-9f36-a86baaf75d95 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:07.330667 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375a1ae-48a4-4a47-b559-180b7f410448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:07.331767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375a1ae-48a4-4a47-b559-180b7f410448 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:07.332497 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375a1ae-48a4-4a47-b559-180b7f410448 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:07.333000 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375a1ae-48a4-4a47-b559-180b7f410448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:07.343722 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375a1ae-48a4-4a47-b559-180b7f410448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:07.345492 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375a1ae-48a4-4a47-b559-180b7f410448 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:07.363756 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-2375a1ae-48a4-4a47-b559-180b7f410448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:07.370136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 350/690] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:07.371784 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375a1ae-48a4-4a47-b559-180b7f410448 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:07.387402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97b4c6-8f68-4783-b3a0-12925addfe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:07.388149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97b4c6-8f68-4783-b3a0-12925addfe39 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:07.388430 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97b4c6-8f68-4783-b3a0-12925addfe39 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:07.388706 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97b4c6-8f68-4783-b3a0-12925addfe39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:07.400088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97b4c6-8f68-4783-b3a0-12925addfe39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:07.401577 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97b4c6-8f68-4783-b3a0-12925addfe39 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:07.430885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-4d97b4c6-8f68-4783-b3a0-12925addfe39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:07.432430 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 341/691] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:07.437554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97b4c6-8f68-4783-b3a0-12925addfe39 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:07.477574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375a1ae-48a4-4a47-b559-180b7f410448 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:07.513527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cab15-a23f-4456-bae4-5ee42c517fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:07.514685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cab15-a23f-4456-bae4-5ee42c517fec None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:07.515159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cab15-a23f-4456-bae4-5ee42c517fec None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:07.515618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cab15-a23f-4456-bae4-5ee42c517fec None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:07.516542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cab15-a23f-4456-bae4-5ee42c517fec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:07.517096 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cab15-a23f-4456-bae4-5ee42c517fec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:07.518675 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cab15-a23f-4456-bae4-5ee42c517fec None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:07.537189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 351/692] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:07.538997 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cab15-a23f-4456-bae4-5ee42c517fec None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:07.570418 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97b4c6-8f68-4783-b3a0-12925addfe39 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:07.619077 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1660266-e359-4379-8257-a76bfd4af3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:07.619445 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1660266-e359-4379-8257-a76bfd4af3de None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:07.619665 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1660266-e359-4379-8257-a76bfd4af3de None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:07.619941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1660266-e359-4379-8257-a76bfd4af3de None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:07.620759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1660266-e359-4379-8257-a76bfd4af3de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:07.621369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1660266-e359-4379-8257-a76bfd4af3de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:07.622870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1660266-e359-4379-8257-a76bfd4af3de None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:07.643564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 342/693] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:07.647919 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cab15-a23f-4456-bae4-5ee42c517fec None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:07.649796 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1660266-e359-4379-8257-a76bfd4af3de None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:07.699484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e616310-76df-4852-8e76-0a7cc28bf5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:07.701395 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e616310-76df-4852-8e76-0a7cc28bf5b3 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:07.702503 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e616310-76df-4852-8e76-0a7cc28bf5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:07.702968 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e616310-76df-4852-8e76-0a7cc28bf5b3 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:07.704548 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e616310-76df-4852-8e76-0a7cc28bf5b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:07.707897 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e616310-76df-4852-8e76-0a7cc28bf5b3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:07.745578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 352/694] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:53:07 2022] POST /identity/v3/users => generated 254 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:53:07.813797 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1660266-e359-4379-8257-a76bfd4af3de None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:07.864151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fd931-b2d3-4427-b51c-e7240f33ddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:07.865183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd931-b2d3-4427-b51c-e7240f33ddd9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:07.865600 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd931-b2d3-4427-b51c-e7240f33ddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:07.866007 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fd931-b2d3-4427-b51c-e7240f33ddd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:07.866980 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fd931-b2d3-4427-b51c-e7240f33ddd9 None admin] RBAC: Adding query filter params (role.id=22681aa004f8450f964af121fc87d40a, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=bfea15b51919441b921c10d02d11f693) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:07.867429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fd931-b2d3-4427-b51c-e7240f33ddd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:07.869034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fd931-b2d3-4427-b51c-e7240f33ddd9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:07.880211 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 343/695] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:53:07 2022] GET /identity/v3/role_assignments?user.id=bfea15b51919441b921c10d02d11f693&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=22681aa004f8450f964af121fc87d40a => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:08.030672 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a109fc-8b17-43ad-94d2-844384157a6c None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:08.031194 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a109fc-8b17-43ad-94d2-844384157a6c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:08.031640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a109fc-8b17-43ad-94d2-844384157a6c None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:08.034283 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 353/696] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:08.039805 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28320840-6942-4fda-bb0a-2c4a2173073f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:08.040311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28320840-6942-4fda-bb0a-2c4a2173073f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:08.040758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28320840-6942-4fda-bb0a-2c4a2173073f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:08.060482 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-28320840-6942-4fda-bb0a-2c4a2173073f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:08.061992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-28320840-6942-4fda-bb0a-2c4a2173073f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:08.136122 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 344/697] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:53:08.159597 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a109fc-8b17-43ad-94d2-844384157a6c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:08.270270 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a109fc-8b17-43ad-94d2-844384157a6c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:08.310446 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bd9a0-6d7f-4271-a809-8c981e503b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:08.311496 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bd9a0-6d7f-4271-a809-8c981e503b1a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:08.311914 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bd9a0-6d7f-4271-a809-8c981e503b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:08.312319 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bd9a0-6d7f-4271-a809-8c981e503b1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:08.326391 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6bd9a0-6d7f-4271-a809-8c981e503b1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:08.333952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-5d6bd9a0-6d7f-4271-a809-8c981e503b1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:53:08.335685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 354/698] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:53:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:08.342496 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28320840-6942-4fda-bb0a-2c4a2173073f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:08.448747 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28320840-6942-4fda-bb0a-2c4a2173073f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:08.488962 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe213b-89d5-4e4f-ac4e-e18f27e5f971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:08.489684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe213b-89d5-4e4f-ac4e-e18f27e5f971 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:08.489969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe213b-89d5-4e4f-ac4e-e18f27e5f971 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:08.490244 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe213b-89d5-4e4f-ac4e-e18f27e5f971 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:08.490998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe213b-89d5-4e4f-ac4e-e18f27e5f971 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:08.491305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe213b-89d5-4e4f-ac4e-e18f27e5f971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:08.492687 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe213b-89d5-4e4f-ac4e-e18f27e5f971 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:08.501960 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 345/699] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:53:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:08.507590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bd9a0-6d7f-4271-a809-8c981e503b1a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:08.632601 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bd9a0-6d7f-4271-a809-8c981e503b1a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:08.672273 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b39ab5-eb58-4425-91aa-1601dcbca747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:08.673107 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b39ab5-eb58-4425-91aa-1601dcbca747 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:08.673389 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b39ab5-eb58-4425-91aa-1601dcbca747 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:08.673666 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b39ab5-eb58-4425-91aa-1601dcbca747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:08.684700 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b39ab5-eb58-4425-91aa-1601dcbca747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:08.686195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b39ab5-eb58-4425-91aa-1601dcbca747 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:08.714375 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-24b39ab5-eb58-4425-91aa-1601dcbca747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:08.715855 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 355/700] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:08.721284 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe213b-89d5-4e4f-ac4e-e18f27e5f971 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:08.951733 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe213b-89d5-4e4f-ac4e-e18f27e5f971 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:09.057495 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dde05f-bb54-4511-82b4-f7a7462f36e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:09.058177 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dde05f-bb54-4511-82b4-f7a7462f36e1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:09.058461 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dde05f-bb54-4511-82b4-f7a7462f36e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:09.058742 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dde05f-bb54-4511-82b4-f7a7462f36e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:09.059466 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dde05f-bb54-4511-82b4-f7a7462f36e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:09.059770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dde05f-bb54-4511-82b4-f7a7462f36e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:09.061164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dde05f-bb54-4511-82b4-f7a7462f36e1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:09.077951 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 346/701] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:09.083018 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b39ab5-eb58-4425-91aa-1601dcbca747 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:09.184290 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b39ab5-eb58-4425-91aa-1601dcbca747 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:09.224921 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f944ad7-b323-4820-a42f-36108caf6fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:09.225736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f944ad7-b323-4820-a42f-36108caf6fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:09.226016 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f944ad7-b323-4820-a42f-36108caf6fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:09.226288 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f944ad7-b323-4820-a42f-36108caf6fd6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:09.234742 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f944ad7-b323-4820-a42f-36108caf6fd6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:09.236136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f944ad7-b323-4820-a42f-36108caf6fd6 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:09.255009 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-6f944ad7-b323-4820-a42f-36108caf6fd6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:53:09.256396 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 356/702] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 27 04:53:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:09.263351 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dde05f-bb54-4511-82b4-f7a7462f36e1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:09.329489 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb82bc-e74d-47c0-bff5-a770565ba355 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:09.329792 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb82bc-e74d-47c0-bff5-a770565ba355 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:09.330049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb82bc-e74d-47c0-bff5-a770565ba355 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:09.332202 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 357/703] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:53:09.337287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4f8bd-8ffe-446b-9a57-f44668dcb33b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:09.337574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4f8bd-8ffe-446b-9a57-f44668dcb33b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:09.337853 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4f8bd-8ffe-446b-9a57-f44668dcb33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:09.370287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-def4f8bd-8ffe-446b-9a57-f44668dcb33b None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:09.371754 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-def4f8bd-8ffe-446b-9a57-f44668dcb33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:09.376606 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dde05f-bb54-4511-82b4-f7a7462f36e1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:09.416856 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0e778-74ea-4a4c-9fe1-eefaeb69048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:09.417590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0e778-74ea-4a4c-9fe1-eefaeb69048b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:09.417874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0e778-74ea-4a4c-9fe1-eefaeb69048b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:09.418149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0e778-74ea-4a4c-9fe1-eefaeb69048b None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:09.418990 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0e778-74ea-4a4c-9fe1-eefaeb69048b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:09.419299 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0e778-74ea-4a4c-9fe1-eefaeb69048b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:09.420740 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0e778-74ea-4a4c-9fe1-eefaeb69048b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:09.443791 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 347/704] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 27 04:53:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:09.449490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf05cc-657a-4f98-9f0c-ce06c58a459d None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:09.450012 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf05cc-657a-4f98-9f0c-ce06c58a459d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:09.450083 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf05cc-657a-4f98-9f0c-ce06c58a459d None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:09.452047 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 348/705] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:09.452784 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf05cc-657a-4f98-9f0c-ce06c58a459d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:09.484958 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 358/706] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:53:09.486273 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309805d3-1f69-475c-81f5-a938c72aad83 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:09.486567 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309805d3-1f69-475c-81f5-a938c72aad83 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:09.486843 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309805d3-1f69-475c-81f5-a938c72aad83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:09.516372 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-309805d3-1f69-475c-81f5-a938c72aad83 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:09.518191 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-309805d3-1f69-475c-81f5-a938c72aad83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:09.573322 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf05cc-657a-4f98-9f0c-ce06c58a459d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:09.601164 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 359/707] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:53:09.602102 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309805d3-1f69-475c-81f5-a938c72aad83 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:09.617852 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe117c1f-86c0-4dd8-9e02-c3565b12d9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:09.618517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe117c1f-86c0-4dd8-9e02-c3565b12d9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:09.618807 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe117c1f-86c0-4dd8-9e02-c3565b12d9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:09.619086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe117c1f-86c0-4dd8-9e02-c3565b12d9a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:09.695221 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe117c1f-86c0-4dd8-9e02-c3565b12d9a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:09.696685 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe117c1f-86c0-4dd8-9e02-c3565b12d9a0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:09.708934 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309805d3-1f69-475c-81f5-a938c72aad83 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:09.748068 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dde1f9-053a-4fe4-8e7d-320cb8ba51ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:09.748819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dde1f9-053a-4fe4-8e7d-320cb8ba51ec None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:09.749102 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dde1f9-053a-4fe4-8e7d-320cb8ba51ec None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:09.749377 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dde1f9-053a-4fe4-8e7d-320cb8ba51ec None admin] PATH_INFO: `/v3/services/network` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:09.750038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dde1f9-053a-4fe4-8e7d-320cb8ba51ec None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:09.751409 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dde1f9-053a-4fe4-8e7d-320cb8ba51ec None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:09.764462 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-03dde1f9-053a-4fe4-8e7d-320cb8ba51ec None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 04:53:09.771336 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 360/708] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:09 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:09.772281 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dde1f9-053a-4fe4-8e7d-320cb8ba51ec None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:09.803343 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 349/709] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:53:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:53:09.804262 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe117c1f-86c0-4dd8-9e02-c3565b12d9a0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:09.878941 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dde1f9-053a-4fe4-8e7d-320cb8ba51ec None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:09.913040 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba062a6-1217-4821-bfd1-d64e291a796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:09.913391 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe117c1f-86c0-4dd8-9e02-c3565b12d9a0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:09.913849 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba062a6-1217-4821-bfd1-d64e291a796a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:09.914131 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba062a6-1217-4821-bfd1-d64e291a796a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:09.914409 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba062a6-1217-4821-bfd1-d64e291a796a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:09.915062 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba062a6-1217-4821-bfd1-d64e291a796a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:09.916451 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba062a6-1217-4821-bfd1-d64e291a796a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:09.929329 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-3ba062a6-1217-4821-bfd1-d64e291a796a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 04:53:09.931377 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 361/710] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Sep 27 04:53:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:09.932160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba062a6-1217-4821-bfd1-d64e291a796a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:09.952314 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f265d19-a6be-41dc-8ee2-57d4d703ca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:09.953013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f265d19-a6be-41dc-8ee2-57d4d703ca86 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:09.953294 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f265d19-a6be-41dc-8ee2-57d4d703ca86 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:09.953568 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f265d19-a6be-41dc-8ee2-57d4d703ca86 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:09.954272 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f265d19-a6be-41dc-8ee2-57d4d703ca86 None admin] RBAC: Adding query filter params (name=network) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:09.954577 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f265d19-a6be-41dc-8ee2-57d4d703ca86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:09.955960 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f265d19-a6be-41dc-8ee2-57d4d703ca86 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:09.960829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 350/711] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 27 04:53:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:09.961597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f265d19-a6be-41dc-8ee2-57d4d703ca86 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:10.042609 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba062a6-1217-4821-bfd1-d64e291a796a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:10.064813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f265d19-a6be-41dc-8ee2-57d4d703ca86 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:10.077316 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1be48b-0f23-449e-bc08-2efa6da13d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:10.078113 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1be48b-0f23-449e-bc08-2efa6da13d7d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:10.078397 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1be48b-0f23-449e-bc08-2efa6da13d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:10.078670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1be48b-0f23-449e-bc08-2efa6da13d7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:10.089753 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1be48b-0f23-449e-bc08-2efa6da13d7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:10.091213 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1be48b-0f23-449e-bc08-2efa6da13d7d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:10.099813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43b850-fb7a-4a9c-b49a-c82fe3ba6f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:10.100483 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43b850-fb7a-4a9c-b49a-c82fe3ba6f3a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:10.100762 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43b850-fb7a-4a9c-b49a-c82fe3ba6f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:10.101079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43b850-fb7a-4a9c-b49a-c82fe3ba6f3a None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:10.101789 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43b850-fb7a-4a9c-b49a-c82fe3ba6f3a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:10.102094 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43b850-fb7a-4a9c-b49a-c82fe3ba6f3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:10.103451 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43b850-fb7a-4a9c-b49a-c82fe3ba6f3a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:10.107887 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 351/712] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Sep 27 04:53:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:10.108653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43b850-fb7a-4a9c-b49a-c82fe3ba6f3a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:10.109763 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-7a1be48b-0f23-449e-bc08-2efa6da13d7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:10.111262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 362/713] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:10.116776 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1be48b-0f23-449e-bc08-2efa6da13d7d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:10.219338 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43b850-fb7a-4a9c-b49a-c82fe3ba6f3a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:10.220276 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1be48b-0f23-449e-bc08-2efa6da13d7d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:10.255954 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc3859-b128-4bea-8691-277fd15108f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:10.256155 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2911c84-5b6a-43e4-bb95-5b0aef14dd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:10.256615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc3859-b128-4bea-8691-277fd15108f4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:10.256720 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2911c84-5b6a-43e4-bb95-5b0aef14dd59 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:10.256919 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc3859-b128-4bea-8691-277fd15108f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:10.257012 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2911c84-5b6a-43e4-bb95-5b0aef14dd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:10.257189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc3859-b128-4bea-8691-277fd15108f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:10.257284 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2911c84-5b6a-43e4-bb95-5b0aef14dd59 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:10.257907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc3859-b128-4bea-8691-277fd15108f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:10.258026 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2911c84-5b6a-43e4-bb95-5b0aef14dd59 None admin] RBAC: Adding query filter params (type=network) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:10.258205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc3859-b128-4bea-8691-277fd15108f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:10.258373 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2911c84-5b6a-43e4-bb95-5b0aef14dd59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:10.259580 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc3859-b128-4bea-8691-277fd15108f4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:10.259747 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2911c84-5b6a-43e4-bb95-5b0aef14dd59 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:10.265630 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 352/714] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 27 04:53:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:10.266515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2911c84-5b6a-43e4-bb95-5b0aef14dd59 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:10.272908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 363/715] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:10.278409 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc3859-b128-4bea-8691-277fd15108f4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:10.377625 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2911c84-5b6a-43e4-bb95-5b0aef14dd59 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:10.384200 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc3859-b128-4bea-8691-277fd15108f4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:10.415301 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eed2c4-904e-412a-96e0-ad193fc77007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:10.415988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eed2c4-904e-412a-96e0-ad193fc77007 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:10.416268 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eed2c4-904e-412a-96e0-ad193fc77007 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:10.416547 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eed2c4-904e-412a-96e0-ad193fc77007 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:10.417518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eed2c4-904e-412a-96e0-ad193fc77007 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:10.417825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eed2c4-904e-412a-96e0-ad193fc77007 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:10.420700 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eed2c4-904e-412a-96e0-ad193fc77007 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:10.426199 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 353/716] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Sep 27 04:53:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:10.465739 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326c74a-cd67-4a3b-ac8a-3106c18c5a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:10.467010 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326c74a-cd67-4a3b-ac8a-3106c18c5a07 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:10.467493 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326c74a-cd67-4a3b-ac8a-3106c18c5a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:10.467974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326c74a-cd67-4a3b-ac8a-3106c18c5a07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:10.482314 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326c74a-cd67-4a3b-ac8a-3106c18c5a07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:10.484216 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326c74a-cd67-4a3b-ac8a-3106c18c5a07 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:10.509426 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-6326c74a-cd67-4a3b-ac8a-3106c18c5a07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:10.511457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 364/717] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:10.516978 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eed2c4-904e-412a-96e0-ad193fc77007 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:10.644686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eed2c4-904e-412a-96e0-ad193fc77007 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:10.655044 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabdf76-b87b-44d3-aaef-00a9e9d64356 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:10.655416 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabdf76-b87b-44d3-aaef-00a9e9d64356 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:10.655633 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabdf76-b87b-44d3-aaef-00a9e9d64356 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:10.657804 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 365/718] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:10.664395 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48920e1a-fcd5-4f52-881d-a4c77a972c33 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:10.664680 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48920e1a-fcd5-4f52-881d-a4c77a972c33 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:10.665024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48920e1a-fcd5-4f52-881d-a4c77a972c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:10.682595 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782b01b-4596-4bed-8020-522aee692d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:10.683264 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782b01b-4596-4bed-8020-522aee692d08 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:10.683540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782b01b-4596-4bed-8020-522aee692d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:10.683825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782b01b-4596-4bed-8020-522aee692d08 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:10.684605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782b01b-4596-4bed-8020-522aee692d08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:10.684941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782b01b-4596-4bed-8020-522aee692d08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:10.685320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-48920e1a-fcd5-4f52-881d-a4c77a972c33 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:10.686447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782b01b-4596-4bed-8020-522aee692d08 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:10.686557 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-48920e1a-fcd5-4f52-881d-a4c77a972c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:10.700829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 354/719] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:10.706599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782b01b-4596-4bed-8020-522aee692d08 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:10.774134 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 366/720] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:53:10.799192 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48920e1a-fcd5-4f52-881d-a4c77a972c33 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:10.811076 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782b01b-4596-4bed-8020-522aee692d08 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:10.849573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199a895-41f5-4d2a-8419-491fbd58babf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:10.850248 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199a895-41f5-4d2a-8419-491fbd58babf None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:10.850528 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199a895-41f5-4d2a-8419-491fbd58babf None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:10.850800 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199a895-41f5-4d2a-8419-491fbd58babf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:10.851628 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199a895-41f5-4d2a-8419-491fbd58babf None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=faac84ed9d37420c811bbf6ac7df0b35) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:10.851934 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199a895-41f5-4d2a-8419-491fbd58babf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:10.853438 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199a895-41f5-4d2a-8419-491fbd58babf None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:10.869014 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 355/721] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:53:10 2022] GET /identity/v3/role_assignments?user.id=faac84ed9d37420c811bbf6ac7df0b35&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:10.914025 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48920e1a-fcd5-4f52-881d-a4c77a972c33 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:10.951032 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de319e1-1b7d-4a4c-879f-01d0cbe175f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:10.951844 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de319e1-1b7d-4a4c-879f-01d0cbe175f0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:10.952128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de319e1-1b7d-4a4c-879f-01d0cbe175f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:10.952408 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de319e1-1b7d-4a4c-879f-01d0cbe175f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:10.964466 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de319e1-1b7d-4a4c-879f-01d0cbe175f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:10.971815 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-8de319e1-1b7d-4a4c-879f-01d0cbe175f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:53:10.973892 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 367/722] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:53:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:10.980031 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199a895-41f5-4d2a-8419-491fbd58babf None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:11.033038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e3e89-40be-482c-a5b9-a99b6eb21189 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:11.033342 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e3e89-40be-482c-a5b9-a99b6eb21189 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:11.033594 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e3e89-40be-482c-a5b9-a99b6eb21189 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:11.037445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 368/723] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:53:11.042160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2ab07-18a0-4aac-bdfc-cdeb01d48513 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:11.042439 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2ab07-18a0-4aac-bdfc-cdeb01d48513 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:11.042716 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2ab07-18a0-4aac-bdfc-cdeb01d48513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:11.082580 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f3d2ab07-18a0-4aac-bdfc-cdeb01d48513 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:11.084023 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f3d2ab07-18a0-4aac-bdfc-cdeb01d48513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:11.093759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199a895-41f5-4d2a-8419-491fbd58babf None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:11.133737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccd595-88f5-4c95-89c6-31f2e19dd333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:11.134782 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccd595-88f5-4c95-89c6-31f2e19dd333 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:11.135209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccd595-88f5-4c95-89c6-31f2e19dd333 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:11.135498 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccd595-88f5-4c95-89c6-31f2e19dd333 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:11.136255 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccd595-88f5-4c95-89c6-31f2e19dd333 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:11.136563 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccd595-88f5-4c95-89c6-31f2e19dd333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:11.138262 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccd595-88f5-4c95-89c6-31f2e19dd333 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:11.147568 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 356/724] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:53:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:11.152867 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccd595-88f5-4c95-89c6-31f2e19dd333 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:11.207102 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 369/725] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 27 04:53:11.251190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2ab07-18a0-4aac-bdfc-cdeb01d48513 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:11.264699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccd595-88f5-4c95-89c6-31f2e19dd333 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:11.303102 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c311d3-4e6d-474c-9946-27b88d2f8058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:11.303908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c311d3-4e6d-474c-9946-27b88d2f8058 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:11.304189 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c311d3-4e6d-474c-9946-27b88d2f8058 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:11.304464 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c311d3-4e6d-474c-9946-27b88d2f8058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:11.316985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c311d3-4e6d-474c-9946-27b88d2f8058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:11.318595 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c311d3-4e6d-474c-9946-27b88d2f8058 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:11.337175 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-20c311d3-4e6d-474c-9946-27b88d2f8058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:11.338822 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 357/726] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:11.344563 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c311d3-4e6d-474c-9946-27b88d2f8058 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:11.454950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2ab07-18a0-4aac-bdfc-cdeb01d48513 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:11.458559 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c311d3-4e6d-474c-9946-27b88d2f8058 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:11.495146 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88211cf1-e719-4aff-9174-a79e11c5efa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:11.495819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88211cf1-e719-4aff-9174-a79e11c5efa9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:11.496350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88211cf1-e719-4aff-9174-a79e11c5efa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:11.496959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88211cf1-e719-4aff-9174-a79e11c5efa9 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:11.497699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88211cf1-e719-4aff-9174-a79e11c5efa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:11.498008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88211cf1-e719-4aff-9174-a79e11c5efa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:11.499795 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88211cf1-e719-4aff-9174-a79e11c5efa9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:11.516950 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 358/727] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:11.519349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88211cf1-e719-4aff-9174-a79e11c5efa9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:11.541496 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e29987-e83c-46ef-9a5b-fce7b1a0f108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:11.542310 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e29987-e83c-46ef-9a5b-fce7b1a0f108 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:11.542595 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e29987-e83c-46ef-9a5b-fce7b1a0f108 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:11.542928 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e29987-e83c-46ef-9a5b-fce7b1a0f108 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:11.568824 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e29987-e83c-46ef-9a5b-fce7b1a0f108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:11.577624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-26e29987-e83c-46ef-9a5b-fce7b1a0f108 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:53:11.579446 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 370/728] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:53:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:11.585736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e29987-e83c-46ef-9a5b-fce7b1a0f108 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:11.634413 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88211cf1-e719-4aff-9174-a79e11c5efa9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:11.672848 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50366903-2530-44b5-afea-6023e3562066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:11.673680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50366903-2530-44b5-afea-6023e3562066 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:11.673960 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50366903-2530-44b5-afea-6023e3562066 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:11.674242 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50366903-2530-44b5-afea-6023e3562066 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:11.683452 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50366903-2530-44b5-afea-6023e3562066 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:11.685009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50366903-2530-44b5-afea-6023e3562066 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:11.702752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-50366903-2530-44b5-afea-6023e3562066 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:53:11.708889 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 359/729] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 27 04:53:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:11.711123 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50366903-2530-44b5-afea-6023e3562066 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:11.822300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50366903-2530-44b5-afea-6023e3562066 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:11.850776 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e29987-e83c-46ef-9a5b-fce7b1a0f108 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:11.864253 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6a0d4-08b5-4fed-8624-85a46d1cb270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:11.864963 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6a0d4-08b5-4fed-8624-85a46d1cb270 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:11.865250 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6a0d4-08b5-4fed-8624-85a46d1cb270 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:11.865529 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6a0d4-08b5-4fed-8624-85a46d1cb270 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:11.866441 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6a0d4-08b5-4fed-8624-85a46d1cb270 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:11.867213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6a0d4-08b5-4fed-8624-85a46d1cb270 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:11.869155 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6a0d4-08b5-4fed-8624-85a46d1cb270 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:11.890050 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 360/730] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Sep 27 04:53:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:11.896174 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6a0d4-08b5-4fed-8624-85a46d1cb270 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:11.961583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01a30c-c1a3-4968-844f-21eac00cb1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:11.962195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01a30c-c1a3-4968-844f-21eac00cb1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:11.962480 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01a30c-c1a3-4968-844f-21eac00cb1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:11.962756 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01a30c-c1a3-4968-844f-21eac00cb1f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:11.963507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01a30c-c1a3-4968-844f-21eac00cb1f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:11.963813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01a30c-c1a3-4968-844f-21eac00cb1f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:11.965227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01a30c-c1a3-4968-844f-21eac00cb1f8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:11.987062 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 371/731] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:53:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:12.001837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01a30c-c1a3-4968-844f-21eac00cb1f8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:12.005964 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6a0d4-08b5-4fed-8624-85a46d1cb270 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:12.042784 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3d356-af65-43b9-a307-033998749ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:12.043831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3d356-af65-43b9-a307-033998749ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:12.044118 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3d356-af65-43b9-a307-033998749ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:12.044397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3d356-af65-43b9-a307-033998749ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:12.122109 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3d356-af65-43b9-a307-033998749ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:12.123751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3d356-af65-43b9-a307-033998749ab5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:12.240898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 361/732] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:53:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 27 04:53:12.246984 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3d356-af65-43b9-a307-033998749ab5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:12.250244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01a30c-c1a3-4968-844f-21eac00cb1f8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:12.345471 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbcf9b-9da9-43e8-b338-a2d1ae78f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:12.346319 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbcf9b-9da9-43e8-b338-a2d1ae78f54e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:12.346590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbcf9b-9da9-43e8-b338-a2d1ae78f54e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:12.346856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbcf9b-9da9-43e8-b338-a2d1ae78f54e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:12.352042 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3d356-af65-43b9-a307-033998749ab5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:12.372611 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbcf9b-9da9-43e8-b338-a2d1ae78f54e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:12.374086 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbcf9b-9da9-43e8-b338-a2d1ae78f54e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:12.389188 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768194d-ce82-4a8a-90d5-4f2e4076f059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:12.389986 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768194d-ce82-4a8a-90d5-4f2e4076f059 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:12.390670 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768194d-ce82-4a8a-90d5-4f2e4076f059 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:12.390962 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768194d-ce82-4a8a-90d5-4f2e4076f059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:12.401554 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-cccbcf9b-9da9-43e8-b338-a2d1ae78f54e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:12.401770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768194d-ce82-4a8a-90d5-4f2e4076f059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:12.403003 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768194d-ce82-4a8a-90d5-4f2e4076f059 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:12.409279 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 372/733] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:12.415342 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbcf9b-9da9-43e8-b338-a2d1ae78f54e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:12.421082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-c768194d-ce82-4a8a-90d5-4f2e4076f059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:12.423449 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 362/734] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:12.431852 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768194d-ce82-4a8a-90d5-4f2e4076f059 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:12.552565 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768194d-ce82-4a8a-90d5-4f2e4076f059 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:12.587759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93273ec2-646f-4f48-82b1-09778e56b267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:12.588440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93273ec2-646f-4f48-82b1-09778e56b267 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:12.588723 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93273ec2-646f-4f48-82b1-09778e56b267 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:12.589077 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93273ec2-646f-4f48-82b1-09778e56b267 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:12.589917 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93273ec2-646f-4f48-82b1-09778e56b267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:12.590114 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93273ec2-646f-4f48-82b1-09778e56b267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:12.591496 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93273ec2-646f-4f48-82b1-09778e56b267 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:12.603497 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 363/735] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:12.604727 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbcf9b-9da9-43e8-b338-a2d1ae78f54e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:12.608769 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93273ec2-646f-4f48-82b1-09778e56b267 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:12.645543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4b6c5-a60c-44b2-8a24-f89405ddfd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:12.646607 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4b6c5-a60c-44b2-8a24-f89405ddfd19 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:12.647095 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4b6c5-a60c-44b2-8a24-f89405ddfd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:12.647571 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4b6c5-a60c-44b2-8a24-f89405ddfd19 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:12.648563 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4b6c5-a60c-44b2-8a24-f89405ddfd19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:12.649093 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4b6c5-a60c-44b2-8a24-f89405ddfd19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:12.651578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4b6c5-a60c-44b2-8a24-f89405ddfd19 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:12.674968 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 373/736] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:12.680924 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4b6c5-a60c-44b2-8a24-f89405ddfd19 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:12.801809 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4b6c5-a60c-44b2-8a24-f89405ddfd19 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:12.815325 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93273ec2-646f-4f48-82b1-09778e56b267 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:12.868929 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a00eb3-b07c-438c-a9f2-516c99861280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:12.869727 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a00eb3-b07c-438c-a9f2-516c99861280 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:12.870002 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a00eb3-b07c-438c-a9f2-516c99861280 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:12.870268 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a00eb3-b07c-438c-a9f2-516c99861280 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:12.881706 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caa33c-aa69-415c-bafd-8663aabd3f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:12.882570 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caa33c-aa69-415c-bafd-8663aabd3f6b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:12.882848 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caa33c-aa69-415c-bafd-8663aabd3f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:12.883115 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caa33c-aa69-415c-bafd-8663aabd3f6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:12.886434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a00eb3-b07c-438c-a9f2-516c99861280 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:12.891868 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a00eb3-b07c-438c-a9f2-516c99861280 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:12.895689 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caa33c-aa69-415c-bafd-8663aabd3f6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:12.897164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caa33c-aa69-415c-bafd-8663aabd3f6b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:12.910374 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-08a00eb3-b07c-438c-a9f2-516c99861280 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:53:12.916303 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 374/737] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:53:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:12.917504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a00eb3-b07c-438c-a9f2-516c99861280 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:12.924361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-89caa33c-aa69-415c-bafd-8663aabd3f6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:12.926420 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 364/738] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:12.932064 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caa33c-aa69-415c-bafd-8663aabd3f6b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:13.041387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a00eb3-b07c-438c-a9f2-516c99861280 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:13.081890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd42c6-3ea4-4e02-a67f-8108585038c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:13.083159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd42c6-3ea4-4e02-a67f-8108585038c7 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:13.083637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd42c6-3ea4-4e02-a67f-8108585038c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:13.084101 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd42c6-3ea4-4e02-a67f-8108585038c7 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:13.085213 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd42c6-3ea4-4e02-a67f-8108585038c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:13.085747 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd42c6-3ea4-4e02-a67f-8108585038c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:13.087522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd42c6-3ea4-4e02-a67f-8108585038c7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:13.115925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 375/739] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Sep 27 04:53:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:13.117729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd42c6-3ea4-4e02-a67f-8108585038c7 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:13.220359 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caa33c-aa69-415c-bafd-8663aabd3f6b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:13.232277 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd42c6-3ea4-4e02-a67f-8108585038c7 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:13.282132 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba46e7f-4e16-46d8-b17b-4a42d4277ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:13.283635 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba46e7f-4e16-46d8-b17b-4a42d4277ecd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:13.284108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba46e7f-4e16-46d8-b17b-4a42d4277ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:13.285155 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba46e7f-4e16-46d8-b17b-4a42d4277ecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:13.293067 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d644db-024b-4267-a804-9c76e07cd38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:13.293335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d644db-024b-4267-a804-9c76e07cd38b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:13.293558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d644db-024b-4267-a804-9c76e07cd38b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:13.293838 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d644db-024b-4267-a804-9c76e07cd38b None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:13.294630 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d644db-024b-4267-a804-9c76e07cd38b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:13.294937 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d644db-024b-4267-a804-9c76e07cd38b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:13.296382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d644db-024b-4267-a804-9c76e07cd38b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:13.308971 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 365/740] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:13.318161 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d644db-024b-4267-a804-9c76e07cd38b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:13.406542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba46e7f-4e16-46d8-b17b-4a42d4277ecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:13.408774 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba46e7f-4e16-46d8-b17b-4a42d4277ecd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:13.429685 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d644db-024b-4267-a804-9c76e07cd38b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:13.467810 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11a5d5-4afc-47f5-b549-0d21fdc0b914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:13.468463 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11a5d5-4afc-47f5-b549-0d21fdc0b914 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:13.468763 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11a5d5-4afc-47f5-b549-0d21fdc0b914 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:13.469053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11a5d5-4afc-47f5-b549-0d21fdc0b914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:13.469895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11a5d5-4afc-47f5-b549-0d21fdc0b914 None admin] RBAC: Adding query filter params (role.id=22681aa004f8450f964af121fc87d40a, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=d27fb10124d24c8ea208a4d020274269) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:13.470198 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11a5d5-4afc-47f5-b549-0d21fdc0b914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:13.471629 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11a5d5-4afc-47f5-b549-0d21fdc0b914 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:13.477579 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 366/741] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:53:13 2022] GET /identity/v3/role_assignments?user.id=d27fb10124d24c8ea208a4d020274269&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=22681aa004f8450f964af121fc87d40a => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:13.478813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f9214-1cd3-4302-9c4b-1f1c68c775ad None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:13.479097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f9214-1cd3-4302-9c4b-1f1c68c775ad None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:13.479373 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f9214-1cd3-4302-9c4b-1f1c68c775ad None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:13.485183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 367/742] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:13.485183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610ffea-5863-42ff-835c-72510f1c394f None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:13.485183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610ffea-5863-42ff-835c-72510f1c394f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:13.485183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610ffea-5863-42ff-835c-72510f1c394f None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:13.488856 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 368/743] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:13.490187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5c0d5-677e-4a14-b5e6-bca816462f41 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:13.490475 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5c0d5-677e-4a14-b5e6-bca816462f41 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:13.490759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5c0d5-677e-4a14-b5e6-bca816462f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:13.508874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-21b5c0d5-677e-4a14-b5e6-bca816462f41 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:13.510111 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-21b5c0d5-677e-4a14-b5e6-bca816462f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:13.530071 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 376/744] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:53:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 27 04:53:13.531796 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e7762-4c32-47b7-8dd3-aefb9ba6cbce None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:13.532822 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e7762-4c32-47b7-8dd3-aefb9ba6cbce None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:13.533306 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e7762-4c32-47b7-8dd3-aefb9ba6cbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:13.556233 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3c4e7762-4c32-47b7-8dd3-aefb9ba6cbce None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:13.558614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3c4e7762-4c32-47b7-8dd3-aefb9ba6cbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:13.592820 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 369/745] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:53:13.592820 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5c0d5-677e-4a14-b5e6-bca816462f41 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:13.647377 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 377/746] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:53:13.648826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fd3f0-de62-43fb-ad33-f12413d43c7b None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:13.649114 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fd3f0-de62-43fb-ad33-f12413d43c7b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:13.649384 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fd3f0-de62-43fb-ad33-f12413d43c7b None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:13.651286 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 378/747] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:13.656071 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fd3f0-de62-43fb-ad33-f12413d43c7b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:13.708841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5c0d5-677e-4a14-b5e6-bca816462f41 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:13.744687 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ae484-38ce-4ba3-86ef-edc9c003c623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:13.745512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae484-38ce-4ba3-86ef-edc9c003c623 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:13.745804 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae484-38ce-4ba3-86ef-edc9c003c623 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:13.746074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ae484-38ce-4ba3-86ef-edc9c003c623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:13.756227 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ae484-38ce-4ba3-86ef-edc9c003c623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:13.757730 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ae484-38ce-4ba3-86ef-edc9c003c623 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:13.765718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fd3f0-de62-43fb-ad33-f12413d43c7b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:13.774621 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-f84ae484-38ce-4ba3-86ef-edc9c003c623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:13.780229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 370/748] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:13.780229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb9c5e-2e33-4cb7-8f2a-59f7f647961c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:13.780229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb9c5e-2e33-4cb7-8f2a-59f7f647961c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:13.780229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb9c5e-2e33-4cb7-8f2a-59f7f647961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:13.794552 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-16cb9c5e-2e33-4cb7-8f2a-59f7f647961c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:13.795736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-16cb9c5e-2e33-4cb7-8f2a-59f7f647961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:13.805739 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fe6f3-f875-4a05-b8fb-90ca6e217a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:13.806402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fe6f3-f875-4a05-b8fb-90ca6e217a09 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:13.806685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fe6f3-f875-4a05-b8fb-90ca6e217a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:13.806960 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fe6f3-f875-4a05-b8fb-90ca6e217a09 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:13.807679 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fe6f3-f875-4a05-b8fb-90ca6e217a09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:13.809089 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fe6f3-f875-4a05-b8fb-90ca6e217a09 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:13.825398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 379/749] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 27 04:53:13 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:53:13.829016 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fe6f3-f875-4a05-b8fb-90ca6e217a09 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:13.907708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 371/750] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 27 04:53:13.908619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb9c5e-2e33-4cb7-8f2a-59f7f647961c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:13.987466 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fe6f3-f875-4a05-b8fb-90ca6e217a09 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:14.029284 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f6ecb-e151-4e7c-a64a-52456fd01736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:14.030071 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f6ecb-e151-4e7c-a64a-52456fd01736 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:14.030349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f6ecb-e151-4e7c-a64a-52456fd01736 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:14.030620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f6ecb-e151-4e7c-a64a-52456fd01736 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:14.042950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f6ecb-e151-4e7c-a64a-52456fd01736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:14.049935 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-2b2f6ecb-e151-4e7c-a64a-52456fd01736 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:53:14.051965 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 380/751] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:53:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:14.052710 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f6ecb-e151-4e7c-a64a-52456fd01736 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:14.054195 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb9c5e-2e33-4cb7-8f2a-59f7f647961c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:14.097592 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3887e4-ed71-4cd0-a220-8e6d3701bf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:14.098760 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3887e4-ed71-4cd0-a220-8e6d3701bf2f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:14.099070 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3887e4-ed71-4cd0-a220-8e6d3701bf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:14.099639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3887e4-ed71-4cd0-a220-8e6d3701bf2f None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:14.100370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3887e4-ed71-4cd0-a220-8e6d3701bf2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:14.100676 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3887e4-ed71-4cd0-a220-8e6d3701bf2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:14.102132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3887e4-ed71-4cd0-a220-8e6d3701bf2f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:14.115143 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 372/752] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:14.115972 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3887e4-ed71-4cd0-a220-8e6d3701bf2f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:14.167997 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f6ecb-e151-4e7c-a64a-52456fd01736 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:14.202811 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48153343-5f11-42cd-b104-bcd9568148dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:14.203529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48153343-5f11-42cd-b104-bcd9568148dc None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:14.203820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48153343-5f11-42cd-b104-bcd9568148dc None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:14.204099 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48153343-5f11-42cd-b104-bcd9568148dc None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:14.204839 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48153343-5f11-42cd-b104-bcd9568148dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:14.206221 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48153343-5f11-42cd-b104-bcd9568148dc None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:14.222552 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 381/753] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 27 04:53:14 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:53:14.223879 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48153343-5f11-42cd-b104-bcd9568148dc None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:14.225153 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3887e4-ed71-4cd0-a220-8e6d3701bf2f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:14.319301 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce4643-82e0-4b3a-8188-61ab4210c3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:14.320263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce4643-82e0-4b3a-8188-61ab4210c3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:14.320965 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce4643-82e0-4b3a-8188-61ab4210c3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:14.322829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce4643-82e0-4b3a-8188-61ab4210c3e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:14.323796 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce4643-82e0-4b3a-8188-61ab4210c3e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:14.324985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce4643-82e0-4b3a-8188-61ab4210c3e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:14.326588 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce4643-82e0-4b3a-8188-61ab4210c3e9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:14.346916 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 373/754] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:53:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:14.353565 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce4643-82e0-4b3a-8188-61ab4210c3e9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:14.402699 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48153343-5f11-42cd-b104-bcd9568148dc None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:14.442955 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8dd3a-8d0d-4944-8c88-db21d4ceb4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:14.444134 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8dd3a-8d0d-4944-8c88-db21d4ceb4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:14.444605 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8dd3a-8d0d-4944-8c88-db21d4ceb4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:14.445116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8dd3a-8d0d-4944-8c88-db21d4ceb4f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:14.452824 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8dd3a-8d0d-4944-8c88-db21d4ceb4f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:14.454806 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8dd3a-8d0d-4944-8c88-db21d4ceb4f9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:14.470160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-abf8dd3a-8d0d-4944-8c88-db21d4ceb4f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:14.472594 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 382/755] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:14.478680 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8dd3a-8d0d-4944-8c88-db21d4ceb4f9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:14.512470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce4643-82e0-4b3a-8188-61ab4210c3e9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:14.555955 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766efc6-eecd-4589-b74e-3ee6f0a694cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:14.557161 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766efc6-eecd-4589-b74e-3ee6f0a694cf None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:14.557635 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766efc6-eecd-4589-b74e-3ee6f0a694cf None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:14.558124 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766efc6-eecd-4589-b74e-3ee6f0a694cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:14.570002 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766efc6-eecd-4589-b74e-3ee6f0a694cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:14.572869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766efc6-eecd-4589-b74e-3ee6f0a694cf None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:14.590597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-7766efc6-eecd-4589-b74e-3ee6f0a694cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:14.591421 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8dd3a-8d0d-4944-8c88-db21d4ceb4f9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:14.592646 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 374/756] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:14.598542 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766efc6-eecd-4589-b74e-3ee6f0a694cf None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:14.633883 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c657a-bf99-4e90-92e9-6d9f56bf8ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:14.634881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c657a-bf99-4e90-92e9-6d9f56bf8ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:14.635483 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c657a-bf99-4e90-92e9-6d9f56bf8ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:14.636625 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c657a-bf99-4e90-92e9-6d9f56bf8ae3 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:14.637818 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c657a-bf99-4e90-92e9-6d9f56bf8ae3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:14.639337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c657a-bf99-4e90-92e9-6d9f56bf8ae3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:14.641005 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c657a-bf99-4e90-92e9-6d9f56bf8ae3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:14.655001 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 383/757] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:14.662595 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c657a-bf99-4e90-92e9-6d9f56bf8ae3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:14.724639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766efc6-eecd-4589-b74e-3ee6f0a694cf None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:14.762145 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e1d5d-7919-407d-93b5-6000f407a6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:14.762819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e1d5d-7919-407d-93b5-6000f407a6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:14.763094 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e1d5d-7919-407d-93b5-6000f407a6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:14.763367 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e1d5d-7919-407d-93b5-6000f407a6b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:14.764088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e1d5d-7919-407d-93b5-6000f407a6b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:14.764392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e1d5d-7919-407d-93b5-6000f407a6b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:14.766290 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e1d5d-7919-407d-93b5-6000f407a6b2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:14.780013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 375/758] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:14.784966 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e1d5d-7919-407d-93b5-6000f407a6b2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:14.876595 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c657a-bf99-4e90-92e9-6d9f56bf8ae3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:14.931756 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e1d5d-7919-407d-93b5-6000f407a6b2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:14.964159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8012ce-47c9-4386-b14b-e8373c69a60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:14.965249 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8012ce-47c9-4386-b14b-e8373c69a60a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:14.965748 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8012ce-47c9-4386-b14b-e8373c69a60a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:14.966045 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32e900-f362-4428-83bc-a181554b33de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:14.966447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8012ce-47c9-4386-b14b-e8373c69a60a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:14.966841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32e900-f362-4428-83bc-a181554b33de None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:14.967121 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32e900-f362-4428-83bc-a181554b33de None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:14.967395 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32e900-f362-4428-83bc-a181554b33de None admin] PATH_INFO: `/v3/users/nova` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:14.968085 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8012ce-47c9-4386-b14b-e8373c69a60a None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=bfea15b51919441b921c10d02d11f693) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:14.968595 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8012ce-47c9-4386-b14b-e8373c69a60a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:14.970236 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8012ce-47c9-4386-b14b-e8373c69a60a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:14.975196 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32e900-f362-4428-83bc-a181554b33de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:14.976222 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32e900-f362-4428-83bc-a181554b33de None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:14.987024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 384/759] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:53:14 2022] GET /identity/v3/role_assignments?user.id=bfea15b51919441b921c10d02d11f693&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 259 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:14.991547 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-4a32e900-f362-4428-83bc-a181554b33de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:53:14.992192 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 376/760] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 27 04:53:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:14.997902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8012ce-47c9-4386-b14b-e8373c69a60a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:15.152905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8012ce-47c9-4386-b14b-e8373c69a60a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:15.202461 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71341673-74fe-4490-8f50-6fd50413433c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:15.203492 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71341673-74fe-4490-8f50-6fd50413433c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:15.203977 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71341673-74fe-4490-8f50-6fd50413433c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:15.204476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71341673-74fe-4490-8f50-6fd50413433c None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:15.205550 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71341673-74fe-4490-8f50-6fd50413433c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:15.206065 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71341673-74fe-4490-8f50-6fd50413433c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:15.207905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71341673-74fe-4490-8f50-6fd50413433c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:15.239076 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 385/761] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 27 04:53:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:15.244097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32e900-f362-4428-83bc-a181554b33de None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:15.388187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32e900-f362-4428-83bc-a181554b33de None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:15.438123 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e8e14-e890-4b5d-baf9-adb14e3ae7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:15.439079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e8e14-e890-4b5d-baf9-adb14e3ae7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:15.439362 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e8e14-e890-4b5d-baf9-adb14e3ae7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:15.439682 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e8e14-e890-4b5d-baf9-adb14e3ae7d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:15.450523 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e8e14-e890-4b5d-baf9-adb14e3ae7d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:15.451976 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e8e14-e890-4b5d-baf9-adb14e3ae7d5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:15.472886 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-520e8e14-e890-4b5d-baf9-adb14e3ae7d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:15.474426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 377/762] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:15.479551 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71341673-74fe-4490-8f50-6fd50413433c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:15.602588 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71341673-74fe-4490-8f50-6fd50413433c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:15.644828 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209a2c7-f409-4faf-8560-4833c76b75cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:15.645849 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209a2c7-f409-4faf-8560-4833c76b75cd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:15.646307 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209a2c7-f409-4faf-8560-4833c76b75cd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:15.646728 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209a2c7-f409-4faf-8560-4833c76b75cd None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:15.647609 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209a2c7-f409-4faf-8560-4833c76b75cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:15.648061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209a2c7-f409-4faf-8560-4833c76b75cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:15.649605 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209a2c7-f409-4faf-8560-4833c76b75cd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:15.666378 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 386/763] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:15.673853 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e8e14-e890-4b5d-baf9-adb14e3ae7d5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:15.815305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e8e14-e890-4b5d-baf9-adb14e3ae7d5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:15.859605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f83ba0-0025-40f6-8eb4-cd730dc59574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:15.860399 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f83ba0-0025-40f6-8eb4-cd730dc59574 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:15.860676 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f83ba0-0025-40f6-8eb4-cd730dc59574 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:15.860974 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f83ba0-0025-40f6-8eb4-cd730dc59574 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:15.870068 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f83ba0-0025-40f6-8eb4-cd730dc59574 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:15.871775 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f83ba0-0025-40f6-8eb4-cd730dc59574 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:15.886397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-46f83ba0-0025-40f6-8eb4-cd730dc59574 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:15.887955 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 378/764] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:15.893498 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209a2c7-f409-4faf-8560-4833c76b75cd None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:16.012021 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209a2c7-f409-4faf-8560-4833c76b75cd None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:16.057681 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498d260-fb52-4790-81ae-ebc459fb45d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:16.058753 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498d260-fb52-4790-81ae-ebc459fb45d2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:16.059265 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498d260-fb52-4790-81ae-ebc459fb45d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:16.059773 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498d260-fb52-4790-81ae-ebc459fb45d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:16.060826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498d260-fb52-4790-81ae-ebc459fb45d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:16.061366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498d260-fb52-4790-81ae-ebc459fb45d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:16.063048 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498d260-fb52-4790-81ae-ebc459fb45d2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:16.077288 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 387/765] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:16.082500 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f83ba0-0025-40f6-8eb4-cd730dc59574 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:16.202039 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f83ba0-0025-40f6-8eb4-cd730dc59574 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:16.249538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debe492-e8dc-4af0-83c5-7b485bff6449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:16.250844 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debe492-e8dc-4af0-83c5-7b485bff6449 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:16.251327 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debe492-e8dc-4af0-83c5-7b485bff6449 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:16.251800 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debe492-e8dc-4af0-83c5-7b485bff6449 None admin] PATH_INFO: `/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/faac84ed9d37420c811bbf6ac7df0b35/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:16.254243 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debe492-e8dc-4af0-83c5-7b485bff6449 None admin] RBAC: Authorizing `identity:create_grant(project_id=470fa8cf5f4a443faea9cfc628ff6003, user_id=faac84ed9d37420c811bbf6ac7df0b35, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:16.255913 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debe492-e8dc-4af0-83c5-7b485bff6449 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:16.283159 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 379/766] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:53:16 2022] PUT /identity/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/faac84ed9d37420c811bbf6ac7df0b35/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:53:16.603403 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec388c4-44b2-4c4a-b3a1-003430604429 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:16.604405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec388c4-44b2-4c4a-b3a1-003430604429 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:16.604936 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec388c4-44b2-4c4a-b3a1-003430604429 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:16.607233 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 388/767] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:16.612991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa08e0-4685-40fa-a9d7-61d4ce1713be None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:16.613612 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa08e0-4685-40fa-a9d7-61d4ce1713be None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:16.614288 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa08e0-4685-40fa-a9d7-61d4ce1713be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:16.634554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2faa08e0-4685-40fa-a9d7-61d4ce1713be None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:16.636052 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2faa08e0-4685-40fa-a9d7-61d4ce1713be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:16.663148 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e08e8-5df0-41f8-98ee-09dff8c0b4b0 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:16.663443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e08e8-5df0-41f8-98ee-09dff8c0b4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:16.663688 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e08e8-5df0-41f8-98ee-09dff8c0b4b0 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:16.665770 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 389/768] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:53:16.670924 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46835a-f3dc-4614-a054-61d6d651f85a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:16.671208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46835a-f3dc-4614-a054-61d6d651f85a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:16.671482 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46835a-f3dc-4614-a054-61d6d651f85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:16.702492 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7e46835a-f3dc-4614-a054-61d6d651f85a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:16.703694 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7e46835a-f3dc-4614-a054-61d6d651f85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:16.758336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 380/769] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:16.785229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa08e0-4685-40fa-a9d7-61d4ce1713be None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:16.790137 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 390/770] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:53:16.818399 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46835a-f3dc-4614-a054-61d6d651f85a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:16.937627 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46835a-f3dc-4614-a054-61d6d651f85a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:16.986803 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe9264-c1ce-4a96-b8c1-8249ca0fdf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:16.987752 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe9264-c1ce-4a96-b8c1-8249ca0fdf97 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:16.988228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe9264-c1ce-4a96-b8c1-8249ca0fdf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:16.991410 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe9264-c1ce-4a96-b8c1-8249ca0fdf97 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:16.991410 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe9264-c1ce-4a96-b8c1-8249ca0fdf97 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:16.991410 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe9264-c1ce-4a96-b8c1-8249ca0fdf97 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:17.011827 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa08e0-4685-40fa-a9d7-61d4ce1713be None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:17.017688 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-e1fe9264-c1ce-4a96-b8c1-8249ca0fdf97 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 04:53:17.028885 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 391/771] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Sep 27 04:53:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:17.046229 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe9264-c1ce-4a96-b8c1-8249ca0fdf97 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:17.088405 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d60d9-99d7-4b89-8453-0f7c7cabc82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:17.089283 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d60d9-99d7-4b89-8453-0f7c7cabc82a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:17.089559 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d60d9-99d7-4b89-8453-0f7c7cabc82a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:17.089831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d60d9-99d7-4b89-8453-0f7c7cabc82a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:17.106671 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d60d9-99d7-4b89-8453-0f7c7cabc82a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:17.123458 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-5c3d60d9-99d7-4b89-8453-0f7c7cabc82a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:53:17.124702 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 381/772] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:53:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:17.131332 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d60d9-99d7-4b89-8453-0f7c7cabc82a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:17.239196 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe9264-c1ce-4a96-b8c1-8249ca0fdf97 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:17.281670 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d60d9-99d7-4b89-8453-0f7c7cabc82a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:17.286632 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e64c89-dfeb-4e7e-a91b-458beff72d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:17.287307 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e64c89-dfeb-4e7e-a91b-458beff72d07 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:17.287585 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e64c89-dfeb-4e7e-a91b-458beff72d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:17.287858 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e64c89-dfeb-4e7e-a91b-458beff72d07 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:17.288568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e64c89-dfeb-4e7e-a91b-458beff72d07 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:17.288901 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e64c89-dfeb-4e7e-a91b-458beff72d07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:17.290293 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e64c89-dfeb-4e7e-a91b-458beff72d07 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:17.295678 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 392/773] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Sep 27 04:53:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:17.297005 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9edebe-b092-4264-a24b-2d774aa58de9 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:17.297291 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9edebe-b092-4264-a24b-2d774aa58de9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:17.297567 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9edebe-b092-4264-a24b-2d774aa58de9 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:17.303992 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 393/774] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:17.304838 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9edebe-b092-4264-a24b-2d774aa58de9 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:17.324312 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db277e7e-32fc-4757-97fb-38accafa9c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:17.325036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db277e7e-32fc-4757-97fb-38accafa9c41 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:17.325315 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db277e7e-32fc-4757-97fb-38accafa9c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:17.325594 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db277e7e-32fc-4757-97fb-38accafa9c41 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:17.326343 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db277e7e-32fc-4757-97fb-38accafa9c41 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:17.326648 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db277e7e-32fc-4757-97fb-38accafa9c41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:17.328023 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db277e7e-32fc-4757-97fb-38accafa9c41 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:17.337934 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 382/775] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:53:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:17.339199 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d6ea9-df85-43f8-8e49-cbc68b44580c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:17.339487 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d6ea9-df85-43f8-8e49-cbc68b44580c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:17.339766 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d6ea9-df85-43f8-8e49-cbc68b44580c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:17.357357 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-413d6ea9-df85-43f8-8e49-cbc68b44580c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:17.358590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-413d6ea9-df85-43f8-8e49-cbc68b44580c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:17.423883 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9edebe-b092-4264-a24b-2d774aa58de9 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:17.435302 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 383/776] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:17.436149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d6ea9-df85-43f8-8e49-cbc68b44580c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:17.479439 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa76fe2-f13c-46e5-ab0b-2f900c4ea1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:17.480465 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa76fe2-f13c-46e5-ab0b-2f900c4ea1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:17.481006 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa76fe2-f13c-46e5-ab0b-2f900c4ea1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:17.481479 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa76fe2-f13c-46e5-ab0b-2f900c4ea1f0 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:17.482381 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa76fe2-f13c-46e5-ab0b-2f900c4ea1f0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:17.482923 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa76fe2-f13c-46e5-ab0b-2f900c4ea1f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:17.484513 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa76fe2-f13c-46e5-ab0b-2f900c4ea1f0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:17.491393 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 394/777] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Sep 27 04:53:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:17.492528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa76fe2-f13c-46e5-ab0b-2f900c4ea1f0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:17.541213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d6ea9-df85-43f8-8e49-cbc68b44580c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:17.576221 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd7790-c43b-43f0-bc23-8e5d560ca6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:17.577103 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd7790-c43b-43f0-bc23-8e5d560ca6bf None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:17.577383 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd7790-c43b-43f0-bc23-8e5d560ca6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:17.577657 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd7790-c43b-43f0-bc23-8e5d560ca6bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:17.588285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd7790-c43b-43f0-bc23-8e5d560ca6bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:17.589816 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd7790-c43b-43f0-bc23-8e5d560ca6bf None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:17.596350 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa76fe2-f13c-46e5-ab0b-2f900c4ea1f0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:17.607910 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-12fd7790-c43b-43f0-bc23-8e5d560ca6bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:17.614102 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 384/778] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:17.614102 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd7790-c43b-43f0-bc23-8e5d560ca6bf None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:17.638034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0af802-e1bb-4d3c-b7cb-da684194091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:17.639490 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0af802-e1bb-4d3c-b7cb-da684194091a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:17.639978 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0af802-e1bb-4d3c-b7cb-da684194091a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:17.640445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0af802-e1bb-4d3c-b7cb-da684194091a None admin] PATH_INFO: `/v3/services/network` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:17.641201 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0af802-e1bb-4d3c-b7cb-da684194091a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:17.642779 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0af802-e1bb-4d3c-b7cb-da684194091a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:17.654125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-1a0af802-e1bb-4d3c-b7cb-da684194091a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 04:53:17.655553 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 395/779] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:17 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:17.656543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0af802-e1bb-4d3c-b7cb-da684194091a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:17.711883 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd7790-c43b-43f0-bc23-8e5d560ca6bf None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:17.744949 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ff3a8-580d-495e-a17b-a663fefac728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:17.745532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ff3a8-580d-495e-a17b-a663fefac728 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:17.745810 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ff3a8-580d-495e-a17b-a663fefac728 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:17.746083 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ff3a8-580d-495e-a17b-a663fefac728 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:17.747129 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ff3a8-580d-495e-a17b-a663fefac728 None admin] RBAC: Adding query filter params (interface=public, service_id=e43e5ce2899649eea99c49ac7ba31c3b, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:17.747437 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ff3a8-580d-495e-a17b-a663fefac728 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:17.748863 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ff3a8-580d-495e-a17b-a663fefac728 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:17.760838 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 385/780] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Sep 27 04:53:17 2022] GET /identity/v3/endpoints?service_id=e43e5ce2899649eea99c49ac7ba31c3b&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:17.762071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d69e91-0108-439f-ad81-7035f17d06a7 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:17.762360 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d69e91-0108-439f-ad81-7035f17d06a7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:17.762651 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d69e91-0108-439f-ad81-7035f17d06a7 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:17.764312 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 386/781] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:17.765034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d69e91-0108-439f-ad81-7035f17d06a7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:17.766008 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0af802-e1bb-4d3c-b7cb-da684194091a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:17.802679 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b182181-2af3-4d38-9a7b-45e8ae22f4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:17.803347 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b182181-2af3-4d38-9a7b-45e8ae22f4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:17.803622 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b182181-2af3-4d38-9a7b-45e8ae22f4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:17.803892 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b182181-2af3-4d38-9a7b-45e8ae22f4d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:17.804598 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b182181-2af3-4d38-9a7b-45e8ae22f4d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:17.804931 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b182181-2af3-4d38-9a7b-45e8ae22f4d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:17.806291 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b182181-2af3-4d38-9a7b-45e8ae22f4d2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:17.818307 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 396/782] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:17.819118 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b182181-2af3-4d38-9a7b-45e8ae22f4d2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:17.878350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d69e91-0108-439f-ad81-7035f17d06a7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:17.913367 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90527e-2134-48b5-bdd4-7b92274ecd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:17.914033 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90527e-2134-48b5-bdd4-7b92274ecd69 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:17.914305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90527e-2134-48b5-bdd4-7b92274ecd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:17.914574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90527e-2134-48b5-bdd4-7b92274ecd69 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:17.915270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90527e-2134-48b5-bdd4-7b92274ecd69 None admin] RBAC: Adding query filter params (name=network) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:17.915573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90527e-2134-48b5-bdd4-7b92274ecd69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:17.916952 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90527e-2134-48b5-bdd4-7b92274ecd69 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:17.921421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 387/783] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 27 04:53:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:17.922599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e300a1-626c-4079-9d9a-1c17e6e694f9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:17.922708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b182181-2af3-4d38-9a7b-45e8ae22f4d2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:17.922874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e300a1-626c-4079-9d9a-1c17e6e694f9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:17.923149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e300a1-626c-4079-9d9a-1c17e6e694f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:17.939900 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-52e300a1-626c-4079-9d9a-1c17e6e694f9 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:17.941363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-52e300a1-626c-4079-9d9a-1c17e6e694f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:17.960216 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59941da0-d7c8-4b07-9011-ab729521092f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:17.961211 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941da0-d7c8-4b07-9011-ab729521092f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:17.961667 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941da0-d7c8-4b07-9011-ab729521092f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:17.962111 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941da0-d7c8-4b07-9011-ab729521092f None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:17.962974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59941da0-d7c8-4b07-9011-ab729521092f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:17.964509 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59941da0-d7c8-4b07-9011-ab729521092f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:17.969394 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 397/784] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 27 04:53:17 2022] GET /identity/v3/services => generated 772 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:17.977851 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59941da0-d7c8-4b07-9011-ab729521092f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:18.025173 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 388/785] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:18.026489 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e300a1-626c-4079-9d9a-1c17e6e694f9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:18.109898 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59941da0-d7c8-4b07-9011-ab729521092f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:18.137286 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e300a1-626c-4079-9d9a-1c17e6e694f9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:18.147304 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0041c2a-0cb1-4450-a09a-45ba2b68982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:18.148120 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0041c2a-0cb1-4450-a09a-45ba2b68982c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:18.148396 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0041c2a-0cb1-4450-a09a-45ba2b68982c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:18.148666 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0041c2a-0cb1-4450-a09a-45ba2b68982c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:18.156342 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0041c2a-0cb1-4450-a09a-45ba2b68982c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:18.158126 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0041c2a-0cb1-4450-a09a-45ba2b68982c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:18.174660 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-d0041c2a-0cb1-4450-a09a-45ba2b68982c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:53:18.176525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 398/786] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 27 04:53:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:18.177189 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d64b2-135f-4145-8f30-3250f613f3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:18.177323 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0041c2a-0cb1-4450-a09a-45ba2b68982c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:18.178174 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d64b2-135f-4145-8f30-3250f613f3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:18.178619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d64b2-135f-4145-8f30-3250f613f3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:18.179031 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d64b2-135f-4145-8f30-3250f613f3a0 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:18.179880 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d64b2-135f-4145-8f30-3250f613f3a0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:18.180329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d64b2-135f-4145-8f30-3250f613f3a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:18.181885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d64b2-135f-4145-8f30-3250f613f3a0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:18.187859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 389/787] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 27 04:53:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:18.188905 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d64b2-135f-4145-8f30-3250f613f3a0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:18.289423 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0041c2a-0cb1-4450-a09a-45ba2b68982c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:18.294906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d64b2-135f-4145-8f30-3250f613f3a0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:18.324469 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a83dce-c4bf-4df9-b2fb-f07e7ef8fd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:18.325351 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a83dce-c4bf-4df9-b2fb-f07e7ef8fd04 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:18.325626 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a83dce-c4bf-4df9-b2fb-f07e7ef8fd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:18.325898 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a83dce-c4bf-4df9-b2fb-f07e7ef8fd04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:18.330524 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdc090-f09e-442b-a706-9aaca09013e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:18.331542 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdc090-f09e-442b-a706-9aaca09013e6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:18.331973 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdc090-f09e-442b-a706-9aaca09013e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:18.332397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdc090-f09e-442b-a706-9aaca09013e6 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:18.333414 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdc090-f09e-442b-a706-9aaca09013e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:18.333870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdc090-f09e-442b-a706-9aaca09013e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:18.335486 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdc090-f09e-442b-a706-9aaca09013e6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:18.337450 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a83dce-c4bf-4df9-b2fb-f07e7ef8fd04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:18.344394 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-f0a83dce-c4bf-4df9-b2fb-f07e7ef8fd04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:53:18.346038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 399/788] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:53:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:18.347410 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a83dce-c4bf-4df9-b2fb-f07e7ef8fd04 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:18.355046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 390/789] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Sep 27 04:53:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:18.356216 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdc090-f09e-442b-a706-9aaca09013e6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:18.454989 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a83dce-c4bf-4df9-b2fb-f07e7ef8fd04 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:18.460712 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdc090-f09e-442b-a706-9aaca09013e6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:18.489865 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43b78b-f55d-43a5-bb96-efc3a829c71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:18.490525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43b78b-f55d-43a5-bb96-efc3a829c71a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:18.490806 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43b78b-f55d-43a5-bb96-efc3a829c71a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:18.491081 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43b78b-f55d-43a5-bb96-efc3a829c71a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:18.491910 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43b78b-f55d-43a5-bb96-efc3a829c71a None admin] RBAC: Adding query filter params (interface=public, service_id=b0cf90b321874469ab039de6531eef76, region_id=RegionOne) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:18.492181 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43b78b-f55d-43a5-bb96-efc3a829c71a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:18.493591 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43b78b-f55d-43a5-bb96-efc3a829c71a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:18.498344 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6155adb-3b39-4d83-89c6-86bcffdcbbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:18.499223 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6155adb-3b39-4d83-89c6-86bcffdcbbee None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:18.499683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6155adb-3b39-4d83-89c6-86bcffdcbbee None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:18.500136 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6155adb-3b39-4d83-89c6-86bcffdcbbee None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:18.501107 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6155adb-3b39-4d83-89c6-86bcffdcbbee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:18.501590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6155adb-3b39-4d83-89c6-86bcffdcbbee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:18.503261 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6155adb-3b39-4d83-89c6-86bcffdcbbee None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:18.507318 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 400/790] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Sep 27 04:53:18 2022] GET /identity/v3/endpoints?service_id=b0cf90b321874469ab039de6531eef76&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:18.508237 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43b78b-f55d-43a5-bb96-efc3a829c71a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:18.513190 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 391/791] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:53:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:18.514329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6155adb-3b39-4d83-89c6-86bcffdcbbee None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:18.611151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43b78b-f55d-43a5-bb96-efc3a829c71a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:18.615848 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6155adb-3b39-4d83-89c6-86bcffdcbbee None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:18.647006 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077f7aa-09c6-4884-93e7-3ba92b7d0d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:18.647920 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077f7aa-09c6-4884-93e7-3ba92b7d0d12 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:18.648095 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077f7aa-09c6-4884-93e7-3ba92b7d0d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:18.648361 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077f7aa-09c6-4884-93e7-3ba92b7d0d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:18.652909 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4edcc-a4a7-478f-b59b-136041c60673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:18.653931 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4edcc-a4a7-478f-b59b-136041c60673 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:18.654471 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4edcc-a4a7-478f-b59b-136041c60673 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:18.654947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4edcc-a4a7-478f-b59b-136041c60673 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:18.655851 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4edcc-a4a7-478f-b59b-136041c60673 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:18.657527 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4edcc-a4a7-478f-b59b-136041c60673 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:18.661982 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077f7aa-09c6-4884-93e7-3ba92b7d0d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:18.663469 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077f7aa-09c6-4884-93e7-3ba92b7d0d12 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:18.665184 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 392/792] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 27 04:53:18 2022] GET /identity/v3/services => generated 772 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:18.666348 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4edcc-a4a7-478f-b59b-136041c60673 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:18.711687 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-1077f7aa-09c6-4884-93e7-3ba92b7d0d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:18.715534 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 401/793] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:18.720045 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077f7aa-09c6-4884-93e7-3ba92b7d0d12 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:18.884337 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4edcc-a4a7-478f-b59b-136041c60673 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:18.901889 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077f7aa-09c6-4884-93e7-3ba92b7d0d12 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:18.918792 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e97040-5d8a-4ea0-bc79-b2950d05354a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:18.919596 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e97040-5d8a-4ea0-bc79-b2950d05354a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:18.919876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e97040-5d8a-4ea0-bc79-b2950d05354a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:18.920147 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e97040-5d8a-4ea0-bc79-b2950d05354a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:18.931556 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e97040-5d8a-4ea0-bc79-b2950d05354a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:18.933041 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e97040-5d8a-4ea0-bc79-b2950d05354a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:18.939142 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018536e-e19a-4d4a-a3bb-4c0409dc7221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:18.940090 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018536e-e19a-4d4a-a3bb-4c0409dc7221 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:18.940572 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018536e-e19a-4d4a-a3bb-4c0409dc7221 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:18.941146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018536e-e19a-4d4a-a3bb-4c0409dc7221 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:18.942075 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018536e-e19a-4d4a-a3bb-4c0409dc7221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:18.942601 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018536e-e19a-4d4a-a3bb-4c0409dc7221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:18.944189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018536e-e19a-4d4a-a3bb-4c0409dc7221 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:18.950511 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-c5e97040-5d8a-4ea0-bc79-b2950d05354a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:18.952054 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 393/794] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:18.958048 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e97040-5d8a-4ea0-bc79-b2950d05354a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:18.961130 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 402/795] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:18.964628 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018536e-e19a-4d4a-a3bb-4c0409dc7221 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:19.079718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018536e-e19a-4d4a-a3bb-4c0409dc7221 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:19.080334 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e97040-5d8a-4ea0-bc79-b2950d05354a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:19.118471 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab56e9-6d8e-4cc6-adb6-a640e96f09e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:19.118704 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c610b1-752d-4c75-9bc0-7f6c9410a214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:19.119140 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab56e9-6d8e-4cc6-adb6-a640e96f09e6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:19.119318 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c610b1-752d-4c75-9bc0-7f6c9410a214 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:19.119412 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab56e9-6d8e-4cc6-adb6-a640e96f09e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:19.119592 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c610b1-752d-4c75-9bc0-7f6c9410a214 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:19.119701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab56e9-6d8e-4cc6-adb6-a640e96f09e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:19.119875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c610b1-752d-4c75-9bc0-7f6c9410a214 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:19.120426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab56e9-6d8e-4cc6-adb6-a640e96f09e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:19.120667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab56e9-6d8e-4cc6-adb6-a640e96f09e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:19.122598 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab56e9-6d8e-4cc6-adb6-a640e96f09e6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:19.127899 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c610b1-752d-4c75-9bc0-7f6c9410a214 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:19.130211 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c610b1-752d-4c75-9bc0-7f6c9410a214 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:19.137047 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 394/796] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:19.138617 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f600757-f8d6-466f-9d68-cf8fcb02255e None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:19.138905 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f600757-f8d6-466f-9d68-cf8fcb02255e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:19.139179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f600757-f8d6-466f-9d68-cf8fcb02255e None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:19.140829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 395/797] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:19.145524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-97c610b1-752d-4c75-9bc0-7f6c9410a214 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:19.145851 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f600757-f8d6-466f-9d68-cf8fcb02255e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:19.147227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 403/798] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:19.148501 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cc9cf-181c-4219-b070-b9b244c6e2b6 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:19.149012 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cc9cf-181c-4219-b070-b9b244c6e2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:19.149313 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cc9cf-181c-4219-b070-b9b244c6e2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:19.170894 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f23cc9cf-181c-4219-b070-b9b244c6e2b6 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:19.172588 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f23cc9cf-181c-4219-b070-b9b244c6e2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:19.251309 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 404/799] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:19.252307 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cc9cf-181c-4219-b070-b9b244c6e2b6 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:19.292857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f600757-f8d6-466f-9d68-cf8fcb02255e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:19.327049 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afd109-6ef2-4546-9f98-6a4d743e14a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:19.327903 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afd109-6ef2-4546-9f98-6a4d743e14a0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:19.328187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afd109-6ef2-4546-9f98-6a4d743e14a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:19.328460 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afd109-6ef2-4546-9f98-6a4d743e14a0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:19.336453 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afd109-6ef2-4546-9f98-6a4d743e14a0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:19.338025 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afd109-6ef2-4546-9f98-6a4d743e14a0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:19.351975 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-01afd109-6ef2-4546-9f98-6a4d743e14a0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:53:19.353541 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 396/800] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:53:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:19.354540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afd109-6ef2-4546-9f98-6a4d743e14a0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:19.368277 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cc9cf-181c-4219-b070-b9b244c6e2b6 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:19.412667 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704fea4-48e5-4a49-a3d8-8f2cc5f4a2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:19.413418 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704fea4-48e5-4a49-a3d8-8f2cc5f4a2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:19.414009 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704fea4-48e5-4a49-a3d8-8f2cc5f4a2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:19.414286 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704fea4-48e5-4a49-a3d8-8f2cc5f4a2c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:19.415338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704fea4-48e5-4a49-a3d8-8f2cc5f4a2c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:19.415648 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704fea4-48e5-4a49-a3d8-8f2cc5f4a2c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:19.417808 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704fea4-48e5-4a49-a3d8-8f2cc5f4a2c3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:19.435348 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 405/801] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:19.436339 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704fea4-48e5-4a49-a3d8-8f2cc5f4a2c3 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:19.455497 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afd109-6ef2-4546-9f98-6a4d743e14a0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:19.490580 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc1efd-48c1-4b7d-9bb1-7c4131ae23ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:19.491459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc1efd-48c1-4b7d-9bb1-7c4131ae23ab None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:19.491804 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc1efd-48c1-4b7d-9bb1-7c4131ae23ab None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:19.492143 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc1efd-48c1-4b7d-9bb1-7c4131ae23ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:19.502948 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc1efd-48c1-4b7d-9bb1-7c4131ae23ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:19.510977 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-cbdc1efd-48c1-4b7d-9bb1-7c4131ae23ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:53:19.517231 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 397/802] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:53:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:19.518091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc1efd-48c1-4b7d-9bb1-7c4131ae23ab None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:19.552116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704fea4-48e5-4a49-a3d8-8f2cc5f4a2c3 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:19.586253 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f362bf-9b0d-44c0-a77d-ae8178f759c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:19.587014 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f362bf-9b0d-44c0-a77d-ae8178f759c4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:19.587351 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f362bf-9b0d-44c0-a77d-ae8178f759c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:19.587693 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f362bf-9b0d-44c0-a77d-ae8178f759c4 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:19.588600 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f362bf-9b0d-44c0-a77d-ae8178f759c4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:19.589012 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f362bf-9b0d-44c0-a77d-ae8178f759c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:19.590524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f362bf-9b0d-44c0-a77d-ae8178f759c4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:19.609059 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 406/803] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Sep 27 04:53:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:19.610101 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f362bf-9b0d-44c0-a77d-ae8178f759c4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:19.647122 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc1efd-48c1-4b7d-9bb1-7c4131ae23ab None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:19.682545 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6d3df-a7b9-4572-b197-ad49571ec041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:19.683960 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6d3df-a7b9-4572-b197-ad49571ec041 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:19.684687 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6d3df-a7b9-4572-b197-ad49571ec041 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:19.685152 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6d3df-a7b9-4572-b197-ad49571ec041 None admin] PATH_INFO: `/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/d27fb10124d24c8ea208a4d020274269/roles/22681aa004f8450f964af121fc87d40a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:19.703963 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6d3df-a7b9-4572-b197-ad49571ec041 None admin] RBAC: Authorizing `identity:create_grant(project_id=470fa8cf5f4a443faea9cfc628ff6003, user_id=d27fb10124d24c8ea208a4d020274269, role_id=22681aa004f8450f964af121fc87d40a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:19.706046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6d3df-a7b9-4572-b197-ad49571ec041 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:19.722475 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f362bf-9b0d-44c0-a77d-ae8178f759c4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:19.724228 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 398/804] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:53:19 2022] PUT /identity/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/d27fb10124d24c8ea208a4d020274269/roles/22681aa004f8450f964af121fc87d40a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:53:19.725423 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6d3df-a7b9-4572-b197-ad49571ec041 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:19.770196 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1227e9-9f6e-4938-883a-319d81c802cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:19.771287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1227e9-9f6e-4938-883a-319d81c802cd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:19.771778 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1227e9-9f6e-4938-883a-319d81c802cd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:19.772251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1227e9-9f6e-4938-883a-319d81c802cd None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:19.773347 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1227e9-9f6e-4938-883a-319d81c802cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:19.774468 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1227e9-9f6e-4938-883a-319d81c802cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:19.776342 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1227e9-9f6e-4938-883a-319d81c802cd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:19.788396 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 407/805] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:53:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:19.797253 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1227e9-9f6e-4938-883a-319d81c802cd None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:19.901291 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6d3df-a7b9-4572-b197-ad49571ec041 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:19.952918 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19922909-4c54-4d2b-becc-37191ae8a3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:19.953716 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19922909-4c54-4d2b-becc-37191ae8a3af None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:19.953996 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19922909-4c54-4d2b-becc-37191ae8a3af None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:19.954270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19922909-4c54-4d2b-becc-37191ae8a3af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:19.970103 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19922909-4c54-4d2b-becc-37191ae8a3af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:19.971572 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19922909-4c54-4d2b-becc-37191ae8a3af None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:19.991859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-19922909-4c54-4d2b-becc-37191ae8a3af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:19.993475 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 399/806] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:19.999063 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19922909-4c54-4d2b-becc-37191ae8a3af None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:20.008922 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1227e9-9f6e-4938-883a-319d81c802cd None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:20.053601 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b366cd7-e5d8-4821-998b-2c3530adcf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:20.054413 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b366cd7-e5d8-4821-998b-2c3530adcf3b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:20.054689 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b366cd7-e5d8-4821-998b-2c3530adcf3b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:20.054959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b366cd7-e5d8-4821-998b-2c3530adcf3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:20.082649 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b366cd7-e5d8-4821-998b-2c3530adcf3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:20.084168 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b366cd7-e5d8-4821-998b-2c3530adcf3b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:20.103996 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19922909-4c54-4d2b-becc-37191ae8a3af None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:20.125234 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-0b366cd7-e5d8-4821-998b-2c3530adcf3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:20.126904 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 408/807] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:20.133056 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b366cd7-e5d8-4821-998b-2c3530adcf3b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:20.152026 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f25e1-496e-4304-9f62-02a10b230a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:20.152716 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f25e1-496e-4304-9f62-02a10b230a3d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:20.153030 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f25e1-496e-4304-9f62-02a10b230a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:20.153306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f25e1-496e-4304-9f62-02a10b230a3d None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:20.154044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f25e1-496e-4304-9f62-02a10b230a3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:20.154353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f25e1-496e-4304-9f62-02a10b230a3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:20.155773 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f25e1-496e-4304-9f62-02a10b230a3d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:20.173149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 400/808] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:20.179970 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f25e1-496e-4304-9f62-02a10b230a3d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:20.315544 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f25e1-496e-4304-9f62-02a10b230a3d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:20.334905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b366cd7-e5d8-4821-998b-2c3530adcf3b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:20.350229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d49d3e-bbc1-4612-ba1b-b65fb04fe29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:20.351028 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d49d3e-bbc1-4612-ba1b-b65fb04fe29d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:20.351305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d49d3e-bbc1-4612-ba1b-b65fb04fe29d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:20.351622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d49d3e-bbc1-4612-ba1b-b65fb04fe29d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:20.358521 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d49d3e-bbc1-4612-ba1b-b65fb04fe29d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:20.359980 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d49d3e-bbc1-4612-ba1b-b65fb04fe29d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:20.374610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-16d49d3e-bbc1-4612-ba1b-b65fb04fe29d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:20.376147 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 401/809] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:20.386831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d49d3e-bbc1-4612-ba1b-b65fb04fe29d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:20.425594 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a45f3-87b3-479c-800e-d18a6f2a84a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:20.426264 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a45f3-87b3-479c-800e-d18a6f2a84a4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:20.426545 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a45f3-87b3-479c-800e-d18a6f2a84a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:20.426822 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a45f3-87b3-479c-800e-d18a6f2a84a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:20.427545 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a45f3-87b3-479c-800e-d18a6f2a84a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:20.427847 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a45f3-87b3-479c-800e-d18a6f2a84a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:20.429261 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a45f3-87b3-479c-800e-d18a6f2a84a4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:20.446674 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 409/810] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:20.454133 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a45f3-87b3-479c-800e-d18a6f2a84a4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:20.492077 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d49d3e-bbc1-4612-ba1b-b65fb04fe29d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:20.542409 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5c8aa-2151-42d8-80e8-c6c424e29934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:20.543074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5c8aa-2151-42d8-80e8-c6c424e29934 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:20.543353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5c8aa-2151-42d8-80e8-c6c424e29934 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:20.543628 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5c8aa-2151-42d8-80e8-c6c424e29934 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:20.546487 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5c8aa-2151-42d8-80e8-c6c424e29934 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:20.546806 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5c8aa-2151-42d8-80e8-c6c424e29934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:20.548266 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5c8aa-2151-42d8-80e8-c6c424e29934 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:20.569631 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 402/811] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:20.582266 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5c8aa-2151-42d8-80e8-c6c424e29934 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:20.617662 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a45f3-87b3-479c-800e-d18a6f2a84a4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:20.653544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f778153-1690-4d8b-adf8-4d2759ab334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:20.654350 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f778153-1690-4d8b-adf8-4d2759ab334d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:20.654630 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f778153-1690-4d8b-adf8-4d2759ab334d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:20.654907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f778153-1690-4d8b-adf8-4d2759ab334d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:20.663243 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f778153-1690-4d8b-adf8-4d2759ab334d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:20.664713 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f778153-1690-4d8b-adf8-4d2759ab334d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:20.679100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-9f778153-1690-4d8b-adf8-4d2759ab334d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:53:20.680684 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 410/812] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 27 04:53:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:20.682006 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1e80e-aab0-474c-ba19-e5793ef71911 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:20.682295 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1e80e-aab0-474c-ba19-e5793ef71911 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:20.682572 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1e80e-aab0-474c-ba19-e5793ef71911 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:20.686380 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5c8aa-2151-42d8-80e8-c6c424e29934 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:20.688334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 411/813] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:20.689285 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1e80e-aab0-474c-ba19-e5793ef71911 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:20.721699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0ccef-2a82-459e-a373-edcaca2a74e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:20.723579 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0ccef-2a82-459e-a373-edcaca2a74e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:20.723861 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0ccef-2a82-459e-a373-edcaca2a74e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:20.724136 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0ccef-2a82-459e-a373-edcaca2a74e8 None admin] PATH_INFO: `/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/bfea15b51919441b921c10d02d11f693/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:20.726251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0ccef-2a82-459e-a373-edcaca2a74e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=470fa8cf5f4a443faea9cfc628ff6003, user_id=bfea15b51919441b921c10d02d11f693, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:20.727739 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0ccef-2a82-459e-a373-edcaca2a74e8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:20.744508 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 403/814] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:53:20 2022] PUT /identity/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/bfea15b51919441b921c10d02d11f693/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:53:20.746024 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1f86b-ed12-48d0-84e6-5a33ab96a29e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:20.746667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1f86b-ed12-48d0-84e6-5a33ab96a29e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:20.746979 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1f86b-ed12-48d0-84e6-5a33ab96a29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:20.772218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2fe1f86b-ed12-48d0-84e6-5a33ab96a29e None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:20.773484 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2fe1f86b-ed12-48d0-84e6-5a33ab96a29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:20.801558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1e80e-aab0-474c-ba19-e5793ef71911 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:20.840281 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181e6f6-94bc-49de-bb3f-115f2c51614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:20.840910 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181e6f6-94bc-49de-bb3f-115f2c51614e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:20.841193 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181e6f6-94bc-49de-bb3f-115f2c51614e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:20.841471 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181e6f6-94bc-49de-bb3f-115f2c51614e None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:20.842314 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181e6f6-94bc-49de-bb3f-115f2c51614e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:20.842624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181e6f6-94bc-49de-bb3f-115f2c51614e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:20.844080 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181e6f6-94bc-49de-bb3f-115f2c51614e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:20.864205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 412/815] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 27 04:53:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:20.869362 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181e6f6-94bc-49de-bb3f-115f2c51614e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:20.927756 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 404/816] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:20.955275 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1f86b-ed12-48d0-84e6-5a33ab96a29e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:21.036842 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181e6f6-94bc-49de-bb3f-115f2c51614e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:21.074602 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799d040-cb20-478c-b0ef-79bbb319b396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:21.075260 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799d040-cb20-478c-b0ef-79bbb319b396 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:21.075548 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799d040-cb20-478c-b0ef-79bbb319b396 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:21.075815 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799d040-cb20-478c-b0ef-79bbb319b396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:21.104005 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1f86b-ed12-48d0-84e6-5a33ab96a29e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:21.154100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ab414-e88e-46c4-b51a-475922ef2c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:21.155320 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ab414-e88e-46c4-b51a-475922ef2c12 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:21.156345 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ab414-e88e-46c4-b51a-475922ef2c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:21.156765 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ab414-e88e-46c4-b51a-475922ef2c12 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:21.157866 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ab414-e88e-46c4-b51a-475922ef2c12 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:21.159658 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ab414-e88e-46c4-b51a-475922ef2c12 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:21.161712 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799d040-cb20-478c-b0ef-79bbb319b396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:21.163190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799d040-cb20-478c-b0ef-79bbb319b396 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:21.175685 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-df3ab414-e88e-46c4-b51a-475922ef2c12 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 27 04:53:21.179635 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 405/817] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Sep 27 04:53:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:21.185224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ab414-e88e-46c4-b51a-475922ef2c12 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:21.304535 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ab414-e88e-46c4-b51a-475922ef2c12 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:21.343659 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517be593-7b6d-49f1-9dc5-605d3585acd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:21.344660 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517be593-7b6d-49f1-9dc5-605d3585acd5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:21.345105 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517be593-7b6d-49f1-9dc5-605d3585acd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:21.345517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517be593-7b6d-49f1-9dc5-605d3585acd5 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:21.346358 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517be593-7b6d-49f1-9dc5-605d3585acd5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:21.346818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517be593-7b6d-49f1-9dc5-605d3585acd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:21.349233 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517be593-7b6d-49f1-9dc5-605d3585acd5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:21.355505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 406/818] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Sep 27 04:53:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:21.361008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517be593-7b6d-49f1-9dc5-605d3585acd5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:21.400605 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 413/819] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:53:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:53:21.419909 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799d040-cb20-478c-b0ef-79bbb319b396 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:21.478767 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517be593-7b6d-49f1-9dc5-605d3585acd5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:21.513413 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86843973-7252-4eb3-8f7e-809ad8626581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:21.514363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86843973-7252-4eb3-8f7e-809ad8626581 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:21.514779 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86843973-7252-4eb3-8f7e-809ad8626581 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:21.515207 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86843973-7252-4eb3-8f7e-809ad8626581 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:21.516038 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86843973-7252-4eb3-8f7e-809ad8626581 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:21.516519 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86843973-7252-4eb3-8f7e-809ad8626581 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:21.518049 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86843973-7252-4eb3-8f7e-809ad8626581 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:21.524177 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 407/820] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Sep 27 04:53:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:21.525635 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaae1f-d57d-4f29-a29d-ba9310d40b9c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:21.526086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaae1f-d57d-4f29-a29d-ba9310d40b9c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:21.526555 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaae1f-d57d-4f29-a29d-ba9310d40b9c None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:21.528314 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 408/821] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:21.533213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaae1f-d57d-4f29-a29d-ba9310d40b9c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:21.559255 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799d040-cb20-478c-b0ef-79bbb319b396 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:21.593420 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee23dd-67dc-4745-806b-6b2312e682f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:21.594258 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee23dd-67dc-4745-806b-6b2312e682f3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:21.594536 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee23dd-67dc-4745-806b-6b2312e682f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:21.594807 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee23dd-67dc-4745-806b-6b2312e682f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:21.605307 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee23dd-67dc-4745-806b-6b2312e682f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:21.606879 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee23dd-67dc-4745-806b-6b2312e682f3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:21.626388 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-b3ee23dd-67dc-4745-806b-6b2312e682f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:21.627708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 414/822] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:21.629007 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1a23e-ea5c-4246-9e5d-6a39c91c5641 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:21.629288 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1a23e-ea5c-4246-9e5d-6a39c91c5641 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:21.629561 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1a23e-ea5c-4246-9e5d-6a39c91c5641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:21.640628 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaae1f-d57d-4f29-a29d-ba9310d40b9c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:21.648572 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e1f1a23e-ea5c-4246-9e5d-6a39c91c5641 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:21.649738 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e1f1a23e-ea5c-4246-9e5d-6a39c91c5641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:21.675876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a843d-fdfa-4dd8-84ed-34264bd3454e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:21.676867 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a843d-fdfa-4dd8-84ed-34264bd3454e None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:21.677330 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a843d-fdfa-4dd8-84ed-34264bd3454e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:21.677783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a843d-fdfa-4dd8-84ed-34264bd3454e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:21.678695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a843d-fdfa-4dd8-84ed-34264bd3454e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:21.680237 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a843d-fdfa-4dd8-84ed-34264bd3454e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:21.713007 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 409/823] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 04:53:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:53:21.714246 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a843d-fdfa-4dd8-84ed-34264bd3454e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:21.739666 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 415/824] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:21.769301 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1a23e-ea5c-4246-9e5d-6a39c91c5641 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:21.905686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a843d-fdfa-4dd8-84ed-34264bd3454e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:21.964510 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834fb5f-18c1-488f-8a63-9be1f6ed6b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:21.965229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834fb5f-18c1-488f-8a63-9be1f6ed6b8c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:21.965500 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834fb5f-18c1-488f-8a63-9be1f6ed6b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:21.965776 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834fb5f-18c1-488f-8a63-9be1f6ed6b8c None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:21.966510 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834fb5f-18c1-488f-8a63-9be1f6ed6b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:21.966815 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834fb5f-18c1-488f-8a63-9be1f6ed6b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:21.968216 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834fb5f-18c1-488f-8a63-9be1f6ed6b8c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:21.976212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1a23e-ea5c-4246-9e5d-6a39c91c5641 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:21.988736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 410/825] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:21.995052 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834fb5f-18c1-488f-8a63-9be1f6ed6b8c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:22.031420 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43ae76-8a0d-4684-afc0-70753513c4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:22.032596 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43ae76-8a0d-4684-afc0-70753513c4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:22.032939 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43ae76-8a0d-4684-afc0-70753513c4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:22.033232 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43ae76-8a0d-4684-afc0-70753513c4e5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:22.034285 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43ae76-8a0d-4684-afc0-70753513c4e5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:22.036425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43ae76-8a0d-4684-afc0-70753513c4e5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:22.051186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-5c43ae76-8a0d-4684-afc0-70753513c4e5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 27 04:53:22.052920 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 416/826] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:21 2022] GET /identity/v3/services/network => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:22.059199 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43ae76-8a0d-4684-afc0-70753513c4e5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:22.112515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834fb5f-18c1-488f-8a63-9be1f6ed6b8c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:22.149746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5c83b-b598-4add-90c5-0000f571777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:22.150862 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5c83b-b598-4add-90c5-0000f571777e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:22.151300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5c83b-b598-4add-90c5-0000f571777e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:22.151780 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5c83b-b598-4add-90c5-0000f571777e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:22.162034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5c83b-b598-4add-90c5-0000f571777e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:22.164218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5c83b-b598-4add-90c5-0000f571777e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:22.172012 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43ae76-8a0d-4684-afc0-70753513c4e5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:22.183268 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-0dd5c83b-b598-4add-90c5-0000f571777e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:22.185713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 411/827] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:22.193753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5c83b-b598-4add-90c5-0000f571777e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:22.228074 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fd861-daab-4340-bc0c-3fdc4d82aa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:22.228740 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fd861-daab-4340-bc0c-3fdc4d82aa24 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:22.229049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fd861-daab-4340-bc0c-3fdc4d82aa24 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:22.229326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fd861-daab-4340-bc0c-3fdc4d82aa24 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:22.230038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fd861-daab-4340-bc0c-3fdc4d82aa24 None admin] RBAC: Adding query filter params (name=network) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:22.230345 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fd861-daab-4340-bc0c-3fdc4d82aa24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:22.231725 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fd861-daab-4340-bc0c-3fdc4d82aa24 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:22.242294 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 417/828] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 27 04:53:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:22.248207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fd861-daab-4340-bc0c-3fdc4d82aa24 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:22.351464 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fd861-daab-4340-bc0c-3fdc4d82aa24 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:22.385870 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003dea8-5118-441e-b7ea-2a33b0caa651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:22.386538 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003dea8-5118-441e-b7ea-2a33b0caa651 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:22.386821 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003dea8-5118-441e-b7ea-2a33b0caa651 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:22.387056 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5c83b-b598-4add-90c5-0000f571777e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:22.387173 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003dea8-5118-441e-b7ea-2a33b0caa651 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:22.387794 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003dea8-5118-441e-b7ea-2a33b0caa651 None admin] RBAC: Adding query filter params (type=network) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:22.388100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003dea8-5118-441e-b7ea-2a33b0caa651 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:22.389526 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003dea8-5118-441e-b7ea-2a33b0caa651 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:22.400888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 418/829] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 27 04:53:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:22.401187 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003dea8-5118-441e-b7ea-2a33b0caa651 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:22.449698 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd4baf-f699-4e33-8b95-5a2e83bbd81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:22.450703 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd4baf-f699-4e33-8b95-5a2e83bbd81f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:22.451197 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd4baf-f699-4e33-8b95-5a2e83bbd81f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:22.451703 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd4baf-f699-4e33-8b95-5a2e83bbd81f None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:22.452751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd4baf-f699-4e33-8b95-5a2e83bbd81f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:22.453277 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd4baf-f699-4e33-8b95-5a2e83bbd81f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:22.454973 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd4baf-f699-4e33-8b95-5a2e83bbd81f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:22.475859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 412/830] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:22.481605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd4baf-f699-4e33-8b95-5a2e83bbd81f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:22.503830 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003dea8-5118-441e-b7ea-2a33b0caa651 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:22.538654 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095738d6-1212-4611-8b12-537e7e8d67fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:22.539320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095738d6-1212-4611-8b12-537e7e8d67fa None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:22.539602 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095738d6-1212-4611-8b12-537e7e8d67fa None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:22.539882 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095738d6-1212-4611-8b12-537e7e8d67fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:22.540631 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095738d6-1212-4611-8b12-537e7e8d67fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:22.542054 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095738d6-1212-4611-8b12-537e7e8d67fa None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:22.564729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 419/831] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 04:53:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:53:22.570242 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e636e8a-e943-43a2-8f0b-18d00dd148aa None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:22.570533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e636e8a-e943-43a2-8f0b-18d00dd148aa None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:22.570812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e636e8a-e943-43a2-8f0b-18d00dd148aa None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:22.576776 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 420/832] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:22.578346 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cff480-2ef1-4568-a2cf-fba5fd784bb3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:22.578633 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cff480-2ef1-4568-a2cf-fba5fd784bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:22.578920 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cff480-2ef1-4568-a2cf-fba5fd784bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:22.609982 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a2cff480-2ef1-4568-a2cf-fba5fd784bb3 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:22.611205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a2cff480-2ef1-4568-a2cf-fba5fd784bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:22.631638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd4baf-f699-4e33-8b95-5a2e83bbd81f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:22.711166 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe760de-4aff-481d-9f82-8900262dfc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:22.711753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe760de-4aff-481d-9f82-8900262dfc92 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:22.712033 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe760de-4aff-481d-9f82-8900262dfc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:22.712306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe760de-4aff-481d-9f82-8900262dfc92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:22.713181 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe760de-4aff-481d-9f82-8900262dfc92 None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=faac84ed9d37420c811bbf6ac7df0b35) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:22.713492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe760de-4aff-481d-9f82-8900262dfc92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:22.714964 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe760de-4aff-481d-9f82-8900262dfc92 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:22.732822 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 413/833] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:53:22 2022] GET /identity/v3/role_assignments?user.id=faac84ed9d37420c811bbf6ac7df0b35&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:22.743280 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 421/834] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:22.796726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe760de-4aff-481d-9f82-8900262dfc92 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:22.910094 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe760de-4aff-481d-9f82-8900262dfc92 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:22.949110 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1118b-c9f4-4f92-bef8-5e785e771a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:22.949922 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1118b-c9f4-4f92-bef8-5e785e771a9f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:22.950199 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1118b-c9f4-4f92-bef8-5e785e771a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:22.950476 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1118b-c9f4-4f92-bef8-5e785e771a9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:22.962439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1118b-c9f4-4f92-bef8-5e785e771a9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:22.969473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-a5d1118b-c9f4-4f92-bef8-5e785e771a9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:53:22.970866 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 414/835] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:53:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:22.980273 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cff480-2ef1-4568-a2cf-fba5fd784bb3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:23.093589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cff480-2ef1-4568-a2cf-fba5fd784bb3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:23.129468 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc46e6-07a6-4043-8006-4d78bf47aa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:23.130616 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc46e6-07a6-4043-8006-4d78bf47aa61 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:23.131101 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc46e6-07a6-4043-8006-4d78bf47aa61 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:23.131566 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc46e6-07a6-4043-8006-4d78bf47aa61 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:23.132502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc46e6-07a6-4043-8006-4d78bf47aa61 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:23.133052 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc46e6-07a6-4043-8006-4d78bf47aa61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:23.134771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc46e6-07a6-4043-8006-4d78bf47aa61 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:23.143466 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 422/836] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:53:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:23.149193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1118b-c9f4-4f92-bef8-5e785e771a9f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:23.255293 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1118b-c9f4-4f92-bef8-5e785e771a9f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:23.289159 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7c1e8-522c-4108-a640-2a9d1400b1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:23.289957 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7c1e8-522c-4108-a640-2a9d1400b1bd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:23.290236 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7c1e8-522c-4108-a640-2a9d1400b1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:23.290513 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7c1e8-522c-4108-a640-2a9d1400b1bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:23.301836 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7c1e8-522c-4108-a640-2a9d1400b1bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:23.303301 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7c1e8-522c-4108-a640-2a9d1400b1bd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:23.319626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-cfa7c1e8-522c-4108-a640-2a9d1400b1bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:23.321170 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 415/837] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:23.326777 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc46e6-07a6-4043-8006-4d78bf47aa61 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:23.427393 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc46e6-07a6-4043-8006-4d78bf47aa61 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:23.464338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fe993-7f7b-4dee-b4e4-3a5c4bc35b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:23.465040 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fe993-7f7b-4dee-b4e4-3a5c4bc35b5e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:23.465322 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fe993-7f7b-4dee-b4e4-3a5c4bc35b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:23.465594 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fe993-7f7b-4dee-b4e4-3a5c4bc35b5e None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:23.466302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fe993-7f7b-4dee-b4e4-3a5c4bc35b5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:23.466604 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fe993-7f7b-4dee-b4e4-3a5c4bc35b5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:23.467950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fe993-7f7b-4dee-b4e4-3a5c4bc35b5e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:23.480715 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 423/838] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:23.485985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7c1e8-522c-4108-a640-2a9d1400b1bd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:23.578015 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca05ae-afd0-4753-a5f2-8b010234f275 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:23.578456 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca05ae-afd0-4753-a5f2-8b010234f275 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:23.578757 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca05ae-afd0-4753-a5f2-8b010234f275 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:23.580917 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 424/839] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:53:23.586601 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d50b8d-7521-44e9-84ed-aae354a04179 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:23.587125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d50b8d-7521-44e9-84ed-aae354a04179 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:23.587614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d50b8d-7521-44e9-84ed-aae354a04179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:23.589442 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7c1e8-522c-4108-a640-2a9d1400b1bd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:23.605423 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-49d50b8d-7521-44e9-84ed-aae354a04179 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:23.606917 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-49d50b8d-7521-44e9-84ed-aae354a04179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:23.624612 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a5f6f-b7bb-4075-9522-c69c6af8aabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:23.625459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a5f6f-b7bb-4075-9522-c69c6af8aabc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:23.625738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a5f6f-b7bb-4075-9522-c69c6af8aabc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:23.626011 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a5f6f-b7bb-4075-9522-c69c6af8aabc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:23.633941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a5f6f-b7bb-4075-9522-c69c6af8aabc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:23.635384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a5f6f-b7bb-4075-9522-c69c6af8aabc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:23.649548 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-c48a5f6f-b7bb-4075-9522-c69c6af8aabc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:53:23.651072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 416/840] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 27 04:53:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:23.656237 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a5f6f-b7bb-4075-9522-c69c6af8aabc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:23.688885 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 425/841] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:23.704111 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d50b8d-7521-44e9-84ed-aae354a04179 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:23.759782 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a5f6f-b7bb-4075-9522-c69c6af8aabc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:23.796423 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09881b8-24cd-42b9-8db5-ce0a3f486955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:23.797129 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09881b8-24cd-42b9-8db5-ce0a3f486955 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:23.797408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09881b8-24cd-42b9-8db5-ce0a3f486955 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:23.797680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09881b8-24cd-42b9-8db5-ce0a3f486955 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:23.798517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09881b8-24cd-42b9-8db5-ce0a3f486955 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:23.798826 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09881b8-24cd-42b9-8db5-ce0a3f486955 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:23.800877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09881b8-24cd-42b9-8db5-ce0a3f486955 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:23.818733 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 417/842] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Sep 27 04:53:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:23.823969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09881b8-24cd-42b9-8db5-ce0a3f486955 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:23.826261 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d50b8d-7521-44e9-84ed-aae354a04179 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:23.867299 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6e50c-11d8-416f-be4e-2780e473dc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:23.868096 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6e50c-11d8-416f-be4e-2780e473dc93 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:23.868376 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6e50c-11d8-416f-be4e-2780e473dc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:23.868708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6e50c-11d8-416f-be4e-2780e473dc93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:23.879923 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6e50c-11d8-416f-be4e-2780e473dc93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:23.886886 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-2ae6e50c-11d8-416f-be4e-2780e473dc93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:53:23.888496 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 426/843] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:53:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:23.895689 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6e50c-11d8-416f-be4e-2780e473dc93 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:23.947138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09881b8-24cd-42b9-8db5-ce0a3f486955 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:23.997432 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7d42f-9d50-48f1-abfb-930399042aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:23.998281 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7d42f-9d50-48f1-abfb-930399042aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:23.998660 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7d42f-9d50-48f1-abfb-930399042aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:23.999035 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7d42f-9d50-48f1-abfb-930399042aa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:24.024691 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6e50c-11d8-416f-be4e-2780e473dc93 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:24.059278 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043e38a-2f4d-470e-8a5c-86dfd7f154e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:24.060258 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043e38a-2f4d-470e-8a5c-86dfd7f154e7 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:24.060756 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043e38a-2f4d-470e-8a5c-86dfd7f154e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:24.061275 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043e38a-2f4d-470e-8a5c-86dfd7f154e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:24.062225 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043e38a-2f4d-470e-8a5c-86dfd7f154e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:24.062730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043e38a-2f4d-470e-8a5c-86dfd7f154e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:24.064283 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043e38a-2f4d-470e-8a5c-86dfd7f154e7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:24.070767 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7d42f-9d50-48f1-abfb-930399042aa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:24.072249 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7d42f-9d50-48f1-abfb-930399042aa6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:24.078532 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 427/844] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:53:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:24.080202 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043e38a-2f4d-470e-8a5c-86dfd7f154e7 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:24.181496 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043e38a-2f4d-470e-8a5c-86dfd7f154e7 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:24.184245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 418/845] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:53:23 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:53:24.185387 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7d42f-9d50-48f1-abfb-930399042aa6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:24.216920 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbb840-a385-4b1b-ab73-5ae37483d552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:24.218097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbb840-a385-4b1b-ab73-5ae37483d552 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:24.218650 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbb840-a385-4b1b-ab73-5ae37483d552 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:24.219130 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbb840-a385-4b1b-ab73-5ae37483d552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:24.231062 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbb840-a385-4b1b-ab73-5ae37483d552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:24.232856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbb840-a385-4b1b-ab73-5ae37483d552 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:24.250381 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-76dbb840-a385-4b1b-ab73-5ae37483d552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:24.256944 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 428/846] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:24.259543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbb840-a385-4b1b-ab73-5ae37483d552 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:24.290913 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7d42f-9d50-48f1-abfb-930399042aa6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:24.326299 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5520c2-250a-4a51-8164-f6b82f10a9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:24.327139 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5520c2-250a-4a51-8164-f6b82f10a9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:24.327422 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5520c2-250a-4a51-8164-f6b82f10a9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:24.327697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5520c2-250a-4a51-8164-f6b82f10a9d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:24.338839 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5520c2-250a-4a51-8164-f6b82f10a9d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:24.340351 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5520c2-250a-4a51-8164-f6b82f10a9d5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:24.357402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-9d5520c2-250a-4a51-8164-f6b82f10a9d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:24.358966 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 419/847] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:24.363923 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbb840-a385-4b1b-ab73-5ae37483d552 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:24.364524 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5520c2-250a-4a51-8164-f6b82f10a9d5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:24.398933 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36f454-2d94-479e-8dc2-60415c86e22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:24.399954 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36f454-2d94-479e-8dc2-60415c86e22a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:24.400461 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36f454-2d94-479e-8dc2-60415c86e22a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:24.400960 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36f454-2d94-479e-8dc2-60415c86e22a None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:24.401872 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36f454-2d94-479e-8dc2-60415c86e22a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:24.402371 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36f454-2d94-479e-8dc2-60415c86e22a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:24.403959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36f454-2d94-479e-8dc2-60415c86e22a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:24.421200 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 429/848] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:24.422694 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36f454-2d94-479e-8dc2-60415c86e22a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:24.466574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5520c2-250a-4a51-8164-f6b82f10a9d5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:24.501577 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac036ff-88c1-4d08-bd92-cc07bcff8344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:24.502252 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac036ff-88c1-4d08-bd92-cc07bcff8344 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:24.502531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac036ff-88c1-4d08-bd92-cc07bcff8344 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:24.502805 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac036ff-88c1-4d08-bd92-cc07bcff8344 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:24.503678 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac036ff-88c1-4d08-bd92-cc07bcff8344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:24.503902 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac036ff-88c1-4d08-bd92-cc07bcff8344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:24.505430 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac036ff-88c1-4d08-bd92-cc07bcff8344 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:24.521918 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 420/849] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:24.522834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac036ff-88c1-4d08-bd92-cc07bcff8344 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:24.525743 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36f454-2d94-479e-8dc2-60415c86e22a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:24.560980 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b7a6c-ae1d-4b7b-aca6-3871fefb28ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:24.562158 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b7a6c-ae1d-4b7b-aca6-3871fefb28ed None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:24.562645 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b7a6c-ae1d-4b7b-aca6-3871fefb28ed None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:24.563128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b7a6c-ae1d-4b7b-aca6-3871fefb28ed None admin] PATH_INFO: `/v3/users/swift` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:24.571586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b7a6c-ae1d-4b7b-aca6-3871fefb28ed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:24.573366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b7a6c-ae1d-4b7b-aca6-3871fefb28ed None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:24.587919 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-272b7a6c-ae1d-4b7b-aca6-3871fefb28ed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 27 04:53:24.594270 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 430/850] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:53:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:24.595672 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b7a6c-ae1d-4b7b-aca6-3871fefb28ed None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:24.627493 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac036ff-88c1-4d08-bd92-cc07bcff8344 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:24.660620 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06770b14-2bc2-4bf7-92c5-587847919e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:24.661440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06770b14-2bc2-4bf7-92c5-587847919e35 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:24.661719 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06770b14-2bc2-4bf7-92c5-587847919e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:24.661992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06770b14-2bc2-4bf7-92c5-587847919e35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:24.668545 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06770b14-2bc2-4bf7-92c5-587847919e35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:24.670036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06770b14-2bc2-4bf7-92c5-587847919e35 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:24.684541 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-06770b14-2bc2-4bf7-92c5-587847919e35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:24.690296 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 421/851] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:24.690296 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329297ed-b299-478f-b369-89e6d4ccf60e None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:24.690296 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329297ed-b299-478f-b369-89e6d4ccf60e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:24.690296 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329297ed-b299-478f-b369-89e6d4ccf60e None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:24.690296 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 422/852] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:24.691663 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329297ed-b299-478f-b369-89e6d4ccf60e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:24.701068 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b7a6c-ae1d-4b7b-aca6-3871fefb28ed None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:24.735600 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb461bb-5416-4a20-a7ae-501023581c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:24.736172 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb461bb-5416-4a20-a7ae-501023581c38 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:24.736452 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb461bb-5416-4a20-a7ae-501023581c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:24.736721 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb461bb-5416-4a20-a7ae-501023581c38 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:24.738132 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb461bb-5416-4a20-a7ae-501023581c38 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:24.738424 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb461bb-5416-4a20-a7ae-501023581c38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:24.739902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb461bb-5416-4a20-a7ae-501023581c38 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:24.767086 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 431/853] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Sep 27 04:53:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:24.768452 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c874b0-0d8d-49c5-a97c-e03a37354a8f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:24.769275 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c874b0-0d8d-49c5-a97c-e03a37354a8f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:24.769585 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c874b0-0d8d-49c5-a97c-e03a37354a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:24.789523 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-43c874b0-0d8d-49c5-a97c-e03a37354a8f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:24.790711 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-43c874b0-0d8d-49c5-a97c-e03a37354a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:24.804741 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329297ed-b299-478f-b369-89e6d4ccf60e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:24.837408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d839da5-d305-4d1a-8857-57827cfeb07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:24.838066 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d839da5-d305-4d1a-8857-57827cfeb07a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:24.838349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d839da5-d305-4d1a-8857-57827cfeb07a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:24.838623 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d839da5-d305-4d1a-8857-57827cfeb07a None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:24.839407 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d839da5-d305-4d1a-8857-57827cfeb07a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:24.839713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d839da5-d305-4d1a-8857-57827cfeb07a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:24.841187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d839da5-d305-4d1a-8857-57827cfeb07a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:24.853177 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 423/854] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:24.857745 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d839da5-d305-4d1a-8857-57827cfeb07a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:24.858807 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 432/855] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:24.859718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c874b0-0d8d-49c5-a97c-e03a37354a8f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:24.956420 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d839da5-d305-4d1a-8857-57827cfeb07a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:24.963807 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c874b0-0d8d-49c5-a97c-e03a37354a8f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:24.993167 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed81f2-5c13-46af-bd2f-7d826fff778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:24.994145 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed81f2-5c13-46af-bd2f-7d826fff778c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:24.994429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed81f2-5c13-46af-bd2f-7d826fff778c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:24.994701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed81f2-5c13-46af-bd2f-7d826fff778c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:25.005871 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c20794-a3c0-4685-ad67-db905732bb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:25.006528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c20794-a3c0-4685-ad67-db905732bb0d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:25.006802 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c20794-a3c0-4685-ad67-db905732bb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:25.007071 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c20794-a3c0-4685-ad67-db905732bb0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:25.007888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c20794-a3c0-4685-ad67-db905732bb0d None admin] RBAC: Adding query filter params (role.id=22681aa004f8450f964af121fc87d40a, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=d27fb10124d24c8ea208a4d020274269) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:25.008192 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c20794-a3c0-4685-ad67-db905732bb0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:25.009649 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c20794-a3c0-4685-ad67-db905732bb0d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:25.016151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 433/856] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:53:24 2022] GET /identity/v3/role_assignments?user.id=d27fb10124d24c8ea208a4d020274269&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=22681aa004f8450f964af121fc87d40a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:25.016955 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c20794-a3c0-4685-ad67-db905732bb0d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:25.089318 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed81f2-5c13-46af-bd2f-7d826fff778c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:25.091442 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed81f2-5c13-46af-bd2f-7d826fff778c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:25.133611 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c20794-a3c0-4685-ad67-db905732bb0d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:25.172109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b3908-1a8c-441a-8369-a3ca21d3777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:25.173265 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3908-1a8c-441a-8369-a3ca21d3777b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:25.173740 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3908-1a8c-441a-8369-a3ca21d3777b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:25.174180 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3908-1a8c-441a-8369-a3ca21d3777b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:25.175075 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b3908-1a8c-441a-8369-a3ca21d3777b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:25.177116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b3908-1a8c-441a-8369-a3ca21d3777b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:25.189125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-ba4b3908-1a8c-441a-8369-a3ca21d3777b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 04:53:25.196170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 434/857] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:53:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:25.197430 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b3908-1a8c-441a-8369-a3ca21d3777b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:25.218189 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 424/858] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:53:24 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:53:25.224056 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed81f2-5c13-46af-bd2f-7d826fff778c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:25.327112 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b3908-1a8c-441a-8369-a3ca21d3777b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:25.340843 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed81f2-5c13-46af-bd2f-7d826fff778c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:25.362692 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07dfc7-b4e3-4591-8c9f-2dc7f734bf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:25.363639 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07dfc7-b4e3-4591-8c9f-2dc7f734bf0b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:25.363924 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07dfc7-b4e3-4591-8c9f-2dc7f734bf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:25.364199 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07dfc7-b4e3-4591-8c9f-2dc7f734bf0b None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:25.364941 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07dfc7-b4e3-4591-8c9f-2dc7f734bf0b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:25.365257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07dfc7-b4e3-4591-8c9f-2dc7f734bf0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:25.366633 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07dfc7-b4e3-4591-8c9f-2dc7f734bf0b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:25.371196 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 435/859] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:53:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:25.372777 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33851d3-1f8c-41b1-a767-67be9c61583d None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:25.373093 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33851d3-1f8c-41b1-a767-67be9c61583d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:25.373372 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33851d3-1f8c-41b1-a767-67be9c61583d None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:25.375136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 436/860] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:25.377593 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33851d3-1f8c-41b1-a767-67be9c61583d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:25.381574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210a913-81dc-4960-bcea-c503eb9d099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:25.382382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210a913-81dc-4960-bcea-c503eb9d099e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:25.382662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210a913-81dc-4960-bcea-c503eb9d099e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:25.382936 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210a913-81dc-4960-bcea-c503eb9d099e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:25.394994 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210a913-81dc-4960-bcea-c503eb9d099e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:25.396672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210a913-81dc-4960-bcea-c503eb9d099e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:25.413513 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-1210a913-81dc-4960-bcea-c503eb9d099e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:25.414944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 425/861] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:25.419697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b4513-8a7c-46de-9913-61b122caeb97 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:25.419808 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b4513-8a7c-46de-9913-61b122caeb97 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:25.420058 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b4513-8a7c-46de-9913-61b122caeb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:25.437468 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e62b4513-8a7c-46de-9913-61b122caeb97 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:25.438642 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e62b4513-8a7c-46de-9913-61b122caeb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:25.483986 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33851d3-1f8c-41b1-a767-67be9c61583d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:25.506057 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 426/862] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:25.506913 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b4513-8a7c-46de-9913-61b122caeb97 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:25.532503 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9255fe5-94f2-4190-a712-29162c52828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:25.534169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9255fe5-94f2-4190-a712-29162c52828b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:25.534706 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9255fe5-94f2-4190-a712-29162c52828b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:25.535483 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9255fe5-94f2-4190-a712-29162c52828b None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:25.537051 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9255fe5-94f2-4190-a712-29162c52828b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:25.537531 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9255fe5-94f2-4190-a712-29162c52828b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:25.538948 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9255fe5-94f2-4190-a712-29162c52828b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:25.543443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 437/863] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:53:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:25.544214 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9255fe5-94f2-4190-a712-29162c52828b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:25.635092 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b4513-8a7c-46de-9913-61b122caeb97 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:25.651474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9255fe5-94f2-4190-a712-29162c52828b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:25.677068 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bde35-b79d-43c0-8a6c-6ad42d41d318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:25.678100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bde35-b79d-43c0-8a6c-6ad42d41d318 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:25.678553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bde35-b79d-43c0-8a6c-6ad42d41d318 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:25.678998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bde35-b79d-43c0-8a6c-6ad42d41d318 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:25.679913 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bde35-b79d-43c0-8a6c-6ad42d41d318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:25.680405 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bde35-b79d-43c0-8a6c-6ad42d41d318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:25.682077 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bde35-b79d-43c0-8a6c-6ad42d41d318 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:25.688125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e28ee-a33e-492c-bf48-e044c5225fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:25.688973 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e28ee-a33e-492c-bf48-e044c5225fdd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:25.689254 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e28ee-a33e-492c-bf48-e044c5225fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:25.689525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e28ee-a33e-492c-bf48-e044c5225fdd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:25.690174 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e28ee-a33e-492c-bf48-e044c5225fdd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:25.692529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e28ee-a33e-492c-bf48-e044c5225fdd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:25.701247 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 427/864] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:25.703139 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bde35-b79d-43c0-8a6c-6ad42d41d318 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:25.704443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-9a2e28ee-a33e-492c-bf48-e044c5225fdd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 04:53:25.705725 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 438/865] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Sep 27 04:53:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:25.712216 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e28ee-a33e-492c-bf48-e044c5225fdd None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:25.822310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bde35-b79d-43c0-8a6c-6ad42d41d318 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:25.822543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e28ee-a33e-492c-bf48-e044c5225fdd None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:25.857133 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e7d4c-8dd0-4236-b493-e50aa32b22f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:25.857476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fcaa0-926b-4f2a-8590-45a5c0cb2084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:25.857939 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e7d4c-8dd0-4236-b493-e50aa32b22f2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:25.858109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fcaa0-926b-4f2a-8590-45a5c0cb2084 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:25.858224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e7d4c-8dd0-4236-b493-e50aa32b22f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:25.858377 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fcaa0-926b-4f2a-8590-45a5c0cb2084 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:25.858476 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e7d4c-8dd0-4236-b493-e50aa32b22f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:25.858634 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fcaa0-926b-4f2a-8590-45a5c0cb2084 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:25.859335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fcaa0-926b-4f2a-8590-45a5c0cb2084 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:25.859636 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fcaa0-926b-4f2a-8590-45a5c0cb2084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:25.861020 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fcaa0-926b-4f2a-8590-45a5c0cb2084 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:25.865743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e7d4c-8dd0-4236-b493-e50aa32b22f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:25.866334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 439/866] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 27 04:53:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:25.867182 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e7d4c-8dd0-4236-b493-e50aa32b22f2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:25.872013 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fcaa0-926b-4f2a-8590-45a5c0cb2084 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:25.883701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-859e7d4c-8dd0-4236-b493-e50aa32b22f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:25.885300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 428/867] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:25.894149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e7d4c-8dd0-4236-b493-e50aa32b22f2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:25.991709 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fcaa0-926b-4f2a-8590-45a5c0cb2084 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:26.017136 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e7d4c-8dd0-4236-b493-e50aa32b22f2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:26.035839 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdfff5-2860-4292-ac7b-4489b848607a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:26.037180 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdfff5-2860-4292-ac7b-4489b848607a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:26.037672 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdfff5-2860-4292-ac7b-4489b848607a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:26.038156 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdfff5-2860-4292-ac7b-4489b848607a None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:26.039481 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdfff5-2860-4292-ac7b-4489b848607a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:26.039988 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdfff5-2860-4292-ac7b-4489b848607a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:26.042020 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdfff5-2860-4292-ac7b-4489b848607a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:26.048928 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 440/868] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 27 04:53:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:26.060399 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e20d4-9a73-4e41-8c9d-8256e07a894c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:26.061523 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e20d4-9a73-4e41-8c9d-8256e07a894c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:26.062034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e20d4-9a73-4e41-8c9d-8256e07a894c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:26.062498 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e20d4-9a73-4e41-8c9d-8256e07a894c None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:26.063507 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e20d4-9a73-4e41-8c9d-8256e07a894c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:26.064045 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e20d4-9a73-4e41-8c9d-8256e07a894c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:26.065990 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e20d4-9a73-4e41-8c9d-8256e07a894c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:26.079958 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 429/869] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:26.087119 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdfff5-2860-4292-ac7b-4489b848607a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:26.197581 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdfff5-2860-4292-ac7b-4489b848607a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:26.235464 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800facd-4cb0-419a-add0-d0f53f47e887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:26.236507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800facd-4cb0-419a-add0-d0f53f47e887 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:26.237058 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800facd-4cb0-419a-add0-d0f53f47e887 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:26.238091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800facd-4cb0-419a-add0-d0f53f47e887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:26.239289 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800facd-4cb0-419a-add0-d0f53f47e887 None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=bfea15b51919441b921c10d02d11f693) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:26.239814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800facd-4cb0-419a-add0-d0f53f47e887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:26.241455 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800facd-4cb0-419a-add0-d0f53f47e887 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:26.248198 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 441/870] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:53:26 2022] GET /identity/v3/role_assignments?user.id=bfea15b51919441b921c10d02d11f693&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:27.513779 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd984c77-a6d7-43dc-93b7-b9835ba3f151 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:27.514392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd984c77-a6d7-43dc-93b7-b9835ba3f151 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:27.514392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd984c77-a6d7-43dc-93b7-b9835ba3f151 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:27.516362 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 430/871] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:27.522527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590c1f3-913e-453c-a864-f2dcda6d24dd None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:27.522959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590c1f3-913e-453c-a864-f2dcda6d24dd None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:27.523160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590c1f3-913e-453c-a864-f2dcda6d24dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:27.540070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1590c1f3-913e-453c-a864-f2dcda6d24dd None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:27.541296 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1590c1f3-913e-453c-a864-f2dcda6d24dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:27.612975 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 442/872] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:27.632335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd984c77-a6d7-43dc-93b7-b9835ba3f151 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:27.744385 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd984c77-a6d7-43dc-93b7-b9835ba3f151 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:27.779883 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfedbb0-b771-4b28-b53f-e858f0abeeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:27.781063 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfedbb0-b771-4b28-b53f-e858f0abeeba None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:27.781551 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfedbb0-b771-4b28-b53f-e858f0abeeba None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:27.782036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfedbb0-b771-4b28-b53f-e858f0abeeba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:27.793154 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfedbb0-b771-4b28-b53f-e858f0abeeba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:27.801487 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-fcfedbb0-b771-4b28-b53f-e858f0abeeba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:53:27.803219 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 431/873] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Sep 27 04:53:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:27.812846 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590c1f3-913e-453c-a864-f2dcda6d24dd None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:27.911211 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590c1f3-913e-453c-a864-f2dcda6d24dd None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:27.946355 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274152b-a34c-4ee0-a52c-2809e66947df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:27.947027 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274152b-a34c-4ee0-a52c-2809e66947df None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:27.947303 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274152b-a34c-4ee0-a52c-2809e66947df None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:27.947575 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274152b-a34c-4ee0-a52c-2809e66947df None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:27.948412 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274152b-a34c-4ee0-a52c-2809e66947df None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:27.948722 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274152b-a34c-4ee0-a52c-2809e66947df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:27.950104 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274152b-a34c-4ee0-a52c-2809e66947df None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:27.959258 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 443/874] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Sep 27 04:53:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:27.964632 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfedbb0-b771-4b28-b53f-e858f0abeeba None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:28.014547 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de10dd-d825-4492-ac20-4df48849be55 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:28.014884 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de10dd-d825-4492-ac20-4df48849be55 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:28.015109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de10dd-d825-4492-ac20-4df48849be55 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:28.017241 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 444/875] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:53:28.023586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111cb5a-155b-409c-92d1-9d7cf5e636b0 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:28.023875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111cb5a-155b-409c-92d1-9d7cf5e636b0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:28.024159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111cb5a-155b-409c-92d1-9d7cf5e636b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:28.041201 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1111cb5a-155b-409c-92d1-9d7cf5e636b0 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:28.042311 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1111cb5a-155b-409c-92d1-9d7cf5e636b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:28.085416 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfedbb0-b771-4b28-b53f-e858f0abeeba None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:28.121286 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19b5f0-6e74-4c27-bf4b-35368fab9223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:28.122786 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b5f0-6e74-4c27-bf4b-35368fab9223 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:28.123283 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b5f0-6e74-4c27-bf4b-35368fab9223 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:28.123773 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b5f0-6e74-4c27-bf4b-35368fab9223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:28.129206 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 445/876] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:53:28.136867 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19b5f0-6e74-4c27-bf4b-35368fab9223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:28.138772 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19b5f0-6e74-4c27-bf4b-35368fab9223 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:28.149562 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111cb5a-155b-409c-92d1-9d7cf5e636b0 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:28.159998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-0d19b5f0-6e74-4c27-bf4b-35368fab9223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:28.161887 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 432/877] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:28.172814 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19b5f0-6e74-4c27-bf4b-35368fab9223 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:28.270787 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111cb5a-155b-409c-92d1-9d7cf5e636b0 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:28.279082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19b5f0-6e74-4c27-bf4b-35368fab9223 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:28.311036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef4176-7aca-4393-9ced-a1af19588c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:28.311629 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef4176-7aca-4393-9ced-a1af19588c50 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:28.311911 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef4176-7aca-4393-9ced-a1af19588c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:28.312186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef4176-7aca-4393-9ced-a1af19588c50 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:28.312932 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef4176-7aca-4393-9ced-a1af19588c50 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:28.314310 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef4176-7aca-4393-9ced-a1af19588c50 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:28.321751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7b705-0484-4857-aa6a-da912720c40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:28.322421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7b705-0484-4857-aa6a-da912720c40f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:28.322699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7b705-0484-4857-aa6a-da912720c40f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:28.323101 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7b705-0484-4857-aa6a-da912720c40f None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:28.323950 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7b705-0484-4857-aa6a-da912720c40f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:28.324256 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7b705-0484-4857-aa6a-da912720c40f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:28.325783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7b705-0484-4857-aa6a-da912720c40f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:28.337277 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 446/878] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 27 04:53:28 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:53:28.344180 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 433/879] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:28.345769 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef4176-7aca-4393-9ced-a1af19588c50 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:28.471418 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef4176-7aca-4393-9ced-a1af19588c50 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:28.505619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e5976-5379-46f4-bf2e-a9adbd1c4c81 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:28.505950 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e5976-5379-46f4-bf2e-a9adbd1c4c81 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:28.506177 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e5976-5379-46f4-bf2e-a9adbd1c4c81 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:28.508224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 434/880] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:28.510330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55245b22-554f-486c-ada3-b1a8fec7eaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:28.511197 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55245b22-554f-486c-ada3-b1a8fec7eaac None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:28.511485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55245b22-554f-486c-ada3-b1a8fec7eaac None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:28.511761 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55245b22-554f-486c-ada3-b1a8fec7eaac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:28.513496 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fa81c-0195-4a87-9477-982342acace3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:28.513784 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fa81c-0195-4a87-9477-982342acace3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:28.514058 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fa81c-0195-4a87-9477-982342acace3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:28.521222 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55245b22-554f-486c-ada3-b1a8fec7eaac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:28.522739 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55245b22-554f-486c-ada3-b1a8fec7eaac None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:28.534251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-261fa81c-0195-4a87-9477-982342acace3 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:28.535762 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-261fa81c-0195-4a87-9477-982342acace3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:28.537449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-55245b22-554f-486c-ada3-b1a8fec7eaac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:53:28.538984 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 447/881] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 27 04:53:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:28.544284 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55245b22-554f-486c-ada3-b1a8fec7eaac None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:28.633103 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 435/882] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:28 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:28.656295 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fa81c-0195-4a87-9477-982342acace3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:28.660383 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55245b22-554f-486c-ada3-b1a8fec7eaac None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:28.695552 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e18467-f405-44a0-877f-1df9a28bb9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:28.696225 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e18467-f405-44a0-877f-1df9a28bb9fd None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:28.696505 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e18467-f405-44a0-877f-1df9a28bb9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:28.696781 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e18467-f405-44a0-877f-1df9a28bb9fd None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:28.697722 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e18467-f405-44a0-877f-1df9a28bb9fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:28.697943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e18467-f405-44a0-877f-1df9a28bb9fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:28.699513 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e18467-f405-44a0-877f-1df9a28bb9fd None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:28.718112 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 448/883] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Sep 27 04:53:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:28.723605 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e18467-f405-44a0-877f-1df9a28bb9fd None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:28.769404 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fa81c-0195-4a87-9477-982342acace3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:28.805119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b712d-9800-42f1-b7d4-fa36fe54349d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:28.805787 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b712d-9800-42f1-b7d4-fa36fe54349d None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:28.806069 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b712d-9800-42f1-b7d4-fa36fe54349d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:28.806345 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b712d-9800-42f1-b7d4-fa36fe54349d None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:28.807076 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b712d-9800-42f1-b7d4-fa36fe54349d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:28.808439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b712d-9800-42f1-b7d4-fa36fe54349d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:28.825466 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 436/884] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 27 04:53:28 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:53:28.827180 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cdddb-ba73-40b8-a1d9-a0f6fd4cf6b2 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:28.827464 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cdddb-ba73-40b8-a1d9-a0f6fd4cf6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:28.827897 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cdddb-ba73-40b8-a1d9-a0f6fd4cf6b2 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:28.830586 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 437/885] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:28.839240 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e18467-f405-44a0-877f-1df9a28bb9fd None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:28.849088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73df5de-c276-4f77-8a90-594147794321 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:28.849397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73df5de-c276-4f77-8a90-594147794321 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:28.849647 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73df5de-c276-4f77-8a90-594147794321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:28.876543 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e73df5de-c276-4f77-8a90-594147794321 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:28.877939 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e73df5de-c276-4f77-8a90-594147794321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:28.889901 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9434e4f-6159-4064-81d3-d79b97522acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:28.890937 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9434e4f-6159-4064-81d3-d79b97522acc None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:28.891414 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9434e4f-6159-4064-81d3-d79b97522acc None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:28.891895 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9434e4f-6159-4064-81d3-d79b97522acc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:28.965523 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 438/886] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:53:28.980024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9434e4f-6159-4064-81d3-d79b97522acc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:28.982355 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9434e4f-6159-4064-81d3-d79b97522acc None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:28.988679 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73df5de-c276-4f77-8a90-594147794321 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:29.108857 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 449/887] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:53:28 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:53:29.120815 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9434e4f-6159-4064-81d3-d79b97522acc None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:29.120984 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73df5de-c276-4f77-8a90-594147794321 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:29.156473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71bd89-57fb-455c-a8c8-da3f4c9ecce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:29.157590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71bd89-57fb-455c-a8c8-da3f4c9ecce7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:29.157870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71bd89-57fb-455c-a8c8-da3f4c9ecce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:29.158143 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71bd89-57fb-455c-a8c8-da3f4c9ecce7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:29.158799 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71bd89-57fb-455c-a8c8-da3f4c9ecce7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:29.160770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71bd89-57fb-455c-a8c8-da3f4c9ecce7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:29.172235 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-2a71bd89-57fb-455c-a8c8-da3f4c9ecce7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:53:29.173841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 439/888] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 27 04:53:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:29.179876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71bd89-57fb-455c-a8c8-da3f4c9ecce7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:29.235207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9434e4f-6159-4064-81d3-d79b97522acc None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:29.277809 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb70983-b7b5-4660-8901-7502be8486b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:29.278766 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb70983-b7b5-4660-8901-7502be8486b9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:29.279048 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb70983-b7b5-4660-8901-7502be8486b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:29.279358 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb70983-b7b5-4660-8901-7502be8486b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:29.285935 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71bd89-57fb-455c-a8c8-da3f4c9ecce7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:29.289733 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb70983-b7b5-4660-8901-7502be8486b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:29.291257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb70983-b7b5-4660-8901-7502be8486b9 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:29.309514 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-ffb70983-b7b5-4660-8901-7502be8486b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:29.311108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 450/889] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:29.317744 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb70983-b7b5-4660-8901-7502be8486b9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:29.328281 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7c1b-9d5c-427f-9698-93c7d08e7d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:29.329182 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7c1b-9d5c-427f-9698-93c7d08e7d4a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:29.329554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7c1b-9d5c-427f-9698-93c7d08e7d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:29.329925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7c1b-9d5c-427f-9698-93c7d08e7d4a None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:29.330748 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce7c1b-9d5c-427f-9698-93c7d08e7d4a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:29.331165 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce7c1b-9d5c-427f-9698-93c7d08e7d4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:29.332980 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce7c1b-9d5c-427f-9698-93c7d08e7d4a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:29.342816 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 440/890] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 27 04:53:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:29.343795 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7c1b-9d5c-427f-9698-93c7d08e7d4a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:29.420902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb70983-b7b5-4660-8901-7502be8486b9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:29.456813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf424b6-fa6e-4e35-8aa8-3faaeb37d5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:29.457956 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf424b6-fa6e-4e35-8aa8-3faaeb37d5ef None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:29.458550 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf424b6-fa6e-4e35-8aa8-3faaeb37d5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:29.458908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf424b6-fa6e-4e35-8aa8-3faaeb37d5ef None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:29.459839 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf424b6-fa6e-4e35-8aa8-3faaeb37d5ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:29.460508 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf424b6-fa6e-4e35-8aa8-3faaeb37d5ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:29.462226 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf424b6-fa6e-4e35-8aa8-3faaeb37d5ef None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:29.462857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7c1b-9d5c-427f-9698-93c7d08e7d4a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:29.476928 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 451/891] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:29.483593 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf424b6-fa6e-4e35-8aa8-3faaeb37d5ef None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:29.506988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8b09f-7195-49a4-90de-94712c11aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:29.507666 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8b09f-7195-49a4-90de-94712c11aca4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:29.508239 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8b09f-7195-49a4-90de-94712c11aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:29.508518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8b09f-7195-49a4-90de-94712c11aca4 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:29.509270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8b09f-7195-49a4-90de-94712c11aca4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:29.509585 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8b09f-7195-49a4-90de-94712c11aca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:29.511374 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8b09f-7195-49a4-90de-94712c11aca4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:29.517433 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 441/892] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 27 04:53:29 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:29.605044 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf424b6-fa6e-4e35-8aa8-3faaeb37d5ef None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:29.643089 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9c647-b12b-4a50-abea-9f8cdd618656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:29.644017 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9c647-b12b-4a50-abea-9f8cdd618656 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:29.644308 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9c647-b12b-4a50-abea-9f8cdd618656 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:29.644549 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9c647-b12b-4a50-abea-9f8cdd618656 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:29.652442 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9c647-b12b-4a50-abea-9f8cdd618656 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:29.654020 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9c647-b12b-4a50-abea-9f8cdd618656 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:29.669782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-1ba9c647-b12b-4a50-abea-9f8cdd618656 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:29.676067 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 452/893] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:29.677455 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8b09f-7195-49a4-90de-94712c11aca4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:29.779604 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8b09f-7195-49a4-90de-94712c11aca4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:29.812805 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd41c0b-88bb-4e8f-9b94-4db5e5e7559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:29.813489 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd41c0b-88bb-4e8f-9b94-4db5e5e7559b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:29.813766 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd41c0b-88bb-4e8f-9b94-4db5e5e7559b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:29.814039 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd41c0b-88bb-4e8f-9b94-4db5e5e7559b None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:29.814878 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd41c0b-88bb-4e8f-9b94-4db5e5e7559b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:29.815189 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd41c0b-88bb-4e8f-9b94-4db5e5e7559b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:29.817105 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd41c0b-88bb-4e8f-9b94-4db5e5e7559b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:29.832919 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 442/894] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:29.835934 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9c647-b12b-4a50-abea-9f8cdd618656 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:29.937298 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9c647-b12b-4a50-abea-9f8cdd618656 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:29.977323 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15033758-e3d0-47ec-a3f7-9474e1a67973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:29.977323 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15033758-e3d0-47ec-a3f7-9474e1a67973 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:29.977323 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15033758-e3d0-47ec-a3f7-9474e1a67973 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:29.977323 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15033758-e3d0-47ec-a3f7-9474e1a67973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:29.978213 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15033758-e3d0-47ec-a3f7-9474e1a67973 None admin] RBAC: Adding query filter params (role.id=66c1cde8141c4a1987bd171077d0ddf3, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=d27fb10124d24c8ea208a4d020274269) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:29.978213 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15033758-e3d0-47ec-a3f7-9474e1a67973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:29.978213 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15033758-e3d0-47ec-a3f7-9474e1a67973 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:29.991607 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 453/895] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:53:29 2022] GET /identity/v3/role_assignments?user.id=d27fb10124d24c8ea208a4d020274269&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=66c1cde8141c4a1987bd171077d0ddf3 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:30.763867 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15768d5-fec9-44a3-85f4-075b858d2e46 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:30.769657 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15768d5-fec9-44a3-85f4-075b858d2e46 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:30.769657 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15768d5-fec9-44a3-85f4-075b858d2e46 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:30.769657 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 443/896] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:30.772862 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31891f96-41d7-49ae-80f8-c47ab3c18009 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:30.773291 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31891f96-41d7-49ae-80f8-c47ab3c18009 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:30.773432 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31891f96-41d7-49ae-80f8-c47ab3c18009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:30.790403 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-31891f96-41d7-49ae-80f8-c47ab3c18009 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:30.791579 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-31891f96-41d7-49ae-80f8-c47ab3c18009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:30.866712 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 454/897] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:30.889813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15768d5-fec9-44a3-85f4-075b858d2e46 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:30.995076 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15768d5-fec9-44a3-85f4-075b858d2e46 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:31.032447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee670f-30f8-4015-990c-2b2e21a919c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:31.033680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee670f-30f8-4015-990c-2b2e21a919c3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:31.034120 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee670f-30f8-4015-990c-2b2e21a919c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:31.035066 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee670f-30f8-4015-990c-2b2e21a919c3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:31.035856 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee670f-30f8-4015-990c-2b2e21a919c3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:31.037396 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee670f-30f8-4015-990c-2b2e21a919c3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:31.048499 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-5aee670f-30f8-4015-990c-2b2e21a919c3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 04:53:31.050309 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 444/898] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:53:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:31.056243 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31891f96-41d7-49ae-80f8-c47ab3c18009 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:31.161431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31891f96-41d7-49ae-80f8-c47ab3c18009 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:31.195583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568ad11-ab66-4437-bfb3-14164a14a541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:31.196255 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568ad11-ab66-4437-bfb3-14164a14a541 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:31.196528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568ad11-ab66-4437-bfb3-14164a14a541 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:31.196825 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568ad11-ab66-4437-bfb3-14164a14a541 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:31.197537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568ad11-ab66-4437-bfb3-14164a14a541 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:31.197839 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568ad11-ab66-4437-bfb3-14164a14a541 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:31.199223 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568ad11-ab66-4437-bfb3-14164a14a541 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:31.204501 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 455/899] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:53:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:31.210666 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee670f-30f8-4015-990c-2b2e21a919c3 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:31.314169 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee670f-30f8-4015-990c-2b2e21a919c3 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:31.347874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687fe6f-6e38-4f24-b99f-6e20f8b84739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:31.348808 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687fe6f-6e38-4f24-b99f-6e20f8b84739 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:31.349242 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687fe6f-6e38-4f24-b99f-6e20f8b84739 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:31.349662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687fe6f-6e38-4f24-b99f-6e20f8b84739 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:31.350510 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687fe6f-6e38-4f24-b99f-6e20f8b84739 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:31.350967 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687fe6f-6e38-4f24-b99f-6e20f8b84739 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:31.352476 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687fe6f-6e38-4f24-b99f-6e20f8b84739 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:31.357807 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 445/900] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:53:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:31.364927 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568ad11-ab66-4437-bfb3-14164a14a541 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:31.371815 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b70ab-1643-47c5-90a9-123126178269 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:31.372091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b70ab-1643-47c5-90a9-123126178269 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:31.372366 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b70ab-1643-47c5-90a9-123126178269 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:31.374390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 446/901] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:53:31.379702 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0786c-6508-483e-9f9f-ab635c30c4cf None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:31.379985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0786c-6508-483e-9f9f-ab635c30c4cf None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:31.380263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0786c-6508-483e-9f9f-ab635c30c4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:31.397362 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e0d0786c-6508-483e-9f9f-ab635c30c4cf None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:31.398532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e0d0786c-6508-483e-9f9f-ab635c30c4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:31.467097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568ad11-ab66-4437-bfb3-14164a14a541 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:31.472311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 447/902] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:53:31.490465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0786c-6508-483e-9f9f-ab635c30c4cf None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:31.502393 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34b5a5-4300-463d-9207-deef91e46f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:31.503585 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34b5a5-4300-463d-9207-deef91e46f62 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:31.503881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34b5a5-4300-463d-9207-deef91e46f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:31.504155 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34b5a5-4300-463d-9207-deef91e46f62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:31.504969 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34b5a5-4300-463d-9207-deef91e46f62 None admin] RBAC: Adding query filter params (interface=public, service_id=508888375a564b59910b7a355792a1c2, region_id=RegionOne) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:31.505278 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34b5a5-4300-463d-9207-deef91e46f62 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:31.506714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34b5a5-4300-463d-9207-deef91e46f62 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:31.512308 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 456/903] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Sep 27 04:53:31 2022] GET /identity/v3/endpoints?service_id=508888375a564b59910b7a355792a1c2&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:31.522097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34b5a5-4300-463d-9207-deef91e46f62 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:31.592495 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0786c-6508-483e-9f9f-ab635c30c4cf None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:31.632986 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706a33f-9621-4263-8275-23ef102444c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:31.633970 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706a33f-9621-4263-8275-23ef102444c1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:31.634256 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706a33f-9621-4263-8275-23ef102444c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:31.634532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706a33f-9621-4263-8275-23ef102444c1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:31.635193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706a33f-9621-4263-8275-23ef102444c1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:31.636574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706a33f-9621-4263-8275-23ef102444c1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:31.636912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34b5a5-4300-463d-9207-deef91e46f62 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:31.655906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-8706a33f-9621-4263-8275-23ef102444c1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 04:53:31.657698 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 448/904] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Sep 27 04:53:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:31.665071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706a33f-9621-4263-8275-23ef102444c1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:31.676649 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17251d85-6ae8-4a56-bfc1-0ddba6c7a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:31.677435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17251d85-6ae8-4a56-bfc1-0ddba6c7a888 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:31.677717 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17251d85-6ae8-4a56-bfc1-0ddba6c7a888 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:31.677987 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17251d85-6ae8-4a56-bfc1-0ddba6c7a888 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:31.678675 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17251d85-6ae8-4a56-bfc1-0ddba6c7a888 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:31.680061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17251d85-6ae8-4a56-bfc1-0ddba6c7a888 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:31.686287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 457/905] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 27 04:53:31 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:53:31.783407 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706a33f-9621-4263-8275-23ef102444c1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:31.821115 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95236645-eeaa-472d-ac29-8a4396c9845d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:31.821835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95236645-eeaa-472d-ac29-8a4396c9845d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:31.822113 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95236645-eeaa-472d-ac29-8a4396c9845d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:31.822382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95236645-eeaa-472d-ac29-8a4396c9845d None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:31.823098 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95236645-eeaa-472d-ac29-8a4396c9845d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:31.823400 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95236645-eeaa-472d-ac29-8a4396c9845d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:31.824776 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95236645-eeaa-472d-ac29-8a4396c9845d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:31.830531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 449/906] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 27 04:53:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:31.836873 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17251d85-6ae8-4a56-bfc1-0ddba6c7a888 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:31.948085 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17251d85-6ae8-4a56-bfc1-0ddba6c7a888 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:31.986153 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbf3fb-b61b-49f5-8779-35551cd3bf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:31.987032 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf3fb-b61b-49f5-8779-35551cd3bf90 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:31.988005 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf3fb-b61b-49f5-8779-35551cd3bf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:31.988421 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbf3fb-b61b-49f5-8779-35551cd3bf90 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:31.989300 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbf3fb-b61b-49f5-8779-35551cd3bf90 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:31.989749 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbf3fb-b61b-49f5-8779-35551cd3bf90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:31.991311 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbf3fb-b61b-49f5-8779-35551cd3bf90 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:31.997268 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 458/907] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 27 04:53:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:32.004287 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95236645-eeaa-472d-ac29-8a4396c9845d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:32.032720 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5ac72-382b-4b7f-8f57-15f0322d9968 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:32.033299 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5ac72-382b-4b7f-8f57-15f0322d9968 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:32.033724 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5ac72-382b-4b7f-8f57-15f0322d9968 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:32.037052 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 459/908] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:53:32.041785 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6e430-4c25-40d8-8547-5f9050f7054b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:32.042312 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6e430-4c25-40d8-8547-5f9050f7054b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:32.042754 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6e430-4c25-40d8-8547-5f9050f7054b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:32.061897 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ffa6e430-4c25-40d8-8547-5f9050f7054b None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:32.063387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ffa6e430-4c25-40d8-8547-5f9050f7054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:32.130936 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95236645-eeaa-472d-ac29-8a4396c9845d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:32.144757 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 460/909] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:53:32.164123 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6e430-4c25-40d8-8547-5f9050f7054b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:32.166190 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711f884-63a9-424e-a9ce-766fdababee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:32.167048 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711f884-63a9-424e-a9ce-766fdababee8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:32.167328 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711f884-63a9-424e-a9ce-766fdababee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:32.167604 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711f884-63a9-424e-a9ce-766fdababee8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:32.169046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711f884-63a9-424e-a9ce-766fdababee8 None admin] RBAC: Adding query filter params (interface=public, service_id=bc08c2b9a4004bbcbf29453b92ce54c9, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:32.169616 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711f884-63a9-424e-a9ce-766fdababee8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:32.171252 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711f884-63a9-424e-a9ce-766fdababee8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:32.177873 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 450/910] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Sep 27 04:53:32 2022] GET /identity/v3/endpoints?service_id=bc08c2b9a4004bbcbf29453b92ce54c9&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:32.183833 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711f884-63a9-424e-a9ce-766fdababee8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:32.289074 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6e430-4c25-40d8-8547-5f9050f7054b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:32.304947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711f884-63a9-424e-a9ce-766fdababee8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:32.330937 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654436af-0219-4f24-904d-6488be9d0804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:32.332132 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654436af-0219-4f24-904d-6488be9d0804 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:32.333176 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654436af-0219-4f24-904d-6488be9d0804 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:32.333779 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654436af-0219-4f24-904d-6488be9d0804 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:32.334804 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654436af-0219-4f24-904d-6488be9d0804 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:32.336589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654436af-0219-4f24-904d-6488be9d0804 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:32.348262 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f36ffe-0a21-478c-9ca1-c5be8770dc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:32.349395 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f36ffe-0a21-478c-9ca1-c5be8770dc63 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:32.350036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f36ffe-0a21-478c-9ca1-c5be8770dc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:32.350509 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f36ffe-0a21-478c-9ca1-c5be8770dc63 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:32.351410 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f36ffe-0a21-478c-9ca1-c5be8770dc63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:32.353076 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f36ffe-0a21-478c-9ca1-c5be8770dc63 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:32.360815 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 461/911] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 27 04:53:32 2022] POST /identity/v3/services => generated 241 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:53:32.364521 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 451/912] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 27 04:53:32 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:53:32.427424 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc708f0-75c5-4512-8783-7e6d4b582f84 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:32.427774 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc708f0-75c5-4512-8783-7e6d4b582f84 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:32.427978 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc708f0-75c5-4512-8783-7e6d4b582f84 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:32.430246 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 462/913] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:32.436114 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6402a-e23d-40aa-bb64-79f938799c33 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:32.436425 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6402a-e23d-40aa-bb64-79f938799c33 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:32.436672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6402a-e23d-40aa-bb64-79f938799c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:32.457620 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-daf6402a-e23d-40aa-bb64-79f938799c33 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:32.458866 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-daf6402a-e23d-40aa-bb64-79f938799c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:32.546838 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 452/914] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:32.570592 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc708f0-75c5-4512-8783-7e6d4b582f84 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:32.677915 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc708f0-75c5-4512-8783-7e6d4b582f84 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:32.713048 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408716ff-521c-4142-a751-e7aabd382bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:32.713852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408716ff-521c-4142-a751-e7aabd382bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:32.714127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408716ff-521c-4142-a751-e7aabd382bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:32.714395 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408716ff-521c-4142-a751-e7aabd382bc9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:32.725441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408716ff-521c-4142-a751-e7aabd382bc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:32.733096 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-408716ff-521c-4142-a751-e7aabd382bc9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:53:32.734725 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 463/915] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Sep 27 04:53:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:32.741206 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6402a-e23d-40aa-bb64-79f938799c33 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:32.841291 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6402a-e23d-40aa-bb64-79f938799c33 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:32.876178 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244feda9-824a-4c15-85f9-cad834df4311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:32.876884 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244feda9-824a-4c15-85f9-cad834df4311 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:32.877162 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244feda9-824a-4c15-85f9-cad834df4311 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:32.877436 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244feda9-824a-4c15-85f9-cad834df4311 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:32.878269 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244feda9-824a-4c15-85f9-cad834df4311 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:32.878576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244feda9-824a-4c15-85f9-cad834df4311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:32.879944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244feda9-824a-4c15-85f9-cad834df4311 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:32.888146 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 453/916] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Sep 27 04:53:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:32.894177 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408716ff-521c-4142-a751-e7aabd382bc9 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:33.002074 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408716ff-521c-4142-a751-e7aabd382bc9 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:33.035876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1305373-ae76-43a9-9975-5a3445d9b002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:33.036668 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1305373-ae76-43a9-9975-5a3445d9b002 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:33.036973 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1305373-ae76-43a9-9975-5a3445d9b002 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:33.037320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1305373-ae76-43a9-9975-5a3445d9b002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:33.047927 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1305373-ae76-43a9-9975-5a3445d9b002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:33.049443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1305373-ae76-43a9-9975-5a3445d9b002 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:33.067724 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-f1305373-ae76-43a9-9975-5a3445d9b002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:33.069296 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 464/917] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:33.074543 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244feda9-824a-4c15-85f9-cad834df4311 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:33.176626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244feda9-824a-4c15-85f9-cad834df4311 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:33.210537 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2a77c-b91b-4a7c-b1d6-34ffd2a00a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:33.211203 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2a77c-b91b-4a7c-b1d6-34ffd2a00a09 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:33.211480 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2a77c-b91b-4a7c-b1d6-34ffd2a00a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:33.211751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2a77c-b91b-4a7c-b1d6-34ffd2a00a09 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:33.212466 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2a77c-b91b-4a7c-b1d6-34ffd2a00a09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:33.212880 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2a77c-b91b-4a7c-b1d6-34ffd2a00a09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:33.214206 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2a77c-b91b-4a7c-b1d6-34ffd2a00a09 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:33.227610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 454/918] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:33.233114 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1305373-ae76-43a9-9975-5a3445d9b002 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:33.337581 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1305373-ae76-43a9-9975-5a3445d9b002 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:33.372184 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34292e-7f16-46ed-9f1c-dc5027c17ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:33.373023 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34292e-7f16-46ed-9f1c-dc5027c17ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:33.373312 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34292e-7f16-46ed-9f1c-dc5027c17ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:33.373590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34292e-7f16-46ed-9f1c-dc5027c17ea5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:33.382306 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34292e-7f16-46ed-9f1c-dc5027c17ea5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:33.383769 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34292e-7f16-46ed-9f1c-dc5027c17ea5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:33.398432 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-5d34292e-7f16-46ed-9f1c-dc5027c17ea5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:53:33.400042 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 465/919] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 27 04:53:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:33.405416 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2a77c-b91b-4a7c-b1d6-34ffd2a00a09 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:33.510148 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2a77c-b91b-4a7c-b1d6-34ffd2a00a09 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:33.545734 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04dcfc5-2adb-48af-8bd7-ebbebf94c460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:33.546417 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04dcfc5-2adb-48af-8bd7-ebbebf94c460 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:33.546700 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04dcfc5-2adb-48af-8bd7-ebbebf94c460 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:33.546976 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04dcfc5-2adb-48af-8bd7-ebbebf94c460 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:33.547820 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04dcfc5-2adb-48af-8bd7-ebbebf94c460 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:33.548128 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04dcfc5-2adb-48af-8bd7-ebbebf94c460 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:33.550797 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04dcfc5-2adb-48af-8bd7-ebbebf94c460 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:33.570823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 455/920] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Sep 27 04:53:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:33.576364 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34292e-7f16-46ed-9f1c-dc5027c17ea5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:33.699840 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34292e-7f16-46ed-9f1c-dc5027c17ea5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:33.743450 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119ce6f-a4a6-46ad-92f4-e78b67b9192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:33.744242 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119ce6f-a4a6-46ad-92f4-e78b67b9192c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:33.744521 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119ce6f-a4a6-46ad-92f4-e78b67b9192c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:33.744822 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119ce6f-a4a6-46ad-92f4-e78b67b9192c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:33.758026 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119ce6f-a4a6-46ad-92f4-e78b67b9192c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:33.759498 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119ce6f-a4a6-46ad-92f4-e78b67b9192c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:33.777173 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-f119ce6f-a4a6-46ad-92f4-e78b67b9192c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:33.778624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 466/921] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:33.785686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04dcfc5-2adb-48af-8bd7-ebbebf94c460 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:33.919101 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04dcfc5-2adb-48af-8bd7-ebbebf94c460 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:33.964305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b654c-c8b3-4704-beb0-22a29a02a8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:33.965010 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b654c-c8b3-4704-beb0-22a29a02a8ab None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:33.965292 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b654c-c8b3-4704-beb0-22a29a02a8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:33.965564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b654c-c8b3-4704-beb0-22a29a02a8ab None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:33.966292 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b654c-c8b3-4704-beb0-22a29a02a8ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:33.966599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b654c-c8b3-4704-beb0-22a29a02a8ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:33.967970 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b654c-c8b3-4704-beb0-22a29a02a8ab None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:34.000150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 456/922] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:34.005990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119ce6f-a4a6-46ad-92f4-e78b67b9192c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:34.139579 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119ce6f-a4a6-46ad-92f4-e78b67b9192c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:34.175445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffee68c-e455-4b9d-a99f-c2778ca04805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:34.176243 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffee68c-e455-4b9d-a99f-c2778ca04805 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:34.176521 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffee68c-e455-4b9d-a99f-c2778ca04805 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:34.176812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffee68c-e455-4b9d-a99f-c2778ca04805 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:34.183820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffee68c-e455-4b9d-a99f-c2778ca04805 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:34.185314 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffee68c-e455-4b9d-a99f-c2778ca04805 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:34.200370 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-6ffee68c-e455-4b9d-a99f-c2778ca04805 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:34.201932 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 467/923] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:34.208655 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b654c-c8b3-4704-beb0-22a29a02a8ab None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:34.279350 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76865f-5ec8-4ec8-bf1f-a7b9f0a999c1 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:34.279675 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76865f-5ec8-4ec8-bf1f-a7b9f0a999c1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:34.279890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76865f-5ec8-4ec8-bf1f-a7b9f0a999c1 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:34.282104 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 468/924] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:53:34.287814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f884d-3b9b-421f-b838-945b57e068a5 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:34.288081 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f884d-3b9b-421f-b838-945b57e068a5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:34.288361 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f884d-3b9b-421f-b838-945b57e068a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:34.306831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0d4f884d-3b9b-421f-b838-945b57e068a5 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:34.308038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0d4f884d-3b9b-421f-b838-945b57e068a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:34.330895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b654c-c8b3-4704-beb0-22a29a02a8ab None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:34.378094 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa941cb7-e5d3-4b22-aba7-22134d3f7704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:34.378975 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa941cb7-e5d3-4b22-aba7-22134d3f7704 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:34.379258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa941cb7-e5d3-4b22-aba7-22134d3f7704 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:34.379535 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa941cb7-e5d3-4b22-aba7-22134d3f7704 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:34.380328 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa941cb7-e5d3-4b22-aba7-22134d3f7704 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:34.380637 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa941cb7-e5d3-4b22-aba7-22134d3f7704 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:34.382794 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa941cb7-e5d3-4b22-aba7-22134d3f7704 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:34.388717 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 469/925] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:34.397213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 457/926] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:34.404146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f884d-3b9b-421f-b838-945b57e068a5 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:34.407783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa941cb7-e5d3-4b22-aba7-22134d3f7704 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:34.517291 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f884d-3b9b-421f-b838-945b57e068a5 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:34.520327 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa941cb7-e5d3-4b22-aba7-22134d3f7704 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:34.559056 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3066a-0601-4f86-8e4d-79e6e47c4cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:34.560004 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3066a-0601-4f86-8e4d-79e6e47c4cc4 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:34.560284 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3066a-0601-4f86-8e4d-79e6e47c4cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:34.560868 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3066a-0601-4f86-8e4d-79e6e47c4cc4 None admin] PATH_INFO: `/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/d27fb10124d24c8ea208a4d020274269/roles/66c1cde8141c4a1987bd171077d0ddf3` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:34.565091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3066a-0601-4f86-8e4d-79e6e47c4cc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=470fa8cf5f4a443faea9cfc628ff6003, user_id=d27fb10124d24c8ea208a4d020274269, role_id=66c1cde8141c4a1987bd171077d0ddf3)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:34.567217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3066a-0601-4f86-8e4d-79e6e47c4cc4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:34.569684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97973230-4f03-4a2c-9fb7-8d459b29c047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:34.570600 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973230-4f03-4a2c-9fb7-8d459b29c047 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:34.570884 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973230-4f03-4a2c-9fb7-8d459b29c047 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:34.571137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973230-4f03-4a2c-9fb7-8d459b29c047 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:34.571823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97973230-4f03-4a2c-9fb7-8d459b29c047 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:34.574503 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97973230-4f03-4a2c-9fb7-8d459b29c047 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:34.592253 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-97973230-4f03-4a2c-9fb7-8d459b29c047 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 27 04:53:34.592704 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 470/927] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:53:34 2022] PUT /identity/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/d27fb10124d24c8ea208a4d020274269/roles/66c1cde8141c4a1987bd171077d0ddf3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:53:34.600069 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 458/928] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:53:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:34.601620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3066a-0601-4f86-8e4d-79e6e47c4cc4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:34.714663 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3066a-0601-4f86-8e4d-79e6e47c4cc4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:34.750389 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fb8fc-a933-47f2-b541-506fb5541c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:34.751064 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fb8fc-a933-47f2-b541-506fb5541c5e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:34.751341 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fb8fc-a933-47f2-b541-506fb5541c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:34.751614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fb8fc-a933-47f2-b541-506fb5541c5e None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:34.752328 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fb8fc-a933-47f2-b541-506fb5541c5e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:34.752631 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fb8fc-a933-47f2-b541-506fb5541c5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:34.755140 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fb8fc-a933-47f2-b541-506fb5541c5e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:34.760852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 471/929] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:53:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:34.766470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97973230-4f03-4a2c-9fb7-8d459b29c047 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:34.885692 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97973230-4f03-4a2c-9fb7-8d459b29c047 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:34.927722 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a73cf-05ef-452c-ae9a-166bfef6d0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:34.929223 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a73cf-05ef-452c-ae9a-166bfef6d0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:34.929717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a73cf-05ef-452c-ae9a-166bfef6d0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:34.930181 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a73cf-05ef-452c-ae9a-166bfef6d0c2 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:34.931080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a73cf-05ef-452c-ae9a-166bfef6d0c2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:34.931574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a73cf-05ef-452c-ae9a-166bfef6d0c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:34.933343 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a73cf-05ef-452c-ae9a-166bfef6d0c2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:34.939094 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 459/930] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Sep 27 04:53:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:34.943689 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b88b9-fd29-44f9-bb01-8cc0d3d984d1 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:34.944571 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b88b9-fd29-44f9-bb01-8cc0d3d984d1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:34.945082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a73cf-05ef-452c-ae9a-166bfef6d0c2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:34.945309 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b88b9-fd29-44f9-bb01-8cc0d3d984d1 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:34.950857 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 472/931] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:34.953222 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccca23c-2c3e-4e54-999d-bd9d7389c477 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:34.954042 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccca23c-2c3e-4e54-999d-bd9d7389c477 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:34.954353 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccca23c-2c3e-4e54-999d-bd9d7389c477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:34.975888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4ccca23c-2c3e-4e54-999d-bd9d7389c477 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:34.977047 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4ccca23c-2c3e-4e54-999d-bd9d7389c477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:35.055527 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a73cf-05ef-452c-ae9a-166bfef6d0c2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:35.060891 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 473/932] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:53:35.068434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb1d25-dec4-461a-9eb6-3bf1393efe4b None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:35.068725 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb1d25-dec4-461a-9eb6-3bf1393efe4b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:35.069038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb1d25-dec4-461a-9eb6-3bf1393efe4b None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:35.070891 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 474/933] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:35.076134 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27d968-c4c5-4e0f-b69a-eb820e048aff None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:35.076425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27d968-c4c5-4e0f-b69a-eb820e048aff None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:35.076705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27d968-c4c5-4e0f-b69a-eb820e048aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:35.097583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2f27d968-c4c5-4e0f-b69a-eb820e048aff None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:35.098769 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2f27d968-c4c5-4e0f-b69a-eb820e048aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:35.099307 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e7ca4-c519-4314-954b-ac199bf3c477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:35.099993 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e7ca4-c519-4314-954b-ac199bf3c477 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:35.100275 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e7ca4-c519-4314-954b-ac199bf3c477 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:35.100550 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e7ca4-c519-4314-954b-ac199bf3c477 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:35.101328 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e7ca4-c519-4314-954b-ac199bf3c477 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:35.102695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e7ca4-c519-4314-954b-ac199bf3c477 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:35.123978 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 460/934] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 04:53:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:53:35.124881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e7ca4-c519-4314-954b-ac199bf3c477 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:35.200399 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 475/935] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:53:35.224680 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27d968-c4c5-4e0f-b69a-eb820e048aff None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:35.269725 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e7ca4-c519-4314-954b-ac199bf3c477 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:35.309088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af169c6f-fd41-405b-be08-c50bc04d2ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:35.309339 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af169c6f-fd41-405b-be08-c50bc04d2ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:35.309427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af169c6f-fd41-405b-be08-c50bc04d2ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:35.309708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af169c6f-fd41-405b-be08-c50bc04d2ad0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:35.310373 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af169c6f-fd41-405b-be08-c50bc04d2ad0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:35.311747 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af169c6f-fd41-405b-be08-c50bc04d2ad0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:35.324004 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-af169c6f-fd41-405b-be08-c50bc04d2ad0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:53:35.325632 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 461/936] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 27 04:53:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:35.331188 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af169c6f-fd41-405b-be08-c50bc04d2ad0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:35.350002 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27d968-c4c5-4e0f-b69a-eb820e048aff None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:35.391922 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360fccb-d688-463b-9ea2-e2dd5f33a797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:35.392740 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360fccb-d688-463b-9ea2-e2dd5f33a797 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:35.393099 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360fccb-d688-463b-9ea2-e2dd5f33a797 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:35.393373 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360fccb-d688-463b-9ea2-e2dd5f33a797 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:35.397403 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360fccb-d688-463b-9ea2-e2dd5f33a797 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:35.397403 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360fccb-d688-463b-9ea2-e2dd5f33a797 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:35.407540 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-f360fccb-d688-463b-9ea2-e2dd5f33a797 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 27 04:53:35.409637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 476/937] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Sep 27 04:53:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:35.417640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360fccb-d688-463b-9ea2-e2dd5f33a797 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:35.452041 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af169c6f-fd41-405b-be08-c50bc04d2ad0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:35.487650 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9463e8-8b2c-414f-a6ef-22233648abff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:35.488417 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9463e8-8b2c-414f-a6ef-22233648abff None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:35.488770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9463e8-8b2c-414f-a6ef-22233648abff None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:35.489143 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9463e8-8b2c-414f-a6ef-22233648abff None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:35.489921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9463e8-8b2c-414f-a6ef-22233648abff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:35.490300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9463e8-8b2c-414f-a6ef-22233648abff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:35.491744 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9463e8-8b2c-414f-a6ef-22233648abff None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:35.501948 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 462/938] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 27 04:53:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:35.503560 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9463e8-8b2c-414f-a6ef-22233648abff None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:35.533343 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360fccb-d688-463b-9ea2-e2dd5f33a797 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:35.575814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7c955-30c1-4576-b0d1-c56bcf1b1d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:35.576820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7c955-30c1-4576-b0d1-c56bcf1b1d01 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:35.577105 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7c955-30c1-4576-b0d1-c56bcf1b1d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:35.577378 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7c955-30c1-4576-b0d1-c56bcf1b1d01 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:35.578363 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7c955-30c1-4576-b0d1-c56bcf1b1d01 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:35.578669 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7c955-30c1-4576-b0d1-c56bcf1b1d01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:35.580503 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7c955-30c1-4576-b0d1-c56bcf1b1d01 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:35.591198 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 477/939] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 27 04:53:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:35.592244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7c955-30c1-4576-b0d1-c56bcf1b1d01 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:35.625305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9463e8-8b2c-414f-a6ef-22233648abff None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:35.660413 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0784b1-9d20-486f-8f83-3a3641473a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:35.661120 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0784b1-9d20-486f-8f83-3a3641473a93 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:35.661400 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0784b1-9d20-486f-8f83-3a3641473a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:35.661672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0784b1-9d20-486f-8f83-3a3641473a93 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:35.662376 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0784b1-9d20-486f-8f83-3a3641473a93 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:35.662677 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0784b1-9d20-486f-8f83-3a3641473a93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:35.664051 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0784b1-9d20-486f-8f83-3a3641473a93 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:35.674009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 463/940] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 27 04:53:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:35.675827 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0784b1-9d20-486f-8f83-3a3641473a93 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:35.728314 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7c955-30c1-4576-b0d1-c56bcf1b1d01 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:35.777358 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30af745-3f4e-4282-aa33-d1a294cc62c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:35.778034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30af745-3f4e-4282-aa33-d1a294cc62c6 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:35.778318 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30af745-3f4e-4282-aa33-d1a294cc62c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:35.778592 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30af745-3f4e-4282-aa33-d1a294cc62c6 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:35.779312 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30af745-3f4e-4282-aa33-d1a294cc62c6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:35.779618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30af745-3f4e-4282-aa33-d1a294cc62c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:35.781057 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30af745-3f4e-4282-aa33-d1a294cc62c6 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:35.785194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0784b1-9d20-486f-8f83-3a3641473a93 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:35.791412 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 478/941] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 27 04:53:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:35.792355 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30af745-3f4e-4282-aa33-d1a294cc62c6 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:35.827584 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4068939-8b8d-4610-993b-f5902bf05b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:35.828397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4068939-8b8d-4610-993b-f5902bf05b46 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:35.828582 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4068939-8b8d-4610-993b-f5902bf05b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:35.828876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4068939-8b8d-4610-993b-f5902bf05b46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:35.829851 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4068939-8b8d-4610-993b-f5902bf05b46 None admin] RBAC: Adding query filter params (interface=public, service_id=c96cbf07d329485699cb6f028f2c3856, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:35.830040 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4068939-8b8d-4610-993b-f5902bf05b46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:35.832211 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4068939-8b8d-4610-993b-f5902bf05b46 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:35.843307 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 464/942] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Sep 27 04:53:35 2022] GET /identity/v3/endpoints?service_id=c96cbf07d329485699cb6f028f2c3856&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:35.844571 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4068939-8b8d-4610-993b-f5902bf05b46 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:35.907980 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30af745-3f4e-4282-aa33-d1a294cc62c6 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:35.942934 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f26c2d-1814-4367-b214-3bdea1d04d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:35.943667 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f26c2d-1814-4367-b214-3bdea1d04d32 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:35.944146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f26c2d-1814-4367-b214-3bdea1d04d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:35.944259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f26c2d-1814-4367-b214-3bdea1d04d32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:35.945057 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f26c2d-1814-4367-b214-3bdea1d04d32 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:35.946438 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f26c2d-1814-4367-b214-3bdea1d04d32 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:35.975237 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 479/943] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 04:53:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:53:35.975427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4068939-8b8d-4610-993b-f5902bf05b46 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:36.017420 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc93f9-edda-4b96-abf0-5670ad786895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:36.018107 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc93f9-edda-4b96-abf0-5670ad786895 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:36.018386 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc93f9-edda-4b96-abf0-5670ad786895 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:36.019406 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc93f9-edda-4b96-abf0-5670ad786895 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:36.020207 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc93f9-edda-4b96-abf0-5670ad786895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:36.021737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc93f9-edda-4b96-abf0-5670ad786895 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:36.029005 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 465/944] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 27 04:53:35 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:53:36.980199 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e3ff2-69dc-494d-860c-ec45e2d7dfcd None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:36.981027 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e3ff2-69dc-494d-860c-ec45e2d7dfcd None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:36.981446 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e3ff2-69dc-494d-860c-ec45e2d7dfcd None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:36.983598 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 480/945] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:36.989367 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6cce2-798f-479d-89b3-cc3fbf4a65c8 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:36.990209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6cce2-798f-479d-89b3-cc3fbf4a65c8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:36.990696 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6cce2-798f-479d-89b3-cc3fbf4a65c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:37.010995 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3dd6cce2-798f-479d-89b3-cc3fbf4a65c8 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:37.012515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3dd6cce2-798f-479d-89b3-cc3fbf4a65c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:37.079740 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 466/946] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:37.103853 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e3ff2-69dc-494d-860c-ec45e2d7dfcd None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:37.211500 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e3ff2-69dc-494d-860c-ec45e2d7dfcd None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:37.254234 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3be81-7246-4de3-b45f-afc42655e2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:37.254976 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3be81-7246-4de3-b45f-afc42655e2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:37.255257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3be81-7246-4de3-b45f-afc42655e2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:37.255522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3be81-7246-4de3-b45f-afc42655e2f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:37.267206 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3be81-7246-4de3-b45f-afc42655e2f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:37.275209 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-6fd3be81-7246-4de3-b45f-afc42655e2f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:53:37.276809 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 481/947] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Sep 27 04:53:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:37.282615 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6cce2-798f-479d-89b3-cc3fbf4a65c8 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:37.381958 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6cce2-798f-479d-89b3-cc3fbf4a65c8 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:37.421476 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8b020-2f95-4e27-b0ec-9a334e72ca5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:37.422490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8b020-2f95-4e27-b0ec-9a334e72ca5e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:37.423020 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8b020-2f95-4e27-b0ec-9a334e72ca5e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:37.423593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8b020-2f95-4e27-b0ec-9a334e72ca5e None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:37.424617 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8b020-2f95-4e27-b0ec-9a334e72ca5e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:37.425732 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8b020-2f95-4e27-b0ec-9a334e72ca5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:37.427283 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8b020-2f95-4e27-b0ec-9a334e72ca5e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:37.436771 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 467/948] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Sep 27 04:53:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:37.442804 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3be81-7246-4de3-b45f-afc42655e2f4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:37.566694 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3be81-7246-4de3-b45f-afc42655e2f4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:37.602351 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003b828-4cdd-47d7-8a7f-7b9b41dbe0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:37.603456 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003b828-4cdd-47d7-8a7f-7b9b41dbe0ec None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:37.603945 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003b828-4cdd-47d7-8a7f-7b9b41dbe0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:37.604420 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003b828-4cdd-47d7-8a7f-7b9b41dbe0ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:37.615936 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003b828-4cdd-47d7-8a7f-7b9b41dbe0ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:37.617674 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003b828-4cdd-47d7-8a7f-7b9b41dbe0ec None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:37.635206 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-6003b828-4cdd-47d7-8a7f-7b9b41dbe0ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:37.641030 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 482/949] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:37.642788 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8b020-2f95-4e27-b0ec-9a334e72ca5e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:37.676467 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21800d-8c70-4c7d-b52c-d11ee058ec22 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:37.676823 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21800d-8c70-4c7d-b52c-d11ee058ec22 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:37.677054 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21800d-8c70-4c7d-b52c-d11ee058ec22 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:37.678953 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 483/950] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:53:37.686233 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa7e84-b188-4b46-92c5-098eff14d660 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:37.686513 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa7e84-b188-4b46-92c5-098eff14d660 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:37.686787 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa7e84-b188-4b46-92c5-098eff14d660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:37.715188 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1cfa7e84-b188-4b46-92c5-098eff14d660 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:37.716983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1cfa7e84-b188-4b46-92c5-098eff14d660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:37.820151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 484/951] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:53:37.837661 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8b020-2f95-4e27-b0ec-9a334e72ca5e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:37.843451 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa7e84-b188-4b46-92c5-098eff14d660 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:37.906146 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692f87a-8e0f-47cc-864f-f6768c4b0a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:37.906814 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692f87a-8e0f-47cc-864f-f6768c4b0a5a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:37.907095 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692f87a-8e0f-47cc-864f-f6768c4b0a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:37.907367 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692f87a-8e0f-47cc-864f-f6768c4b0a5a None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:37.908089 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692f87a-8e0f-47cc-864f-f6768c4b0a5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:37.908390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692f87a-8e0f-47cc-864f-f6768c4b0a5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:37.913154 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692f87a-8e0f-47cc-864f-f6768c4b0a5a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:37.948851 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 468/952] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:37.948851 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692f87a-8e0f-47cc-864f-f6768c4b0a5a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:37.956491 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa7e84-b188-4b46-92c5-098eff14d660 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:38.004816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9f40d-3f87-4212-a9df-e23cc4750e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:38.004816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9f40d-3f87-4212-a9df-e23cc4750e1b None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:38.004816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9f40d-3f87-4212-a9df-e23cc4750e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:38.004816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9f40d-3f87-4212-a9df-e23cc4750e1b None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:38.005614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9f40d-3f87-4212-a9df-e23cc4750e1b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:38.005614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c9f40d-3f87-4212-a9df-e23cc4750e1b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:38.008819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.common [None req-f9c9f40d-3f87-4212-a9df-e23cc4750e1b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 27 04:53:38.030097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.sql.core [None req-f9c9f40d-3f87-4212-a9df-e23cc4750e1b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 27 04:53:38.030097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 27 04:53:38.030097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [parameters: {'id': '1fb3e01cbf974989881960dd33fa697c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 27 04:53:38.030097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80022) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 27 04:53:38.041263 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-f9c9f40d-3f87-4212-a9df-e23cc4750e1b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1fb3e01cbf974989881960dd33fa697c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1fb3e01cbf974989881960dd33fa697c. Sep 27 04:53:38.043097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 485/953] 10.222.0.27 () {60 vars in 1140 bytes} [Tue Sep 27 04:53:37 2022] POST /identity/v3/projects => generated 262 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:38.060815 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9f40d-3f87-4212-a9df-e23cc4750e1b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:38.137770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692f87a-8e0f-47cc-864f-f6768c4b0a5a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:38.179072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e70483-ecfe-4365-80e8-32c3e9debdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:38.179969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e70483-ecfe-4365-80e8-32c3e9debdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:38.180246 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e70483-ecfe-4365-80e8-32c3e9debdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:38.180513 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e70483-ecfe-4365-80e8-32c3e9debdc7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:38.184032 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9f40d-3f87-4212-a9df-e23cc4750e1b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:38.188132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e70483-ecfe-4365-80e8-32c3e9debdc7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:38.189733 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e70483-ecfe-4365-80e8-32c3e9debdc7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:38.204532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-c5e70483-ecfe-4365-80e8-32c3e9debdc7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 27 04:53:38.211405 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 469/954] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 27 04:53:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:38.212250 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e70483-ecfe-4365-80e8-32c3e9debdc7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:38.224224 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961dae6-e22d-4b28-9a46-727805f59c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:38.225355 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961dae6-e22d-4b28-9a46-727805f59c07 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:38.225639 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961dae6-e22d-4b28-9a46-727805f59c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:38.226188 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961dae6-e22d-4b28-9a46-727805f59c07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:38.235230 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961dae6-e22d-4b28-9a46-727805f59c07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:38.238185 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961dae6-e22d-4b28-9a46-727805f59c07 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:38.256227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-a961dae6-e22d-4b28-9a46-727805f59c07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:38.258472 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 486/955] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:38.264483 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961dae6-e22d-4b28-9a46-727805f59c07 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:38.332558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e70483-ecfe-4365-80e8-32c3e9debdc7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:38.374766 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6672c5f-f404-41e2-9776-089fa2c0f345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:38.375834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6672c5f-f404-41e2-9776-089fa2c0f345 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:38.376570 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6672c5f-f404-41e2-9776-089fa2c0f345 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:38.377032 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6672c5f-f404-41e2-9776-089fa2c0f345 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:38.379120 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6672c5f-f404-41e2-9776-089fa2c0f345 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:38.379801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6672c5f-f404-41e2-9776-089fa2c0f345 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:38.381994 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6672c5f-f404-41e2-9776-089fa2c0f345 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:38.386870 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961dae6-e22d-4b28-9a46-727805f59c07 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:38.404009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 470/956] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Sep 27 04:53:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:38.410430 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6672c5f-f404-41e2-9776-089fa2c0f345 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:38.427074 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddfc5d-d612-4b41-9447-d3d43431fa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:38.427946 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddfc5d-d612-4b41-9447-d3d43431fa47 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:38.428394 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddfc5d-d612-4b41-9447-d3d43431fa47 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:38.428825 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddfc5d-d612-4b41-9447-d3d43431fa47 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:38.429709 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddfc5d-d612-4b41-9447-d3d43431fa47 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:38.430150 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddfc5d-d612-4b41-9447-d3d43431fa47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:38.431712 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddfc5d-d612-4b41-9447-d3d43431fa47 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:38.460942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 487/957] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 27 04:53:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:38.498959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aea1b-2e23-4af5-83c4-f5487af38bd8 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:38.499615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aea1b-2e23-4af5-83c4-f5487af38bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:38.500095 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aea1b-2e23-4af5-83c4-f5487af38bd8 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:38.502427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 488/958] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:53:38.508839 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006fbd9-01e2-43c7-95f5-532465a632f2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:38.508839 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006fbd9-01e2-43c7-95f5-532465a632f2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:38.509106 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006fbd9-01e2-43c7-95f5-532465a632f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:38.526543 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6672c5f-f404-41e2-9776-089fa2c0f345 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:38.531857 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1006fbd9-01e2-43c7-95f5-532465a632f2 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:38.533543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1006fbd9-01e2-43c7-95f5-532465a632f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:38.564911 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026f994-2245-432a-84bf-60c361d15a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:38.566187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026f994-2245-432a-84bf-60c361d15a6c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:38.566466 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026f994-2245-432a-84bf-60c361d15a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:38.566741 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026f994-2245-432a-84bf-60c361d15a6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:38.609097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 489/959] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:53:38.610450 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1661b77-d11a-4b2d-9734-a61dfe2b53cd None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:38.610736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1661b77-d11a-4b2d-9734-a61dfe2b53cd None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:38.611009 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1661b77-d11a-4b2d-9734-a61dfe2b53cd None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:38.617277 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 490/960] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:38.618904 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c8cd8-c999-444b-8126-30cd081a1c98 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:38.619189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c8cd8-c999-444b-8126-30cd081a1c98 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:38.619464 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c8cd8-c999-444b-8126-30cd081a1c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:38.639771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b41c8cd8-c999-444b-8126-30cd081a1c98 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:38.641391 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b41c8cd8-c999-444b-8126-30cd081a1c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:38.650149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026f994-2245-432a-84bf-60c361d15a6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:38.651608 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026f994-2245-432a-84bf-60c361d15a6c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:38.724913 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 491/961] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:38.724913 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c8cd8-c999-444b-8126-30cd081a1c98 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:38.760899 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 471/962] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:53:38 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:53:38.761848 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026f994-2245-432a-84bf-60c361d15a6c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:38.820847 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c8cd8-c999-444b-8126-30cd081a1c98 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:38.854779 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02ac38-8f91-42b5-b5cf-ce73892057a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:38.855870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026f994-2245-432a-84bf-60c361d15a6c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:38.856115 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02ac38-8f91-42b5-b5cf-ce73892057a5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:38.856645 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02ac38-8f91-42b5-b5cf-ce73892057a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:38.857145 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02ac38-8f91-42b5-b5cf-ce73892057a5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:38.858035 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02ac38-8f91-42b5-b5cf-ce73892057a5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:38.859481 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02ac38-8f91-42b5-b5cf-ce73892057a5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:38.871263 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-9a02ac38-8f91-42b5-b5cf-ce73892057a5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:53:38.872967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 492/963] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 27 04:53:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:38.873523 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02ac38-8f91-42b5-b5cf-ce73892057a5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:38.896242 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb5999-0afa-43b8-8cf1-24535d5854a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:38.897071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb5999-0afa-43b8-8cf1-24535d5854a4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:38.897351 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb5999-0afa-43b8-8cf1-24535d5854a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:38.897620 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb5999-0afa-43b8-8cf1-24535d5854a4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:38.898274 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb5999-0afa-43b8-8cf1-24535d5854a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:38.899624 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb5999-0afa-43b8-8cf1-24535d5854a4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:38.911868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-31eb5999-0afa-43b8-8cf1-24535d5854a4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 04:53:38.913073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 472/964] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:38.914144 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb5999-0afa-43b8-8cf1-24535d5854a4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:38.984146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02ac38-8f91-42b5-b5cf-ce73892057a5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:39.017081 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b4cb9-321c-4ae2-ade2-d4489fd1b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:39.017712 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb5999-0afa-43b8-8cf1-24535d5854a4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:39.017934 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b4cb9-321c-4ae2-ade2-d4489fd1b81b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:39.018140 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b4cb9-321c-4ae2-ade2-d4489fd1b81b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:39.018935 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b4cb9-321c-4ae2-ade2-d4489fd1b81b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:39.029273 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b4cb9-321c-4ae2-ade2-d4489fd1b81b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:39.030718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b4cb9-321c-4ae2-ade2-d4489fd1b81b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:39.047530 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-063b4cb9-321c-4ae2-ade2-d4489fd1b81b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:39.053434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 493/965] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:39.053434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b4cb9-321c-4ae2-ade2-d4489fd1b81b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:39.055900 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f7d73-6749-416a-87e9-0f01c0dcf352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:39.056571 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f7d73-6749-416a-87e9-0f01c0dcf352 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:39.056881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f7d73-6749-416a-87e9-0f01c0dcf352 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:39.057158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f7d73-6749-416a-87e9-0f01c0dcf352 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:39.057869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f7d73-6749-416a-87e9-0f01c0dcf352 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:39.058173 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f7d73-6749-416a-87e9-0f01c0dcf352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:39.059524 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f7d73-6749-416a-87e9-0f01c0dcf352 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:39.064306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 473/966] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 27 04:53:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:39.064306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f7d73-6749-416a-87e9-0f01c0dcf352 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:39.152584 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b4cb9-321c-4ae2-ade2-d4489fd1b81b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:39.164829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f7d73-6749-416a-87e9-0f01c0dcf352 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:39.185409 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0326225-52f5-409b-95bf-c31e0cc0a792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:39.186058 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0326225-52f5-409b-95bf-c31e0cc0a792 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:39.186341 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0326225-52f5-409b-95bf-c31e0cc0a792 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:39.186613 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0326225-52f5-409b-95bf-c31e0cc0a792 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:39.187314 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0326225-52f5-409b-95bf-c31e0cc0a792 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:39.187618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0326225-52f5-409b-95bf-c31e0cc0a792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:39.189009 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0326225-52f5-409b-95bf-c31e0cc0a792 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:39.198590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 494/967] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 27 04:53:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:39.198590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0326225-52f5-409b-95bf-c31e0cc0a792 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:39.202222 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f6990-0a25-46ef-afe0-35fce9c9ce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:39.202888 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f6990-0a25-46ef-afe0-35fce9c9ce11 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:39.203166 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f6990-0a25-46ef-afe0-35fce9c9ce11 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:39.203439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f6990-0a25-46ef-afe0-35fce9c9ce11 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:39.204160 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f6990-0a25-46ef-afe0-35fce9c9ce11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:39.204467 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f6990-0a25-46ef-afe0-35fce9c9ce11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:39.205872 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f6990-0a25-46ef-afe0-35fce9c9ce11 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:39.223777 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 474/968] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:39.223777 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f6990-0a25-46ef-afe0-35fce9c9ce11 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:39.300398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0326225-52f5-409b-95bf-c31e0cc0a792 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:39.323560 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f6990-0a25-46ef-afe0-35fce9c9ce11 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:39.334070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c61e74-ceea-4dfe-8afb-3e325e0607d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:39.334809 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c61e74-ceea-4dfe-8afb-3e325e0607d1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:39.335094 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c61e74-ceea-4dfe-8afb-3e325e0607d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:39.335372 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c61e74-ceea-4dfe-8afb-3e325e0607d1 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:39.336075 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c61e74-ceea-4dfe-8afb-3e325e0607d1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:39.336384 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c61e74-ceea-4dfe-8afb-3e325e0607d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:39.337788 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c61e74-ceea-4dfe-8afb-3e325e0607d1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:39.342723 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 495/969] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 27 04:53:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:39.348532 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c61e74-ceea-4dfe-8afb-3e325e0607d1 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:39.357300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa591cda-70b8-4f04-ae59-5c4586ecf8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:39.357968 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa591cda-70b8-4f04-ae59-5c4586ecf8bd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:39.358247 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa591cda-70b8-4f04-ae59-5c4586ecf8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:39.358519 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa591cda-70b8-4f04-ae59-5c4586ecf8bd None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:39.359222 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa591cda-70b8-4f04-ae59-5c4586ecf8bd None admin] RBAC: Adding query filter params (type=compute) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:39.359520 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa591cda-70b8-4f04-ae59-5c4586ecf8bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:39.360892 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa591cda-70b8-4f04-ae59-5c4586ecf8bd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:39.366926 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 475/970] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 27 04:53:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:39.366926 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa591cda-70b8-4f04-ae59-5c4586ecf8bd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:39.456942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c61e74-ceea-4dfe-8afb-3e325e0607d1 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:39.494469 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7c2fb-76a3-46ad-b205-0204c95bb85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:39.495788 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7c2fb-76a3-46ad-b205-0204c95bb85c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:39.496213 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7c2fb-76a3-46ad-b205-0204c95bb85c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:39.496629 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7c2fb-76a3-46ad-b205-0204c95bb85c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:39.498485 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa591cda-70b8-4f04-ae59-5c4586ecf8bd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:39.505722 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7c2fb-76a3-46ad-b205-0204c95bb85c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:39.507208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7c2fb-76a3-46ad-b205-0204c95bb85c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:39.527328 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-ccb7c2fb-76a3-46ad-b205-0204c95bb85c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:39.532979 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 496/971] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:39.535311 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7c2fb-76a3-46ad-b205-0204c95bb85c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:39.544656 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbc713-cb03-4b3c-9c61-55af34d54e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:39.545552 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbc713-cb03-4b3c-9c61-55af34d54e51 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:39.545834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbc713-cb03-4b3c-9c61-55af34d54e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:39.546105 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbc713-cb03-4b3c-9c61-55af34d54e51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:39.547505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbc713-cb03-4b3c-9c61-55af34d54e51 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:39.548934 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbc713-cb03-4b3c-9c61-55af34d54e51 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:39.577186 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 476/972] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 04:53:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:53:39.674174 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7c2fb-76a3-46ad-b205-0204c95bb85c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:39.722445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfa153-b6ac-4ec9-90d5-b946e155931b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:39.723414 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfa153-b6ac-4ec9-90d5-b946e155931b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:39.723693 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfa153-b6ac-4ec9-90d5-b946e155931b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:39.724020 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfa153-b6ac-4ec9-90d5-b946e155931b None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:39.725004 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfa153-b6ac-4ec9-90d5-b946e155931b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:39.725318 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfa153-b6ac-4ec9-90d5-b946e155931b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:39.726771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfa153-b6ac-4ec9-90d5-b946e155931b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:39.742353 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 497/973] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:39.748847 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbc713-cb03-4b3c-9c61-55af34d54e51 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:39.853849 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbc713-cb03-4b3c-9c61-55af34d54e51 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:39.887373 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea76377-1fb4-435e-9508-7500356e1a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:39.888080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76377-1fb4-435e-9508-7500356e1a92 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:39.888365 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76377-1fb4-435e-9508-7500356e1a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:39.888638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea76377-1fb4-435e-9508-7500356e1a92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:39.889490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea76377-1fb4-435e-9508-7500356e1a92 None admin] RBAC: Adding query filter params (role.id=66c1cde8141c4a1987bd171077d0ddf3, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=d27fb10124d24c8ea208a4d020274269) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:39.889798 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea76377-1fb4-435e-9508-7500356e1a92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:39.891244 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea76377-1fb4-435e-9508-7500356e1a92 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:39.897564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 477/974] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:53:39 2022] GET /identity/v3/role_assignments?user.id=d27fb10124d24c8ea208a4d020274269&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=66c1cde8141c4a1987bd171077d0ddf3 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:40.936738 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649e6eb-01d0-4e30-ad88-bbdab5fd8c32 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:40.937718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649e6eb-01d0-4e30-ad88-bbdab5fd8c32 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:40.937718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649e6eb-01d0-4e30-ad88-bbdab5fd8c32 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:40.939429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 498/975] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:40.944769 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afada9d7-6a6d-4ed5-ad48-44b4a4d85510 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:40.945624 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afada9d7-6a6d-4ed5-ad48-44b4a4d85510 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:40.946102 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afada9d7-6a6d-4ed5-ad48-44b4a4d85510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:40.963904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-afada9d7-6a6d-4ed5-ad48-44b4a4d85510 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:40.965405 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-afada9d7-6a6d-4ed5-ad48-44b4a4d85510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:41.052911 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 478/976] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:41.073414 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649e6eb-01d0-4e30-ad88-bbdab5fd8c32 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:41.179516 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649e6eb-01d0-4e30-ad88-bbdab5fd8c32 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:41.213641 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46903b-9dc1-4d00-8e61-3a01ca1dd598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:41.214631 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46903b-9dc1-4d00-8e61-3a01ca1dd598 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:41.215352 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46903b-9dc1-4d00-8e61-3a01ca1dd598 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:41.215821 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46903b-9dc1-4d00-8e61-3a01ca1dd598 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:41.216971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46903b-9dc1-4d00-8e61-3a01ca1dd598 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:41.218607 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46903b-9dc1-4d00-8e61-3a01ca1dd598 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:41.232982 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.sql.core [None req-ad46903b-9dc1-4d00-8e61-3a01ca1dd598 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 27 04:53:41.232982 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 27 04:53:41.232982 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [parameters: {'user_id': 'fa67220779614cfba2fc436d26256188', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 27 04:53:41.232982 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80022) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 27 04:53:41.240034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-ad46903b-9dc1-4d00-8e61-3a01ca1dd598 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 27 04:53:41.245375 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 499/977] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Sep 27 04:53:41 2022] POST /identity/v3/users => generated 160 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:41.248844 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afada9d7-6a6d-4ed5-ad48-44b4a4d85510 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:41.349190 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afada9d7-6a6d-4ed5-ad48-44b4a4d85510 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:41.383767 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3273e1-a25c-4725-89ad-7a21b1e26ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:41.384892 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3273e1-a25c-4725-89ad-7a21b1e26ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:41.385353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3273e1-a25c-4725-89ad-7a21b1e26ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:41.385830 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3273e1-a25c-4725-89ad-7a21b1e26ab8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:41.393253 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3273e1-a25c-4725-89ad-7a21b1e26ab8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:41.395089 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3273e1-a25c-4725-89ad-7a21b1e26ab8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:41.409678 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-2a3273e1-a25c-4725-89ad-7a21b1e26ab8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 27 04:53:41.415947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 479/978] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:53:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:41.417763 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46903b-9dc1-4d00-8e61-3a01ca1dd598 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:41.525460 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46903b-9dc1-4d00-8e61-3a01ca1dd598 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:41.562461 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd120c-56f7-4b37-82e1-4517d1adf6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:41.563449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd120c-56f7-4b37-82e1-4517d1adf6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:41.563908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd120c-56f7-4b37-82e1-4517d1adf6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:41.564391 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd120c-56f7-4b37-82e1-4517d1adf6c5 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:41.565940 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd120c-56f7-4b37-82e1-4517d1adf6c5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:41.566424 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd120c-56f7-4b37-82e1-4517d1adf6c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:41.568240 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd120c-56f7-4b37-82e1-4517d1adf6c5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:41.613127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 500/979] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Sep 27 04:53:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:41.861693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f007f-002b-4d87-82ed-f18f9ffd77e2 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:41.861941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f007f-002b-4d87-82ed-f18f9ffd77e2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:41.862489 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f007f-002b-4d87-82ed-f18f9ffd77e2 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:41.864485 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 480/980] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:41.869798 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed4728-04db-40ec-a77e-20098268216f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:41.870087 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed4728-04db-40ec-a77e-20098268216f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:41.870371 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed4728-04db-40ec-a77e-20098268216f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:41.888244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-50ed4728-04db-40ec-a77e-20098268216f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:41.889797 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-50ed4728-04db-40ec-a77e-20098268216f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:41.960624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 501/981] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:41.984109 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f007f-002b-4d87-82ed-f18f9ffd77e2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:42.059476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1186352-c85f-4f60-9146-a34ea3cf49fe None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:42.059794 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1186352-c85f-4f60-9146-a34ea3cf49fe None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:42.060036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1186352-c85f-4f60-9146-a34ea3cf49fe None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:42.061996 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 502/982] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:53:42.067455 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134604f1-b3ed-4604-94e3-2843d8f49683 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:42.067811 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134604f1-b3ed-4604-94e3-2843d8f49683 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:42.068098 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134604f1-b3ed-4604-94e3-2843d8f49683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:42.084618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-134604f1-b3ed-4604-94e3-2843d8f49683 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:42.085811 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-134604f1-b3ed-4604-94e3-2843d8f49683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:42.086647 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f007f-002b-4d87-82ed-f18f9ffd77e2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:42.126211 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114b8b0-b8cb-4edf-8d34-6aa02e31d3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:42.126885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114b8b0-b8cb-4edf-8d34-6aa02e31d3f8 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:42.127163 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114b8b0-b8cb-4edf-8d34-6aa02e31d3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:42.127435 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114b8b0-b8cb-4edf-8d34-6aa02e31d3f8 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:42.128564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114b8b0-b8cb-4edf-8d34-6aa02e31d3f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:42.130082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114b8b0-b8cb-4edf-8d34-6aa02e31d3f8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:42.146163 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 481/983] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 27 04:53:41 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:53:42.173202 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 503/984] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:53:42.187609 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114b8b0-b8cb-4edf-8d34-6aa02e31d3f8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:42.293293 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114b8b0-b8cb-4edf-8d34-6aa02e31d3f8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:42.309250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f26544-fdfd-4d8c-9416-8b09302f4707 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:42.309566 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f26544-fdfd-4d8c-9416-8b09302f4707 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:42.309826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f26544-fdfd-4d8c-9416-8b09302f4707 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:42.311807 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 504/985] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:53:42.317825 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7eee2-f2dc-47d8-914b-20c6ebf4c19e None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:42.318115 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7eee2-f2dc-47d8-914b-20c6ebf4c19e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:42.318396 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7eee2-f2dc-47d8-914b-20c6ebf4c19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:42.329821 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32565ffd-f442-4883-87e8-e53bf00634cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:42.330641 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32565ffd-f442-4883-87e8-e53bf00634cb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:42.331738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32565ffd-f442-4883-87e8-e53bf00634cb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:42.331738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32565ffd-f442-4883-87e8-e53bf00634cb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:42.332455 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32565ffd-f442-4883-87e8-e53bf00634cb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:42.334032 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32565ffd-f442-4883-87e8-e53bf00634cb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:42.336159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4aa7eee2-f2dc-47d8-914b-20c6ebf4c19e None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:42.337388 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4aa7eee2-f2dc-47d8-914b-20c6ebf4c19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:42.345597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-32565ffd-f442-4883-87e8-e53bf00634cb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:53:42.347882 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 482/986] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 27 04:53:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:42.353752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32565ffd-f442-4883-87e8-e53bf00634cb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:42.406900 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 505/987] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:53:42.430055 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7eee2-f2dc-47d8-914b-20c6ebf4c19e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:42.454889 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32565ffd-f442-4883-87e8-e53bf00634cb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:42.491003 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c2755-c7c0-47ad-90d0-7b2536a0933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:42.492042 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c2755-c7c0-47ad-90d0-7b2536a0933d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:42.492515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c2755-c7c0-47ad-90d0-7b2536a0933d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:42.493058 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c2755-c7c0-47ad-90d0-7b2536a0933d None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:42.493774 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c2755-c7c0-47ad-90d0-7b2536a0933d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:42.494083 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c2755-c7c0-47ad-90d0-7b2536a0933d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:42.495457 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c2755-c7c0-47ad-90d0-7b2536a0933d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:42.504100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 483/988] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 27 04:53:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:42.509688 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c2755-c7c0-47ad-90d0-7b2536a0933d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:42.526194 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7eee2-f2dc-47d8-914b-20c6ebf4c19e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:42.560085 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65a915-d2f1-4bba-b7d9-a983060a805f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:42.560901 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65a915-d2f1-4bba-b7d9-a983060a805f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:42.561182 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65a915-d2f1-4bba-b7d9-a983060a805f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:42.561457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65a915-d2f1-4bba-b7d9-a983060a805f None admin] PATH_INFO: `/v3/services/image` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:42.562108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65a915-d2f1-4bba-b7d9-a983060a805f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:42.563491 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65a915-d2f1-4bba-b7d9-a983060a805f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:42.574642 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-5d65a915-d2f1-4bba-b7d9-a983060a805f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 04:53:42.580609 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 506/989] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Sep 27 04:53:42 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:42.582732 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65a915-d2f1-4bba-b7d9-a983060a805f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:42.616339 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c2755-c7c0-47ad-90d0-7b2536a0933d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:42.649392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb3f95-3561-4c3b-a44f-0802a9b007fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:42.650058 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb3f95-3561-4c3b-a44f-0802a9b007fb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:42.650334 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb3f95-3561-4c3b-a44f-0802a9b007fb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:42.650633 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb3f95-3561-4c3b-a44f-0802a9b007fb None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:42.651308 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb3f95-3561-4c3b-a44f-0802a9b007fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:42.651617 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb3f95-3561-4c3b-a44f-0802a9b007fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:42.653020 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb3f95-3561-4c3b-a44f-0802a9b007fb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:42.657879 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 484/990] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 27 04:53:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:42.664342 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb3f95-3561-4c3b-a44f-0802a9b007fb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:42.681134 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65a915-d2f1-4bba-b7d9-a983060a805f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:42.721069 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cf69b-a566-4a6c-b70f-f626dd64b291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:42.722130 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cf69b-a566-4a6c-b70f-f626dd64b291 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:42.722433 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cf69b-a566-4a6c-b70f-f626dd64b291 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:42.722967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cf69b-a566-4a6c-b70f-f626dd64b291 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:42.723677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486cf69b-a566-4a6c-b70f-f626dd64b291 None admin] RBAC: Adding query filter params (name=image) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:42.724131 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486cf69b-a566-4a6c-b70f-f626dd64b291 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:42.726170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486cf69b-a566-4a6c-b70f-f626dd64b291 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:42.737656 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 507/991] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:42.738990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cf69b-a566-4a6c-b70f-f626dd64b291 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:42.761709 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb3f95-3561-4c3b-a44f-0802a9b007fb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:42.794072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccdb77-0256-4307-860d-1cf36f2d242c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:42.794727 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccdb77-0256-4307-860d-1cf36f2d242c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:42.795005 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccdb77-0256-4307-860d-1cf36f2d242c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:42.795279 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccdb77-0256-4307-860d-1cf36f2d242c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:42.796072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccdb77-0256-4307-860d-1cf36f2d242c None admin] RBAC: Adding query filter params (interface=admin, service_id=c96cbf07d329485699cb6f028f2c3856, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:42.796381 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccdb77-0256-4307-860d-1cf36f2d242c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:42.797783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccdb77-0256-4307-860d-1cf36f2d242c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:42.803236 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 485/992] 10.222.0.27 () {56 vars in 1249 bytes} [Tue Sep 27 04:53:42 2022] GET /identity/v3/endpoints?service_id=c96cbf07d329485699cb6f028f2c3856&interface=admin®ion_id=RegionOne => generated 193 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:42.808729 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccdb77-0256-4307-860d-1cf36f2d242c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:42.841704 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cf69b-a566-4a6c-b70f-f626dd64b291 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:42.873907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c06e0-5546-444e-aaf3-bf2cf784229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:42.874568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c06e0-5546-444e-aaf3-bf2cf784229f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:42.874850 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c06e0-5546-444e-aaf3-bf2cf784229f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:42.875122 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c06e0-5546-444e-aaf3-bf2cf784229f None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:42.875822 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c06e0-5546-444e-aaf3-bf2cf784229f None admin] RBAC: Adding query filter params (type=image) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:42.876128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c06e0-5546-444e-aaf3-bf2cf784229f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:42.877524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c06e0-5546-444e-aaf3-bf2cf784229f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:42.882802 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 508/993] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:42.910612 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccdb77-0256-4307-860d-1cf36f2d242c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:42.946517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2178f-f9f3-41cc-8f53-dccc10e4710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:42.947215 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2178f-f9f3-41cc-8f53-dccc10e4710d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:42.947499 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2178f-f9f3-41cc-8f53-dccc10e4710d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:42.947770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2178f-f9f3-41cc-8f53-dccc10e4710d None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:42.948470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2178f-f9f3-41cc-8f53-dccc10e4710d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:42.949925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2178f-f9f3-41cc-8f53-dccc10e4710d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:42.957532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 486/994] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 27 04:53:42 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:53:44.557495 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7df12-6815-4c09-8b69-4bd66df63765 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:44.558026 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7df12-6815-4c09-8b69-4bd66df63765 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:44.558026 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7df12-6815-4c09-8b69-4bd66df63765 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:44.559831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 509/995] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:44.566578 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd170c19-3ee7-40d7-846f-4e3c4785bd4f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:44.567073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd170c19-3ee7-40d7-846f-4e3c4785bd4f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:44.567073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd170c19-3ee7-40d7-846f-4e3c4785bd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:44.586167 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-bd170c19-3ee7-40d7-846f-4e3c4785bd4f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:44.587363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bd170c19-3ee7-40d7-846f-4e3c4785bd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:44.651737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 487/996] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:53:44.675234 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7df12-6815-4c09-8b69-4bd66df63765 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:44.775603 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7df12-6815-4c09-8b69-4bd66df63765 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:44.808784 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6753c30-026b-4019-8cef-eb4ff74766f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:44.809528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6753c30-026b-4019-8cef-eb4ff74766f6 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:44.809808 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6753c30-026b-4019-8cef-eb4ff74766f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:44.810082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6753c30-026b-4019-8cef-eb4ff74766f6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:44.810732 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6753c30-026b-4019-8cef-eb4ff74766f6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:44.812099 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6753c30-026b-4019-8cef-eb4ff74766f6 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:44.823168 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-f6753c30-026b-4019-8cef-eb4ff74766f6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 04:53:44.824512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 510/997] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:44.830427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd170c19-3ee7-40d7-846f-4e3c4785bd4f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:44.932720 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd170c19-3ee7-40d7-846f-4e3c4785bd4f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:44.975629 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dfa3c-e001-4a9b-92d8-f8d6f31cc09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:44.975629 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dfa3c-e001-4a9b-92d8-f8d6f31cc09b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:44.975629 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dfa3c-e001-4a9b-92d8-f8d6f31cc09b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:44.975629 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dfa3c-e001-4a9b-92d8-f8d6f31cc09b None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:44.976036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dfa3c-e001-4a9b-92d8-f8d6f31cc09b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:44.976036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dfa3c-e001-4a9b-92d8-f8d6f31cc09b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:44.978244 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dfa3c-e001-4a9b-92d8-f8d6f31cc09b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:44.988166 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 488/998] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 27 04:53:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:44.992641 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6753c30-026b-4019-8cef-eb4ff74766f6 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:45.091071 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6753c30-026b-4019-8cef-eb4ff74766f6 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:45.123729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f53d6-0f75-4ff0-af7a-40b04c4d10db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:45.124388 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f53d6-0f75-4ff0-af7a-40b04c4d10db None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:45.124671 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f53d6-0f75-4ff0-af7a-40b04c4d10db None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:45.124978 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f53d6-0f75-4ff0-af7a-40b04c4d10db None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:45.125681 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f53d6-0f75-4ff0-af7a-40b04c4d10db None admin] RBAC: Adding query filter params (type=compute) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:45.125985 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f53d6-0f75-4ff0-af7a-40b04c4d10db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:45.127349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f53d6-0f75-4ff0-af7a-40b04c4d10db None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:45.137633 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 511/999] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 27 04:53:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:45.138906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dfa3c-e001-4a9b-92d8-f8d6f31cc09b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:45.239780 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dfa3c-e001-4a9b-92d8-f8d6f31cc09b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:45.260438 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ebc3b-6529-4fea-9a3d-d3685ee8791c None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:45.260742 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ebc3b-6529-4fea-9a3d-d3685ee8791c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:45.261033 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ebc3b-6529-4fea-9a3d-d3685ee8791c None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:45.262813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 512/1000] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:53:45.267767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb58eb-99bd-4bc6-96a0-e920eb079adf None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:45.268057 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb58eb-99bd-4bc6-96a0-e920eb079adf None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:45.268360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb58eb-99bd-4bc6-96a0-e920eb079adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:45.276245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed171a98-618e-4684-923f-c7bbdbb12cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:45.276938 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed171a98-618e-4684-923f-c7bbdbb12cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:45.277220 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed171a98-618e-4684-923f-c7bbdbb12cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:45.277492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed171a98-618e-4684-923f-c7bbdbb12cf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:45.278277 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed171a98-618e-4684-923f-c7bbdbb12cf4 None admin] RBAC: Adding query filter params (interface=public, service_id=109f99f00de74e90b8dd22687c79cac2, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:45.278585 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed171a98-618e-4684-923f-c7bbdbb12cf4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:45.279949 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed171a98-618e-4684-923f-c7bbdbb12cf4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:45.289766 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 489/1001] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Sep 27 04:53:45 2022] GET /identity/v3/endpoints?service_id=109f99f00de74e90b8dd22687c79cac2&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:45.289912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-bdeb58eb-99bd-4bc6-96a0-e920eb079adf None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:45.289912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-bdeb58eb-99bd-4bc6-96a0-e920eb079adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:45.291260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed171a98-618e-4684-923f-c7bbdbb12cf4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:45.353395 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 513/1002] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:53:45.354618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca1689-3410-49dc-bc06-fb79c46a563a None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:45.354897 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca1689-3410-49dc-bc06-fb79c46a563a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:45.355170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca1689-3410-49dc-bc06-fb79c46a563a None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:45.356983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 514/1003] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:45.362128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63242304-94e9-4ee8-bfa8-fda1054f0160 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:45.362479 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63242304-94e9-4ee8-bfa8-fda1054f0160 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:45.363035 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63242304-94e9-4ee8-bfa8-fda1054f0160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:45.380203 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-63242304-94e9-4ee8-bfa8-fda1054f0160 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:45.381398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-63242304-94e9-4ee8-bfa8-fda1054f0160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:45.387427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed171a98-618e-4684-923f-c7bbdbb12cf4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:45.419903 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef759db-01f7-4d00-bdb5-e78d33ec7b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:45.420559 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef759db-01f7-4d00-bdb5-e78d33ec7b3f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:45.420864 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef759db-01f7-4d00-bdb5-e78d33ec7b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:45.421140 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef759db-01f7-4d00-bdb5-e78d33ec7b3f None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:45.421809 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef759db-01f7-4d00-bdb5-e78d33ec7b3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:45.423166 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef759db-01f7-4d00-bdb5-e78d33ec7b3f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:45.429816 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 490/1004] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 27 04:53:45 2022] GET /identity/v3/services => generated 1727 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 04:53:45.430564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef759db-01f7-4d00-bdb5-e78d33ec7b3f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:45.453032 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 515/1005] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:45.471473 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63242304-94e9-4ee8-bfa8-fda1054f0160 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:45.537725 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef759db-01f7-4d00-bdb5-e78d33ec7b3f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:45.572932 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80117821-c433-4aa3-8c08-a281d928adbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:45.574454 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80117821-c433-4aa3-8c08-a281d928adbc None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:45.574946 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80117821-c433-4aa3-8c08-a281d928adbc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:45.575231 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63242304-94e9-4ee8-bfa8-fda1054f0160 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:45.575855 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80117821-c433-4aa3-8c08-a281d928adbc None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:45.576763 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80117821-c433-4aa3-8c08-a281d928adbc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:45.578371 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80117821-c433-4aa3-8c08-a281d928adbc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:45.595370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 491/1006] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 27 04:53:45 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:53:45.621751 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edc86e-01b3-492e-9d0e-651c3b47f15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:45.622854 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edc86e-01b3-492e-9d0e-651c3b47f15c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:45.623131 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edc86e-01b3-492e-9d0e-651c3b47f15c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:45.623403 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edc86e-01b3-492e-9d0e-651c3b47f15c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:45.624070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edc86e-01b3-492e-9d0e-651c3b47f15c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:45.625558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edc86e-01b3-492e-9d0e-651c3b47f15c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:45.637754 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-b8edc86e-01b3-492e-9d0e-651c3b47f15c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 27 04:53:45.639345 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 516/1007] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Sep 27 04:53:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:45.646536 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80117821-c433-4aa3-8c08-a281d928adbc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:45.756339 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80117821-c433-4aa3-8c08-a281d928adbc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:45.794081 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55848f75-0a45-4ee2-9aaa-bb002fb1b4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:45.794756 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55848f75-0a45-4ee2-9aaa-bb002fb1b4ce None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:45.795041 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55848f75-0a45-4ee2-9aaa-bb002fb1b4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:45.795318 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55848f75-0a45-4ee2-9aaa-bb002fb1b4ce None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:45.796030 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55848f75-0a45-4ee2-9aaa-bb002fb1b4ce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:45.796338 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55848f75-0a45-4ee2-9aaa-bb002fb1b4ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:45.797764 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55848f75-0a45-4ee2-9aaa-bb002fb1b4ce None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:45.803512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 492/1008] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 27 04:53:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:45.809529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edc86e-01b3-492e-9d0e-651c3b47f15c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:45.910360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edc86e-01b3-492e-9d0e-651c3b47f15c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:45.942251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661d548-a61a-4644-81cd-0a83aa9d3802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:45.942907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661d548-a61a-4644-81cd-0a83aa9d3802 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:45.943186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661d548-a61a-4644-81cd-0a83aa9d3802 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:45.943458 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661d548-a61a-4644-81cd-0a83aa9d3802 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:45.944149 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661d548-a61a-4644-81cd-0a83aa9d3802 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:45.944458 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661d548-a61a-4644-81cd-0a83aa9d3802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:45.945848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661d548-a61a-4644-81cd-0a83aa9d3802 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:45.950662 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 517/1009] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Sep 27 04:53:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:45.957438 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55848f75-0a45-4ee2-9aaa-bb002fb1b4ce None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:46.061615 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55848f75-0a45-4ee2-9aaa-bb002fb1b4ce None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:46.093088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e294e-4e70-44ee-ac67-fcace5cf49c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:46.093735 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e294e-4e70-44ee-ac67-fcace5cf49c2 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:46.094012 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e294e-4e70-44ee-ac67-fcace5cf49c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:46.094306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e294e-4e70-44ee-ac67-fcace5cf49c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:46.095034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e294e-4e70-44ee-ac67-fcace5cf49c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:46.096392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e294e-4e70-44ee-ac67-fcace5cf49c2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:46.120880 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 493/1010] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 04:53:45 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:53:47.851959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9eb1e-eed3-4262-9588-ba1c635cb854 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:47.852512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9eb1e-eed3-4262-9588-ba1c635cb854 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:47.852512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9eb1e-eed3-4262-9588-ba1c635cb854 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:47.854369 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 518/1011] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:47.859540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c5da4-d399-4c5f-95cd-9ccee3802c0d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:47.859953 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c5da4-d399-4c5f-95cd-9ccee3802c0d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:47.860144 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c5da4-d399-4c5f-95cd-9ccee3802c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:47.877737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-262c5da4-d399-4c5f-95cd-9ccee3802c0d None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:47.879149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-262c5da4-d399-4c5f-95cd-9ccee3802c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:47.951022 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 494/1012] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:47 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:47.965555 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146a052-4d01-45e5-a14e-8804289b2d04 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:47.965846 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146a052-4d01-45e5-a14e-8804289b2d04 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:47.966122 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146a052-4d01-45e5-a14e-8804289b2d04 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:47.968024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 519/1013] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:47.973420 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c6c16-c4f3-4ce0-a611-a3f46fb7b333 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:47.973711 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c6c16-c4f3-4ce0-a611-a3f46fb7b333 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:47.973987 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c6c16-c4f3-4ce0-a611-a3f46fb7b333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:47.976094 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146a052-4d01-45e5-a14e-8804289b2d04 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:47.992358 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-603c6c16-c4f3-4ce0-a611-a3f46fb7b333 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:47.993443 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-603c6c16-c4f3-4ce0-a611-a3f46fb7b333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:48.066220 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 495/1014] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:47 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:48.084216 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146a052-4d01-45e5-a14e-8804289b2d04 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:48.090205 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c6c16-c4f3-4ce0-a611-a3f46fb7b333 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:48.124039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f75c2d-4d25-4765-8ece-d7fe5d39b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:48.124894 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f75c2d-4d25-4765-8ece-d7fe5d39b81b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:48.125170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f75c2d-4d25-4765-8ece-d7fe5d39b81b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:48.125452 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f75c2d-4d25-4765-8ece-d7fe5d39b81b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:48.126100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f75c2d-4d25-4765-8ece-d7fe5d39b81b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:48.127533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f75c2d-4d25-4765-8ece-d7fe5d39b81b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:48.138561 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-72f75c2d-4d25-4765-8ece-d7fe5d39b81b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 27 04:53:48.139785 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 520/1015] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:48.145891 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f75c2d-4d25-4765-8ece-d7fe5d39b81b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:48.201033 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c6c16-c4f3-4ce0-a611-a3f46fb7b333 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:48.240229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f662bef-e65f-4643-948c-bf0238ecffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:48.241053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f662bef-e65f-4643-948c-bf0238ecffe9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:48.241336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f662bef-e65f-4643-948c-bf0238ecffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:48.241617 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f662bef-e65f-4643-948c-bf0238ecffe9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:48.242279 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f662bef-e65f-4643-948c-bf0238ecffe9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:48.243654 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f662bef-e65f-4643-948c-bf0238ecffe9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:48.250305 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f75c2d-4d25-4765-8ece-d7fe5d39b81b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:48.254723 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-5f662bef-e65f-4643-948c-bf0238ecffe9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 04:53:48.255901 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 496/1016] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Sep 27 04:53:48 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:48.261611 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f662bef-e65f-4643-948c-bf0238ecffe9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:48.286128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf6477-0802-4123-a540-6b61b6287e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:48.286950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf6477-0802-4123-a540-6b61b6287e31 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:48.287563 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf6477-0802-4123-a540-6b61b6287e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:48.287848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf6477-0802-4123-a540-6b61b6287e31 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:48.288711 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf6477-0802-4123-a540-6b61b6287e31 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:48.289052 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf6477-0802-4123-a540-6b61b6287e31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:48.290420 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf6477-0802-4123-a540-6b61b6287e31 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:48.295882 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 521/1017] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 27 04:53:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:48.302012 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf6477-0802-4123-a540-6b61b6287e31 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:48.361512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f662bef-e65f-4643-948c-bf0238ecffe9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:48.395727 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7f079-f769-488b-b557-97d68e7db3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:48.396311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7f079-f769-488b-b557-97d68e7db3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:48.396588 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7f079-f769-488b-b557-97d68e7db3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:48.396886 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7f079-f769-488b-b557-97d68e7db3f8 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:48.397746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7f079-f769-488b-b557-97d68e7db3f8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:48.397853 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7f079-f769-488b-b557-97d68e7db3f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:48.399209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7f079-f769-488b-b557-97d68e7db3f8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:48.404035 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 497/1018] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:48.405717 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf6477-0802-4123-a540-6b61b6287e31 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:48.410597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7f079-f769-488b-b557-97d68e7db3f8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:48.441772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46798339-6db9-47eb-8a19-16bc01fdbf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:48.442496 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46798339-6db9-47eb-8a19-16bc01fdbf29 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:48.442782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46798339-6db9-47eb-8a19-16bc01fdbf29 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:48.443053 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46798339-6db9-47eb-8a19-16bc01fdbf29 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:48.443753 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46798339-6db9-47eb-8a19-16bc01fdbf29 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:48.444057 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46798339-6db9-47eb-8a19-16bc01fdbf29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:48.445456 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46798339-6db9-47eb-8a19-16bc01fdbf29 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:48.454848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 522/1019] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Sep 27 04:53:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:48.456594 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46798339-6db9-47eb-8a19-16bc01fdbf29 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:48.506771 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7f079-f769-488b-b557-97d68e7db3f8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:48.539448 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099d63b-5618-41f3-957e-5e09731f9e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:48.540111 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099d63b-5618-41f3-957e-5e09731f9e53 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:48.540391 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099d63b-5618-41f3-957e-5e09731f9e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:48.540667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099d63b-5618-41f3-957e-5e09731f9e53 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:48.541402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099d63b-5618-41f3-957e-5e09731f9e53 None admin] RBAC: Adding query filter params (type=image) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:48.541707 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099d63b-5618-41f3-957e-5e09731f9e53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:48.543064 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099d63b-5618-41f3-957e-5e09731f9e53 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:48.547662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 498/1020] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:48.548885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15cb3-621b-40c0-88a3-7e58f7186024 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:48.549151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15cb3-621b-40c0-88a3-7e58f7186024 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:48.549432 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15cb3-621b-40c0-88a3-7e58f7186024 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:48.551257 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 499/1021] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:48.551769 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46798339-6db9-47eb-8a19-16bc01fdbf29 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:48.553563 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf15cb3-621b-40c0-88a3-7e58f7186024 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:48.585540 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0779823-8c24-4805-a8da-3aea2860c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:48.586188 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0779823-8c24-4805-a8da-3aea2860c620 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:48.586471 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0779823-8c24-4805-a8da-3aea2860c620 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:48.586748 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0779823-8c24-4805-a8da-3aea2860c620 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:48.587481 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0779823-8c24-4805-a8da-3aea2860c620 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:48.588874 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0779823-8c24-4805-a8da-3aea2860c620 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:48.607166 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 523/1022] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 04:53:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:53:48.608387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bda713-807e-4856-aeb4-4d0c89f3099c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:48.608670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bda713-807e-4856-aeb4-4d0c89f3099c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:48.608984 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bda713-807e-4856-aeb4-4d0c89f3099c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:48.626829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b8bda713-807e-4856-aeb4-4d0c89f3099c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:48.628049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b8bda713-807e-4856-aeb4-4d0c89f3099c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:48.673265 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf15cb3-621b-40c0-88a3-7e58f7186024 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:48.702186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 524/1023] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:48.710359 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bde97-8580-4035-85de-a58699786287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:48.711037 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bde97-8580-4035-85de-a58699786287 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:48.711315 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bde97-8580-4035-85de-a58699786287 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:48.711591 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bde97-8580-4035-85de-a58699786287 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:48.712385 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bde97-8580-4035-85de-a58699786287 None admin] RBAC: Adding query filter params (interface=public, service_id=42433818a6fc48ad8bbe9e24517eee50, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:48.712696 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bde97-8580-4035-85de-a58699786287 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:48.714142 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bde97-8580-4035-85de-a58699786287 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:48.724517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 500/1024] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Sep 27 04:53:48 2022] GET /identity/v3/endpoints?service_id=42433818a6fc48ad8bbe9e24517eee50&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:48.726112 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bda713-807e-4856-aeb4-4d0c89f3099c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:48.727538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bde97-8580-4035-85de-a58699786287 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:48.833119 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bda713-807e-4856-aeb4-4d0c89f3099c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:48.836743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bde97-8580-4035-85de-a58699786287 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:48.871679 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ec04e-effb-4e22-9584-ecfb91e0771b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:48.872686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ec04e-effb-4e22-9584-ecfb91e0771b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:48.873349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ec04e-effb-4e22-9584-ecfb91e0771b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:48.873349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ec04e-effb-4e22-9584-ecfb91e0771b None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:48.873744 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b18d63-d5ec-4946-8a6a-db8bee3af1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:48.874144 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ec04e-effb-4e22-9584-ecfb91e0771b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:48.874544 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b18d63-d5ec-4946-8a6a-db8bee3af1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:48.874822 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b18d63-d5ec-4946-8a6a-db8bee3af1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:48.875097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b18d63-d5ec-4946-8a6a-db8bee3af1a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:48.875378 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ec04e-effb-4e22-9584-ecfb91e0771b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:48.876265 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b18d63-d5ec-4946-8a6a-db8bee3af1a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:48.878252 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b18d63-d5ec-4946-8a6a-db8bee3af1a4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:48.879933 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 501/1025] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:48.883230 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 525/1026] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 27 04:53:48 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:53:48.886552 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b18d63-d5ec-4946-8a6a-db8bee3af1a4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:49.003440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b18d63-d5ec-4946-8a6a-db8bee3af1a4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:49.039518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3095d-57ff-4132-a676-78234331ed86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:49.040204 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3095d-57ff-4132-a676-78234331ed86 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:49.040489 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3095d-57ff-4132-a676-78234331ed86 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:49.040769 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3095d-57ff-4132-a676-78234331ed86 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:49.041536 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3095d-57ff-4132-a676-78234331ed86 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:49.043007 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3095d-57ff-4132-a676-78234331ed86 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:49.072926 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 502/1027] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 27 04:53:48 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:53:51.096034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98782f35-4282-418c-b6ab-b2da58cad5d1 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:51.097452 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98782f35-4282-418c-b6ab-b2da58cad5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:51.097452 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98782f35-4282-418c-b6ab-b2da58cad5d1 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:51.099526 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 526/1028] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:51.105506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1077c-4d30-4d4e-a7aa-16259bd80283 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:51.106033 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1077c-4d30-4d4e-a7aa-16259bd80283 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:51.106033 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1077c-4d30-4d4e-a7aa-16259bd80283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:51.123802 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-18c1077c-4d30-4d4e-a7aa-16259bd80283 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:51.125011 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-18c1077c-4d30-4d4e-a7aa-16259bd80283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:51.191882 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 503/1029] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:51.215726 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98782f35-4282-418c-b6ab-b2da58cad5d1 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:51.274316 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7e278-bcfd-406c-a1e6-010e8dcd6973 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:51.274560 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7e278-bcfd-406c-a1e6-010e8dcd6973 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:51.274792 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7e278-bcfd-406c-a1e6-010e8dcd6973 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:51.280258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 504/1030] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:53:51.281859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d49d7-8dcf-41e6-88e3-96867891e2f9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:51.282147 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d49d7-8dcf-41e6-88e3-96867891e2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:51.282428 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d49d7-8dcf-41e6-88e3-96867891e2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:51.299347 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-718d49d7-8dcf-41e6-88e3-96867891e2f9 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:51.301327 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-718d49d7-8dcf-41e6-88e3-96867891e2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:51.318995 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98782f35-4282-418c-b6ab-b2da58cad5d1 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:51.352420 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43280b2-899f-4d74-967d-15d7f092f925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:51.353270 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43280b2-899f-4d74-967d-15d7f092f925 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:51.353558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43280b2-899f-4d74-967d-15d7f092f925 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:51.353830 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43280b2-899f-4d74-967d-15d7f092f925 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:51.364383 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43280b2-899f-4d74-967d-15d7f092f925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:51.367274 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 505/1031] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:53:51.373913 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-a43280b2-899f-4d74-967d-15d7f092f925 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:53:51.380299 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 527/1032] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Sep 27 04:53:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:51.381087 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d49d7-8dcf-41e6-88e3-96867891e2f9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:51.390604 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43280b2-899f-4d74-967d-15d7f092f925 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:51.476274 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d49d7-8dcf-41e6-88e3-96867891e2f9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:51.485731 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43280b2-899f-4d74-967d-15d7f092f925 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:51.509847 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081e998-1fb3-4a5d-b307-07c3d9e5892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:51.510515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081e998-1fb3-4a5d-b307-07c3d9e5892b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:51.511024 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081e998-1fb3-4a5d-b307-07c3d9e5892b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:51.511300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081e998-1fb3-4a5d-b307-07c3d9e5892b None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:51.512032 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081e998-1fb3-4a5d-b307-07c3d9e5892b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:51.512334 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081e998-1fb3-4a5d-b307-07c3d9e5892b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:51.513735 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081e998-1fb3-4a5d-b307-07c3d9e5892b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:51.518546 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7aabc-a6c6-4199-adc1-8bdd4a86f582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:51.519320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7aabc-a6c6-4199-adc1-8bdd4a86f582 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:51.519602 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7aabc-a6c6-4199-adc1-8bdd4a86f582 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:51.519878 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7aabc-a6c6-4199-adc1-8bdd4a86f582 None admin] PATH_INFO: `/v3/services/image` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:51.520537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7aabc-a6c6-4199-adc1-8bdd4a86f582 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:51.521673 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 506/1033] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Sep 27 04:53:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:51.521926 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7aabc-a6c6-4199-adc1-8bdd4a86f582 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:51.522878 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229022f-3c6c-4014-8a5d-7f434603f23f None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:51.523292 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229022f-3c6c-4014-8a5d-7f434603f23f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:51.523571 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229022f-3c6c-4014-8a5d-7f434603f23f None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:51.525417 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 507/1034] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:51.527226 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229022f-3c6c-4014-8a5d-7f434603f23f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:51.533550 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-bdd7aabc-a6c6-4199-adc1-8bdd4a86f582 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 27 04:53:51.534848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 528/1035] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Sep 27 04:53:51 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:51.536852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5050f2-5375-4b4a-9370-19c6fdaa9354 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:51.537940 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5050f2-5375-4b4a-9370-19c6fdaa9354 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:51.538224 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5050f2-5375-4b4a-9370-19c6fdaa9354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:51.555108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1e5050f2-5375-4b4a-9370-19c6fdaa9354 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:51.556270 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1e5050f2-5375-4b4a-9370-19c6fdaa9354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:51.621056 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 529/1036] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:51.622494 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5050f2-5375-4b4a-9370-19c6fdaa9354 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:51.625617 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229022f-3c6c-4014-8a5d-7f434603f23f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:51.658463 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c7093-2ec7-4281-ab98-bf60b516471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:51.660028 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c7093-2ec7-4281-ab98-bf60b516471c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:51.660379 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c7093-2ec7-4281-ab98-bf60b516471c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:51.660740 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c7093-2ec7-4281-ab98-bf60b516471c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:51.671017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c7093-2ec7-4281-ab98-bf60b516471c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:51.672458 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c7093-2ec7-4281-ab98-bf60b516471c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:51.688409 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-271c7093-2ec7-4281-ab98-bf60b516471c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:51.689613 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 508/1037] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:51.690411 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c7093-2ec7-4281-ab98-bf60b516471c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:51.717586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5050f2-5375-4b4a-9370-19c6fdaa9354 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:51.750225 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57900140-4838-45eb-a018-86223457497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:51.750872 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57900140-4838-45eb-a018-86223457497d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:51.751150 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57900140-4838-45eb-a018-86223457497d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:51.751424 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57900140-4838-45eb-a018-86223457497d None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:51.752119 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57900140-4838-45eb-a018-86223457497d None admin] RBAC: Adding query filter params (name=image) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:51.752421 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57900140-4838-45eb-a018-86223457497d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:51.754596 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57900140-4838-45eb-a018-86223457497d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:51.759263 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 530/1038] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:51.760025 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57900140-4838-45eb-a018-86223457497d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:51.784182 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c7093-2ec7-4281-ab98-bf60b516471c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:51.816502 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50b1cd-ddca-4793-b0c6-d96a1214b89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:51.817314 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50b1cd-ddca-4793-b0c6-d96a1214b89e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:51.817592 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50b1cd-ddca-4793-b0c6-d96a1214b89e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:51.817863 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50b1cd-ddca-4793-b0c6-d96a1214b89e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:51.819026 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50b1cd-ddca-4793-b0c6-d96a1214b89e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:51.820466 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50b1cd-ddca-4793-b0c6-d96a1214b89e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:51.822101 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 509/1039] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:51.822842 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50b1cd-ddca-4793-b0c6-d96a1214b89e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:51.854937 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57900140-4838-45eb-a018-86223457497d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:51.887708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c76c2f-537b-47f0-a233-15848b0aa6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:51.888360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c76c2f-537b-47f0-a233-15848b0aa6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:51.888646 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c76c2f-537b-47f0-a233-15848b0aa6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:51.888960 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c76c2f-537b-47f0-a233-15848b0aa6b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:51.889681 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c76c2f-537b-47f0-a233-15848b0aa6b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:51.889985 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c76c2f-537b-47f0-a233-15848b0aa6b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:51.891350 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c76c2f-537b-47f0-a233-15848b0aa6b5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:51.902369 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 531/1040] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:51.903130 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c76c2f-537b-47f0-a233-15848b0aa6b5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:51.917002 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50b1cd-ddca-4793-b0c6-d96a1214b89e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:51.949627 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa9506-6ac0-4ad9-bdc4-a3c888310ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:51.950288 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa9506-6ac0-4ad9-bdc4-a3c888310ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:51.950567 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa9506-6ac0-4ad9-bdc4-a3c888310ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:51.950840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa9506-6ac0-4ad9-bdc4-a3c888310ae6 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:51.951538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa9506-6ac0-4ad9-bdc4-a3c888310ae6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:51.951843 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa9506-6ac0-4ad9-bdc4-a3c888310ae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:51.953309 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa9506-6ac0-4ad9-bdc4-a3c888310ae6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:51.958113 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 510/1041] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:51.958883 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa9506-6ac0-4ad9-bdc4-a3c888310ae6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:52.000064 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c76c2f-537b-47f0-a233-15848b0aa6b5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:52.032095 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90781e-549c-48dc-9ac4-d37e1b875709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:52.032751 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90781e-549c-48dc-9ac4-d37e1b875709 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:52.033061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90781e-549c-48dc-9ac4-d37e1b875709 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:52.033402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90781e-549c-48dc-9ac4-d37e1b875709 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:52.034871 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90781e-549c-48dc-9ac4-d37e1b875709 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:52.036484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90781e-549c-48dc-9ac4-d37e1b875709 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:52.056059 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 532/1042] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:53:51 2022] POST /identity/v3/users => generated 285 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:53:52.057065 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90781e-549c-48dc-9ac4-d37e1b875709 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:52.059152 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa9506-6ac0-4ad9-bdc4-a3c888310ae6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:52.094977 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0eb90b-a2b0-437d-8956-8e35c579b55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:52.095787 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0eb90b-a2b0-437d-8956-8e35c579b55c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:52.096073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0eb90b-a2b0-437d-8956-8e35c579b55c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:52.096346 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0eb90b-a2b0-437d-8956-8e35c579b55c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:52.105141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0eb90b-a2b0-437d-8956-8e35c579b55c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:52.106616 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0eb90b-a2b0-437d-8956-8e35c579b55c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:52.122362 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-7f0eb90b-a2b0-437d-8956-8e35c579b55c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:53:52.128825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 511/1043] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 27 04:53:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:52.129829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0eb90b-a2b0-437d-8956-8e35c579b55c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:52.178778 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90781e-549c-48dc-9ac4-d37e1b875709 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:52.216188 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825dcfc-4010-4c32-8f3a-f8cfdcba7dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:52.217333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825dcfc-4010-4c32-8f3a-f8cfdcba7dcb None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:52.217664 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825dcfc-4010-4c32-8f3a-f8cfdcba7dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:52.217942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825dcfc-4010-4c32-8f3a-f8cfdcba7dcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:52.218696 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825dcfc-4010-4c32-8f3a-f8cfdcba7dcb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:52.220127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825dcfc-4010-4c32-8f3a-f8cfdcba7dcb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:52.237599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0eb90b-a2b0-437d-8956-8e35c579b55c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:52.241000 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 533/1044] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 04:53:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:53:52.283846 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b0091-0495-43f0-ac8f-d20d590a6c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:52.285202 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b0091-0495-43f0-ac8f-d20d590a6c97 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:52.285419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b0091-0495-43f0-ac8f-d20d590a6c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:52.286144 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b0091-0495-43f0-ac8f-d20d590a6c97 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:52.286762 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b0091-0495-43f0-ac8f-d20d590a6c97 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:52.286875 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b0091-0495-43f0-ac8f-d20d590a6c97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:52.288273 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b0091-0495-43f0-ac8f-d20d590a6c97 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:52.308157 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 512/1045] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 27 04:53:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:52.314108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825dcfc-4010-4c32-8f3a-f8cfdcba7dcb None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:52.427008 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825dcfc-4010-4c32-8f3a-f8cfdcba7dcb None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:52.461008 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecad50-0094-47f9-9920-96b5896dbcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:52.461725 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecad50-0094-47f9-9920-96b5896dbcb5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:52.461938 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecad50-0094-47f9-9920-96b5896dbcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:52.462213 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecad50-0094-47f9-9920-96b5896dbcb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:52.529219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecad50-0094-47f9-9920-96b5896dbcb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:52.530682 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecad50-0094-47f9-9920-96b5896dbcb5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:52.631443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 534/1046] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:53:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:53:52.637459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b0091-0495-43f0-ac8f-d20d590a6c97 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:52.732915 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b0091-0495-43f0-ac8f-d20d590a6c97 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:52.765385 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82873bd8-7890-4a66-bf08-6ee97a935278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:52.766174 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82873bd8-7890-4a66-bf08-6ee97a935278 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:52.766457 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82873bd8-7890-4a66-bf08-6ee97a935278 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:52.766734 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82873bd8-7890-4a66-bf08-6ee97a935278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:52.776425 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82873bd8-7890-4a66-bf08-6ee97a935278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:52.777904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82873bd8-7890-4a66-bf08-6ee97a935278 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:52.797170 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-82873bd8-7890-4a66-bf08-6ee97a935278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:52.803799 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 513/1047] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:52.804741 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecad50-0094-47f9-9920-96b5896dbcb5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:52.899574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecad50-0094-47f9-9920-96b5896dbcb5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:52.932156 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5587fe-34f2-41e3-810d-00ec7d13edc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:52.932829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5587fe-34f2-41e3-810d-00ec7d13edc6 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:52.933116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5587fe-34f2-41e3-810d-00ec7d13edc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:52.933468 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5587fe-34f2-41e3-810d-00ec7d13edc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:52.934099 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5587fe-34f2-41e3-810d-00ec7d13edc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:52.934401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5587fe-34f2-41e3-810d-00ec7d13edc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:52.935759 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5587fe-34f2-41e3-810d-00ec7d13edc6 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:52.951485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 535/1048] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:52.952753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82873bd8-7890-4a66-bf08-6ee97a935278 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:53.058381 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82873bd8-7890-4a66-bf08-6ee97a935278 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:53.091881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2152a-d8f8-4614-bc4c-93cefaf9a14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:53.093066 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2152a-d8f8-4614-bc4c-93cefaf9a14d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:53.093584 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2152a-d8f8-4614-bc4c-93cefaf9a14d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:53.094067 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2152a-d8f8-4614-bc4c-93cefaf9a14d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:53.101852 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2152a-d8f8-4614-bc4c-93cefaf9a14d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:53.103554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2152a-d8f8-4614-bc4c-93cefaf9a14d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:53.116586 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-e4e2152a-d8f8-4614-bc4c-93cefaf9a14d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:53.123382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 514/1049] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:53.124510 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5587fe-34f2-41e3-810d-00ec7d13edc6 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:53.222888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5587fe-34f2-41e3-810d-00ec7d13edc6 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:53.255127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973b3d4-3f93-4557-b7a7-c3b752765038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:53.255786 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973b3d4-3f93-4557-b7a7-c3b752765038 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:53.256066 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973b3d4-3f93-4557-b7a7-c3b752765038 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:53.256337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973b3d4-3f93-4557-b7a7-c3b752765038 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:53.257156 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973b3d4-3f93-4557-b7a7-c3b752765038 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:53.257464 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973b3d4-3f93-4557-b7a7-c3b752765038 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:53.258890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973b3d4-3f93-4557-b7a7-c3b752765038 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:53.277159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 536/1050] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:53.278649 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2152a-d8f8-4614-bc4c-93cefaf9a14d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:53.378840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2152a-d8f8-4614-bc4c-93cefaf9a14d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:53.411188 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa9bfe-b752-4abf-ad1e-d81d27153e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:53.411850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa9bfe-b752-4abf-ad1e-d81d27153e45 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:53.412127 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa9bfe-b752-4abf-ad1e-d81d27153e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:53.412400 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa9bfe-b752-4abf-ad1e-d81d27153e45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:53.413246 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa9bfe-b752-4abf-ad1e-d81d27153e45 None admin] RBAC: Adding query filter params (role.id=66c1cde8141c4a1987bd171077d0ddf3, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=faac84ed9d37420c811bbf6ac7df0b35) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:53.413558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa9bfe-b752-4abf-ad1e-d81d27153e45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:53.414990 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa9bfe-b752-4abf-ad1e-d81d27153e45 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:53.429093 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 515/1051] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:53:53 2022] GET /identity/v3/role_assignments?user.id=faac84ed9d37420c811bbf6ac7df0b35&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=66c1cde8141c4a1987bd171077d0ddf3 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:54.497749 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2346cc7-5aa1-4019-9a69-ad6d10c583a2 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:54.498284 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2346cc7-5aa1-4019-9a69-ad6d10c583a2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:54.498284 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2346cc7-5aa1-4019-9a69-ad6d10c583a2 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:54.500226 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 537/1052] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:54.506084 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253b0fc-e3a2-4607-bf23-4107d13769a2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:54.506495 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253b0fc-e3a2-4607-bf23-4107d13769a2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:54.506669 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253b0fc-e3a2-4607-bf23-4107d13769a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:54.524008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6253b0fc-e3a2-4607-bf23-4107d13769a2 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:54.525215 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6253b0fc-e3a2-4607-bf23-4107d13769a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:54.594037 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 516/1053] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:54.617921 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2346cc7-5aa1-4019-9a69-ad6d10c583a2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:54.641034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d9410-3599-4d02-8957-8b5cc6a807a5 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:54.641361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d9410-3599-4d02-8957-8b5cc6a807a5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:54.641617 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d9410-3599-4d02-8957-8b5cc6a807a5 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:54.643615 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 517/1054] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:53:54.648502 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7955a60-ceeb-4bc8-b114-efc08a07b1de None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:54.648808 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7955a60-ceeb-4bc8-b114-efc08a07b1de None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:54.649089 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7955a60-ceeb-4bc8-b114-efc08a07b1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:54.665507 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f7955a60-ceeb-4bc8-b114-efc08a07b1de None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:54.666697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f7955a60-ceeb-4bc8-b114-efc08a07b1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:54.717682 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2346cc7-5aa1-4019-9a69-ad6d10c583a2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:54.732876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 518/1055] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:53:54.750564 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb3765-0eb1-4141-b327-a3a13b077b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:54.751292 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb3765-0eb1-4141-b327-a3a13b077b21 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:54.751571 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb3765-0eb1-4141-b327-a3a13b077b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:54.751846 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb3765-0eb1-4141-b327-a3a13b077b21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:54.755547 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7955a60-ceeb-4bc8-b114-efc08a07b1de None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:54.762304 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb3765-0eb1-4141-b327-a3a13b077b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:54.770167 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-31bb3765-0eb1-4141-b327-a3a13b077b21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:53:54.776367 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 538/1056] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:53:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:54.777207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb3765-0eb1-4141-b327-a3a13b077b21 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:54.849640 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7955a60-ceeb-4bc8-b114-efc08a07b1de None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:54.873494 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb3765-0eb1-4141-b327-a3a13b077b21 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:54.882758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f6633-f844-4e5e-9be3-3b947ef0d074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:54.883413 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f6633-f844-4e5e-9be3-3b947ef0d074 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:54.883687 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f6633-f844-4e5e-9be3-3b947ef0d074 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:54.883960 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f6633-f844-4e5e-9be3-3b947ef0d074 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:54.907249 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54386d6-bb12-45c9-8450-560c780a58f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:54.907890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54386d6-bb12-45c9-8450-560c780a58f8 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:54.908172 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54386d6-bb12-45c9-8450-560c780a58f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:54.908447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54386d6-bb12-45c9-8450-560c780a58f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:54.909786 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54386d6-bb12-45c9-8450-560c780a58f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:54.910075 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54386d6-bb12-45c9-8450-560c780a58f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:54.911443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54386d6-bb12-45c9-8450-560c780a58f8 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:54.924382 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 539/1057] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:53:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:54.925623 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54386d6-bb12-45c9-8450-560c780a58f8 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:54.950352 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f6633-f844-4e5e-9be3-3b947ef0d074 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:54.951822 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f6633-f844-4e5e-9be3-3b947ef0d074 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:55.031573 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54386d6-bb12-45c9-8450-560c780a58f8 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:55.051319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 519/1058] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:53:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:53:55.057401 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f6633-f844-4e5e-9be3-3b947ef0d074 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:55.064301 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff74bd2-576d-4eef-9992-62799bfb2206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:55.065791 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff74bd2-576d-4eef-9992-62799bfb2206 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:55.066073 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff74bd2-576d-4eef-9992-62799bfb2206 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:55.066347 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff74bd2-576d-4eef-9992-62799bfb2206 None admin] PATH_INFO: `/v3/users/02a90d6c9a6b47f18ff75a9745d7ab9a` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:55.079610 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff74bd2-576d-4eef-9992-62799bfb2206 None admin] RBAC: Authorizing `identity:get_user(user_id=02a90d6c9a6b47f18ff75a9745d7ab9a)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:55.081221 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff74bd2-576d-4eef-9992-62799bfb2206 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:55.083406 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 540/1059] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:53:54 2022] GET /identity/v3/users/02a90d6c9a6b47f18ff75a9745d7ab9a => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:55.088536 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff74bd2-576d-4eef-9992-62799bfb2206 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:55.155186 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f6633-f844-4e5e-9be3-3b947ef0d074 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:55.186024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff74bd2-576d-4eef-9992-62799bfb2206 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:55.189702 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7040b-ada0-49d0-831c-8b2ae0ee3791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:55.190654 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7040b-ada0-49d0-831c-8b2ae0ee3791 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:55.190990 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7040b-ada0-49d0-831c-8b2ae0ee3791 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:55.191305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7040b-ada0-49d0-831c-8b2ae0ee3791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:55.201438 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7040b-ada0-49d0-831c-8b2ae0ee3791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:55.202887 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7040b-ada0-49d0-831c-8b2ae0ee3791 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:55.219736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0374c-72ec-4a07-9da6-63d74d63171d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:55.220382 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0374c-72ec-4a07-9da6-63d74d63171d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:55.220664 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0374c-72ec-4a07-9da6-63d74d63171d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:55.220975 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0374c-72ec-4a07-9da6-63d74d63171d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:55.222502 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-6cf7040b-ada0-49d0-831c-8b2ae0ee3791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:55.228454 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 520/1060] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:55.229504 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7040b-ada0-49d0-831c-8b2ae0ee3791 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:55.290494 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0374c-72ec-4a07-9da6-63d74d63171d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:55.291878 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0374c-72ec-4a07-9da6-63d74d63171d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:55.333306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7040b-ada0-49d0-831c-8b2ae0ee3791 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:55.366339 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cde959-2ee1-4b01-8a84-4b35062d5f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:55.367003 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cde959-2ee1-4b01-8a84-4b35062d5f11 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:55.367279 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cde959-2ee1-4b01-8a84-4b35062d5f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:55.367553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cde959-2ee1-4b01-8a84-4b35062d5f11 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:55.368270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cde959-2ee1-4b01-8a84-4b35062d5f11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:55.368572 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cde959-2ee1-4b01-8a84-4b35062d5f11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:55.369988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cde959-2ee1-4b01-8a84-4b35062d5f11 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:55.382270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 521/1061] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:53:55.407042 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 541/1062] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:53:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:53:55.413919 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cde959-2ee1-4b01-8a84-4b35062d5f11 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:55.517219 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cde959-2ee1-4b01-8a84-4b35062d5f11 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:55.553146 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdcb1c-3aa7-4bf9-8323-e2c46ad1ab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:55.553946 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdcb1c-3aa7-4bf9-8323-e2c46ad1ab46 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:55.554229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdcb1c-3aa7-4bf9-8323-e2c46ad1ab46 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:55.554507 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdcb1c-3aa7-4bf9-8323-e2c46ad1ab46 None admin] PATH_INFO: `/v3/projects/542280f1c71b45ba8a5d0c0950b58da8` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:55.555719 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdcb1c-3aa7-4bf9-8323-e2c46ad1ab46 None admin] RBAC: Authorizing `identity:get_project(project_id=542280f1c71b45ba8a5d0c0950b58da8)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:55.557193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdcb1c-3aa7-4bf9-8323-e2c46ad1ab46 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:55.559319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 522/1063] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:53:55 2022] GET /identity/v3/projects/542280f1c71b45ba8a5d0c0950b58da8 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:55.565748 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0374c-72ec-4a07-9da6-63d74d63171d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:55.665427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0374c-72ec-4a07-9da6-63d74d63171d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:55.702090 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99820b-da25-47c3-9ff7-8fc7003bd3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:55.702458 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99820b-da25-47c3-9ff7-8fc7003bd3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:55.702729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99820b-da25-47c3-9ff7-8fc7003bd3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:55.703000 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99820b-da25-47c3-9ff7-8fc7003bd3a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:55.703826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99820b-da25-47c3-9ff7-8fc7003bd3a4 None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=542280f1c71b45ba8a5d0c0950b58da8, user.id=02a90d6c9a6b47f18ff75a9745d7ab9a) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:55.704134 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99820b-da25-47c3-9ff7-8fc7003bd3a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:55.707431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99820b-da25-47c3-9ff7-8fc7003bd3a4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:55.711274 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 542/1064] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:53:55 2022] GET /identity/v3/role_assignments?user.id=02a90d6c9a6b47f18ff75a9745d7ab9a&scope.project.id=542280f1c71b45ba8a5d0c0950b58da8&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:55.767759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2949f-d02c-4eac-8e19-664f2f0d1a71 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:55.768153 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2949f-d02c-4eac-8e19-664f2f0d1a71 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:55.769048 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2949f-d02c-4eac-8e19-664f2f0d1a71 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:55.771016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 523/1065] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:55.777182 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f7242-8ec7-41d4-b85e-990953e6c985 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:55.777473 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f7242-8ec7-41d4-b85e-990953e6c985 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:55.777753 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f7242-8ec7-41d4-b85e-990953e6c985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:55.795907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-803f7242-8ec7-41d4-b85e-990953e6c985 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:55.797186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-803f7242-8ec7-41d4-b85e-990953e6c985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:55.867459 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 543/1066] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:55.891043 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2949f-d02c-4eac-8e19-664f2f0d1a71 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:55.992451 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2949f-d02c-4eac-8e19-664f2f0d1a71 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:56.025966 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565bce8-8491-4276-9ade-9f07fdf24806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:56.026767 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565bce8-8491-4276-9ade-9f07fdf24806 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:56.027042 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565bce8-8491-4276-9ade-9f07fdf24806 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:56.027309 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565bce8-8491-4276-9ade-9f07fdf24806 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:56.038287 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565bce8-8491-4276-9ade-9f07fdf24806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:56.045496 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-a565bce8-8491-4276-9ade-9f07fdf24806 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:53:56.046825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 524/1067] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Sep 27 04:53:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:56.052966 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f7242-8ec7-41d4-b85e-990953e6c985 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:56.145258 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f7242-8ec7-41d4-b85e-990953e6c985 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:56.176840 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7ffea-2a0d-49da-a512-6e8b567230b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:56.177492 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7ffea-2a0d-49da-a512-6e8b567230b4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:56.177765 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7ffea-2a0d-49da-a512-6e8b567230b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:56.178030 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7ffea-2a0d-49da-a512-6e8b567230b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:56.178758 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7ffea-2a0d-49da-a512-6e8b567230b4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:56.179053 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7ffea-2a0d-49da-a512-6e8b567230b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:56.180402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7ffea-2a0d-49da-a512-6e8b567230b4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:56.187876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 544/1068] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Sep 27 04:53:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:56.193711 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565bce8-8491-4276-9ade-9f07fdf24806 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:56.290878 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565bce8-8491-4276-9ade-9f07fdf24806 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:56.323139 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5336cf-7b59-4e4b-8fa5-d339008f0031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:56.323921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5336cf-7b59-4e4b-8fa5-d339008f0031 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:56.324195 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5336cf-7b59-4e4b-8fa5-d339008f0031 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:56.324465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5336cf-7b59-4e4b-8fa5-d339008f0031 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:56.335005 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5336cf-7b59-4e4b-8fa5-d339008f0031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:56.336435 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5336cf-7b59-4e4b-8fa5-d339008f0031 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:56.352674 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-bf5336cf-7b59-4e4b-8fa5-d339008f0031 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:56.353869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 525/1069] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:56.359705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7ffea-2a0d-49da-a512-6e8b567230b4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:56.456751 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7ffea-2a0d-49da-a512-6e8b567230b4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:56.490879 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f95344-7755-4877-b094-3145b6813b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:56.491542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f95344-7755-4877-b094-3145b6813b2e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:56.491825 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f95344-7755-4877-b094-3145b6813b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:56.492104 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f95344-7755-4877-b094-3145b6813b2e None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:56.492849 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f95344-7755-4877-b094-3145b6813b2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:56.493164 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f95344-7755-4877-b094-3145b6813b2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:56.494544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f95344-7755-4877-b094-3145b6813b2e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:56.507133 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 545/1070] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:56.512710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5336cf-7b59-4e4b-8fa5-d339008f0031 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:56.611260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5336cf-7b59-4e4b-8fa5-d339008f0031 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:56.643609 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5e0ea-2dd8-4691-9ee8-8fb567200f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:56.644384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5e0ea-2dd8-4691-9ee8-8fb567200f2e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:56.644658 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5e0ea-2dd8-4691-9ee8-8fb567200f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:56.644956 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5e0ea-2dd8-4691-9ee8-8fb567200f2e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:56.651994 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5e0ea-2dd8-4691-9ee8-8fb567200f2e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:56.653469 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5e0ea-2dd8-4691-9ee8-8fb567200f2e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:56.666698 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-83e5e0ea-2dd8-4691-9ee8-8fb567200f2e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:53:56.667857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 526/1071] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 27 04:53:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:56.673737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f95344-7755-4877-b094-3145b6813b2e None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:56.770054 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f95344-7755-4877-b094-3145b6813b2e None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:56.802751 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c1581-ae25-4d45-9d5d-640b94e6c68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:56.803418 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c1581-ae25-4d45-9d5d-640b94e6c68c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:56.803700 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c1581-ae25-4d45-9d5d-640b94e6c68c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:56.803976 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c1581-ae25-4d45-9d5d-640b94e6c68c None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:56.804817 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c1581-ae25-4d45-9d5d-640b94e6c68c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:56.805134 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c1581-ae25-4d45-9d5d-640b94e6c68c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:56.806569 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c1581-ae25-4d45-9d5d-640b94e6c68c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:56.824860 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 546/1072] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 27 04:53:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:56.831391 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5e0ea-2dd8-4691-9ee8-8fb567200f2e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:56.924343 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5e0ea-2dd8-4691-9ee8-8fb567200f2e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:56.956434 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cba5c6-8f9e-4956-aba5-d7a350cb3d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:56.957259 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cba5c6-8f9e-4956-aba5-d7a350cb3d62 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:56.957538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cba5c6-8f9e-4956-aba5-d7a350cb3d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:56.957812 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cba5c6-8f9e-4956-aba5-d7a350cb3d62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:56.967697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cba5c6-8f9e-4956-aba5-d7a350cb3d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:56.969178 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cba5c6-8f9e-4956-aba5-d7a350cb3d62 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:56.985796 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-40cba5c6-8f9e-4956-aba5-d7a350cb3d62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:53:56.987308 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 527/1073] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:56.992885 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c1581-ae25-4d45-9d5d-640b94e6c68c None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:57.086458 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c1581-ae25-4d45-9d5d-640b94e6c68c None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:57.117178 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4171236-96e3-4426-8ce1-72e93e2bd0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:57.117822 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4171236-96e3-4426-8ce1-72e93e2bd0ea None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:57.118095 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4171236-96e3-4426-8ce1-72e93e2bd0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:57.118360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4171236-96e3-4426-8ce1-72e93e2bd0ea None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:57.119052 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4171236-96e3-4426-8ce1-72e93e2bd0ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:57.119349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4171236-96e3-4426-8ce1-72e93e2bd0ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:57.120708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4171236-96e3-4426-8ce1-72e93e2bd0ea None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:57.132051 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 547/1074] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:57.137738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cba5c6-8f9e-4956-aba5-d7a350cb3d62 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:57.233573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cba5c6-8f9e-4956-aba5-d7a350cb3d62 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:57.265898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55e404-55bc-4f40-92e3-eb3739c80060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:57.266680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55e404-55bc-4f40-92e3-eb3739c80060 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:57.266957 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55e404-55bc-4f40-92e3-eb3739c80060 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:57.267227 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55e404-55bc-4f40-92e3-eb3739c80060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:57.274203 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55e404-55bc-4f40-92e3-eb3739c80060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:57.275639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55e404-55bc-4f40-92e3-eb3739c80060 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:57.288581 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-3b55e404-55bc-4f40-92e3-eb3739c80060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:53:57.289770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 528/1075] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:53:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:53:57.295500 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4171236-96e3-4426-8ce1-72e93e2bd0ea None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:57.389484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4171236-96e3-4426-8ce1-72e93e2bd0ea None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:57.420763 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bf427-d334-4729-a431-d09706fe3ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:57.421436 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bf427-d334-4729-a431-d09706fe3ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:57.421711 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bf427-d334-4729-a431-d09706fe3ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:57.421980 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bf427-d334-4729-a431-d09706fe3ed1 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:57.422747 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bf427-d334-4729-a431-d09706fe3ed1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:57.423049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bf427-d334-4729-a431-d09706fe3ed1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:57.424552 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bf427-d334-4729-a431-d09706fe3ed1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:57.436014 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 548/1076] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:53:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:57.442014 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55e404-55bc-4f40-92e3-eb3739c80060 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:57.537119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55e404-55bc-4f40-92e3-eb3739c80060 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:57.570136 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c7772-ef73-49ce-814d-aee4a77d443e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:57.571011 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c7772-ef73-49ce-814d-aee4a77d443e None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:57.571290 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c7772-ef73-49ce-814d-aee4a77d443e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:57.571566 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c7772-ef73-49ce-814d-aee4a77d443e None admin] PATH_INFO: `/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/faac84ed9d37420c811bbf6ac7df0b35/roles/66c1cde8141c4a1987bd171077d0ddf3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:57.573778 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c7772-ef73-49ce-814d-aee4a77d443e None admin] RBAC: Authorizing `identity:create_grant(project_id=470fa8cf5f4a443faea9cfc628ff6003, user_id=faac84ed9d37420c811bbf6ac7df0b35, role_id=66c1cde8141c4a1987bd171077d0ddf3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:57.575209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c7772-ef73-49ce-814d-aee4a77d443e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:57.587951 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 529/1077] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:53:57 2022] PUT /identity/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/faac84ed9d37420c811bbf6ac7df0b35/roles/66c1cde8141c4a1987bd171077d0ddf3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:53:58.038769 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd597-f594-4ddc-aa7d-2587f6a7200d None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:58.039300 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd597-f594-4ddc-aa7d-2587f6a7200d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:58.039300 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd597-f594-4ddc-aa7d-2587f6a7200d None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:58.041142 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 549/1078] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:58.046430 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01ea15-1976-4dba-a1f6-89cf857dd4aa None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:58.046804 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01ea15-1976-4dba-a1f6-89cf857dd4aa None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:58.046985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01ea15-1976-4dba-a1f6-89cf857dd4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:58.063625 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-fb01ea15-1976-4dba-a1f6-89cf857dd4aa None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:58.064835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fb01ea15-1976-4dba-a1f6-89cf857dd4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:53:58.129017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 530/1079] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:53:58.151503 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcd597-f594-4ddc-aa7d-2587f6a7200d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:58.251508 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcd597-f594-4ddc-aa7d-2587f6a7200d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:58.285126 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57de2c-ec3f-4526-9bdf-ed259b550aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:58.285911 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57de2c-ec3f-4526-9bdf-ed259b550aaa None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:58.286191 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57de2c-ec3f-4526-9bdf-ed259b550aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:58.286469 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57de2c-ec3f-4526-9bdf-ed259b550aaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:58.296231 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57de2c-ec3f-4526-9bdf-ed259b550aaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:53:58.303715 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-1f57de2c-ec3f-4526-9bdf-ed259b550aaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:53:58.305357 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 550/1080] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:53:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:53:58.311435 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01ea15-1976-4dba-a1f6-89cf857dd4aa None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:58.407752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01ea15-1976-4dba-a1f6-89cf857dd4aa None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:58.440021 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834add9d-3817-4289-81db-55a57f9bf363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:58.441236 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834add9d-3817-4289-81db-55a57f9bf363 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:58.441513 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834add9d-3817-4289-81db-55a57f9bf363 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:58.441780 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834add9d-3817-4289-81db-55a57f9bf363 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:58.442518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834add9d-3817-4289-81db-55a57f9bf363 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:53:58.442818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834add9d-3817-4289-81db-55a57f9bf363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:58.444193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834add9d-3817-4289-81db-55a57f9bf363 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:58.452082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 531/1081] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:53:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:58.458108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57de2c-ec3f-4526-9bdf-ed259b550aaa None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:58.553220 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57de2c-ec3f-4526-9bdf-ed259b550aaa None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:58.585326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe5fe4-47e0-42d1-b112-20985adae43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:58.586188 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe5fe4-47e0-42d1-b112-20985adae43b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:58.586470 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe5fe4-47e0-42d1-b112-20985adae43b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:58.586745 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe5fe4-47e0-42d1-b112-20985adae43b None admin] PATH_INFO: `/v3/users/02a90d6c9a6b47f18ff75a9745d7ab9a` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:58.587930 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe5fe4-47e0-42d1-b112-20985adae43b None admin] RBAC: Authorizing `identity:get_user(user_id=02a90d6c9a6b47f18ff75a9745d7ab9a)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:58.589408 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe5fe4-47e0-42d1-b112-20985adae43b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:58.591096 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 551/1082] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:53:58 2022] GET /identity/v3/users/02a90d6c9a6b47f18ff75a9745d7ab9a => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:58.597703 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834add9d-3817-4289-81db-55a57f9bf363 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:58.692866 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834add9d-3817-4289-81db-55a57f9bf363 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:58.725267 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e36a8-e1c4-4727-b1cc-a01402bdb710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:58.726159 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e36a8-e1c4-4727-b1cc-a01402bdb710 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:58.726438 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e36a8-e1c4-4727-b1cc-a01402bdb710 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:58.726713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e36a8-e1c4-4727-b1cc-a01402bdb710 None admin] PATH_INFO: `/v3/projects/542280f1c71b45ba8a5d0c0950b58da8` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:58.727986 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e36a8-e1c4-4727-b1cc-a01402bdb710 None admin] RBAC: Authorizing `identity:get_project(project_id=542280f1c71b45ba8a5d0c0950b58da8)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:58.729479 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e36a8-e1c4-4727-b1cc-a01402bdb710 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:58.731194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 532/1083] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:53:58 2022] GET /identity/v3/projects/542280f1c71b45ba8a5d0c0950b58da8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:53:58.737629 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe5fe4-47e0-42d1-b112-20985adae43b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:53:58.832032 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe5fe4-47e0-42d1-b112-20985adae43b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:53:58.863819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768db8f-9961-4ee4-b96c-f78bb36b8478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:53:58.864683 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768db8f-9961-4ee4-b96c-f78bb36b8478 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:58.864991 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768db8f-9961-4ee4-b96c-f78bb36b8478 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:58.865266 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768db8f-9961-4ee4-b96c-f78bb36b8478 None admin] PATH_INFO: `/v3/projects/542280f1c71b45ba8a5d0c0950b58da8/users/02a90d6c9a6b47f18ff75a9745d7ab9a/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:58.867207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768db8f-9961-4ee4-b96c-f78bb36b8478 None admin] RBAC: Authorizing `identity:create_grant(project_id=542280f1c71b45ba8a5d0c0950b58da8, user_id=02a90d6c9a6b47f18ff75a9745d7ab9a, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:53:58.868635 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768db8f-9961-4ee4-b96c-f78bb36b8478 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:53:58.882463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 552/1084] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:53:58 2022] PUT /identity/v3/projects/542280f1c71b45ba8a5d0c0950b58da8/users/02a90d6c9a6b47f18ff75a9745d7ab9a/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:53:59.936551 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed618c55-40b8-4971-8096-c415a5977558 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:59.937108 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed618c55-40b8-4971-8096-c415a5977558 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:59.937108 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed618c55-40b8-4971-8096-c415a5977558 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:59.938890 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 533/1085] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:53:59.944289 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b738e9-02cd-470a-823f-773b420804c3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:53:59.944702 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b738e9-02cd-470a-823f-773b420804c3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:53:59.944881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b738e9-02cd-470a-823f-773b420804c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:53:59.962887 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-01b738e9-02cd-470a-823f-773b420804c3 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:53:59.964094 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-01b738e9-02cd-470a-823f-773b420804c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:00.154185 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 553/1086] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:53:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:54:00.177879 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed618c55-40b8-4971-8096-c415a5977558 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:00.275655 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed618c55-40b8-4971-8096-c415a5977558 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:00.307533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa948748-57ba-4b45-820c-4b328dba287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:00.308341 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa948748-57ba-4b45-820c-4b328dba287c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:00.308619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa948748-57ba-4b45-820c-4b328dba287c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:00.308921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa948748-57ba-4b45-820c-4b328dba287c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:00.319751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa948748-57ba-4b45-820c-4b328dba287c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:54:00.327421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-aa948748-57ba-4b45-820c-4b328dba287c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 27 04:54:00.328816 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 534/1087] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Sep 27 04:54:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:54:00.334876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b738e9-02cd-470a-823f-773b420804c3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:00.428099 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b738e9-02cd-470a-823f-773b420804c3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:00.460272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f246a-8cd5-409e-be62-f968e9ca9d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:00.460974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f246a-8cd5-409e-be62-f968e9ca9d19 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:00.461254 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f246a-8cd5-409e-be62-f968e9ca9d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:00.461526 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f246a-8cd5-409e-be62-f968e9ca9d19 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:00.462268 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f246a-8cd5-409e-be62-f968e9ca9d19 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:00.462569 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f246a-8cd5-409e-be62-f968e9ca9d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:00.463957 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f246a-8cd5-409e-be62-f968e9ca9d19 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:00.472749 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 554/1088] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Sep 27 04:54:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:00.478360 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa948748-57ba-4b45-820c-4b328dba287c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:00.572329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa948748-57ba-4b45-820c-4b328dba287c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:00.605527 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ba33a-e01c-480c-b797-0c8c7c3ed66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:00.606310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ba33a-e01c-480c-b797-0c8c7c3ed66d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:00.606584 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ba33a-e01c-480c-b797-0c8c7c3ed66d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:00.606858 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ba33a-e01c-480c-b797-0c8c7c3ed66d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:00.616771 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ba33a-e01c-480c-b797-0c8c7c3ed66d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:00.618232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ba33a-e01c-480c-b797-0c8c7c3ed66d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:00.634740 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-361ba33a-e01c-480c-b797-0c8c7c3ed66d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:54:00.635911 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 535/1089] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:54:00.641493 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f246a-8cd5-409e-be62-f968e9ca9d19 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:00.736722 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f246a-8cd5-409e-be62-f968e9ca9d19 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:00.768003 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8fa81-ea73-4c9c-9d08-66b368551ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:00.769244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8fa81-ea73-4c9c-9d08-66b368551ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:00.769522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8fa81-ea73-4c9c-9d08-66b368551ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:00.769797 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8fa81-ea73-4c9c-9d08-66b368551ca2 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:00.770507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8fa81-ea73-4c9c-9d08-66b368551ca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:00.770809 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8fa81-ea73-4c9c-9d08-66b368551ca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:00.772170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef8fa81-ea73-4c9c-9d08-66b368551ca2 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:00.783643 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 555/1090] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:54:00.789826 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ba33a-e01c-480c-b797-0c8c7c3ed66d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:00.888117 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ba33a-e01c-480c-b797-0c8c7c3ed66d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:00.920251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05117b0e-4fca-41ad-be8f-e8eae0bc6978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:00.921059 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05117b0e-4fca-41ad-be8f-e8eae0bc6978 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:00.921338 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05117b0e-4fca-41ad-be8f-e8eae0bc6978 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:00.921609 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05117b0e-4fca-41ad-be8f-e8eae0bc6978 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:00.928953 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05117b0e-4fca-41ad-be8f-e8eae0bc6978 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:00.930399 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05117b0e-4fca-41ad-be8f-e8eae0bc6978 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:00.945248 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-05117b0e-4fca-41ad-be8f-e8eae0bc6978 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 27 04:54:00.946418 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 536/1091] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Sep 27 04:54:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:54:00.952092 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8fa81-ea73-4c9c-9d08-66b368551ca2 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:01.050181 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8fa81-ea73-4c9c-9d08-66b368551ca2 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:01.082126 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eaac57-efe1-43c7-acee-b7a2ded20969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:01.082784 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaac57-efe1-43c7-acee-b7a2ded20969 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:01.083064 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaac57-efe1-43c7-acee-b7a2ded20969 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:01.083334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eaac57-efe1-43c7-acee-b7a2ded20969 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:01.084170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eaac57-efe1-43c7-acee-b7a2ded20969 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:01.084474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eaac57-efe1-43c7-acee-b7a2ded20969 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:01.085946 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eaac57-efe1-43c7-acee-b7a2ded20969 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:01.102733 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 556/1092] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Sep 27 04:54:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:01.108321 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05117b0e-4fca-41ad-be8f-e8eae0bc6978 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:01.191067 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621e86c-1144-4c68-a0ef-280f12aeab9d None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:01.191260 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621e86c-1144-4c68-a0ef-280f12aeab9d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:01.191521 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621e86c-1144-4c68-a0ef-280f12aeab9d None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:01.193322 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 557/1093] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:54:01.198390 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a4ff3-961f-4b25-8c50-21adf0250553 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:01.198671 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a4ff3-961f-4b25-8c50-21adf0250553 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:01.198942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a4ff3-961f-4b25-8c50-21adf0250553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:01.202657 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05117b0e-4fca-41ad-be8f-e8eae0bc6978 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:01.215622 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e30a4ff3-961f-4b25-8c50-21adf0250553 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:01.216864 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e30a4ff3-961f-4b25-8c50-21adf0250553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:01.236742 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359aa2e-41b4-423f-b521-84d44de12a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:01.237763 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359aa2e-41b4-423f-b521-84d44de12a18 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:01.238046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359aa2e-41b4-423f-b521-84d44de12a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:01.238318 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359aa2e-41b4-423f-b521-84d44de12a18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:01.281075 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 558/1094] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:54:01.301387 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359aa2e-41b4-423f-b521-84d44de12a18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:01.302875 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359aa2e-41b4-423f-b521-84d44de12a18 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:01.305163 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a4ff3-961f-4b25-8c50-21adf0250553 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:01.395850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 537/1095] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:54:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:54:01.398719 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a4ff3-961f-4b25-8c50-21adf0250553 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:01.401529 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359aa2e-41b4-423f-b521-84d44de12a18 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:01.431411 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e93b2-7601-408e-8f25-b841e2f711b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:01.432194 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e93b2-7601-408e-8f25-b841e2f711b0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:01.432475 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e93b2-7601-408e-8f25-b841e2f711b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:01.432750 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e93b2-7601-408e-8f25-b841e2f711b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:01.442599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e93b2-7601-408e-8f25-b841e2f711b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:54:01.449384 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-3f6e93b2-7601-408e-8f25-b841e2f711b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:54:01.450560 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 559/1096] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:54:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:54:01.456897 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e93b2-7601-408e-8f25-b841e2f711b0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:01.492390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359aa2e-41b4-423f-b521-84d44de12a18 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:01.524649 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794c4e6-3872-49a1-903c-c3ea1eb727e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:01.525469 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794c4e6-3872-49a1-903c-c3ea1eb727e4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:01.525749 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794c4e6-3872-49a1-903c-c3ea1eb727e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:01.526019 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794c4e6-3872-49a1-903c-c3ea1eb727e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:01.535558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794c4e6-3872-49a1-903c-c3ea1eb727e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:01.537019 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794c4e6-3872-49a1-903c-c3ea1eb727e4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:01.550578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e93b2-7601-408e-8f25-b841e2f711b0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:01.553785 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-f794c4e6-3872-49a1-903c-c3ea1eb727e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:54:01.554952 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 538/1097] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:54:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:54:01.560495 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794c4e6-3872-49a1-903c-c3ea1eb727e4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:01.582457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da8e0a-b31d-4e49-b225-87d9360f8b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:01.583104 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da8e0a-b31d-4e49-b225-87d9360f8b24 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:01.583387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da8e0a-b31d-4e49-b225-87d9360f8b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:01.583655 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da8e0a-b31d-4e49-b225-87d9360f8b24 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:01.584386 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da8e0a-b31d-4e49-b225-87d9360f8b24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:01.584686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da8e0a-b31d-4e49-b225-87d9360f8b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:01.586070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da8e0a-b31d-4e49-b225-87d9360f8b24 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:01.599599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 560/1098] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:54:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:54:01.600635 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da8e0a-b31d-4e49-b225-87d9360f8b24 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:01.654745 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794c4e6-3872-49a1-903c-c3ea1eb727e4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:01.686590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fac16a-c8c8-4cf9-8b71-8233eca44f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:01.687236 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fac16a-c8c8-4cf9-8b71-8233eca44f40 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:01.687515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fac16a-c8c8-4cf9-8b71-8233eca44f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:01.687784 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fac16a-c8c8-4cf9-8b71-8233eca44f40 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:01.688493 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fac16a-c8c8-4cf9-8b71-8233eca44f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:01.688816 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fac16a-c8c8-4cf9-8b71-8233eca44f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:01.691175 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fac16a-c8c8-4cf9-8b71-8233eca44f40 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:01.694436 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da8e0a-b31d-4e49-b225-87d9360f8b24 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:01.702229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 539/1099] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:54:01.708091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fac16a-c8c8-4cf9-8b71-8233eca44f40 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:01.726943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873409a-5035-4c79-ae77-bae9317978f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:01.727814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873409a-5035-4c79-ae77-bae9317978f6 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:01.728110 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873409a-5035-4c79-ae77-bae9317978f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:01.728387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873409a-5035-4c79-ae77-bae9317978f6 None admin] PATH_INFO: `/v3/users/02a90d6c9a6b47f18ff75a9745d7ab9a` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:01.729663 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873409a-5035-4c79-ae77-bae9317978f6 None admin] RBAC: Authorizing `identity:get_user(user_id=02a90d6c9a6b47f18ff75a9745d7ab9a)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:01.731079 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873409a-5035-4c79-ae77-bae9317978f6 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:01.732704 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 561/1100] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:54:01 2022] GET /identity/v3/users/02a90d6c9a6b47f18ff75a9745d7ab9a => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:01.738714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873409a-5035-4c79-ae77-bae9317978f6 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:01.802465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fac16a-c8c8-4cf9-8b71-8233eca44f40 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:01.831248 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873409a-5035-4c79-ae77-bae9317978f6 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:01.833937 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c016585-f851-4d92-b821-35b258e43e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:01.834763 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c016585-f851-4d92-b821-35b258e43e72 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:01.835044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c016585-f851-4d92-b821-35b258e43e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:01.835313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c016585-f851-4d92-b821-35b258e43e72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:01.841850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c016585-f851-4d92-b821-35b258e43e72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:01.843287 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c016585-f851-4d92-b821-35b258e43e72 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:01.857085 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-1c016585-f851-4d92-b821-35b258e43e72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:54:01.858249 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 540/1101] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:54:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:54:01.863758 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9813f0d-cc12-436d-b3f9-f9c1555843ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:01.864417 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9813f0d-cc12-436d-b3f9-f9c1555843ac None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:01.864653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c016585-f851-4d92-b821-35b258e43e72 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:01.864779 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9813f0d-cc12-436d-b3f9-f9c1555843ac None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:01.864990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9813f0d-cc12-436d-b3f9-f9c1555843ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:01.928947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9813f0d-cc12-436d-b3f9-f9c1555843ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:01.930392 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9813f0d-cc12-436d-b3f9-f9c1555843ac None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:01.957713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c016585-f851-4d92-b821-35b258e43e72 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:01.990364 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a4f56-57fb-47e9-aafd-36b76e2baea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:01.991027 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a4f56-57fb-47e9-aafd-36b76e2baea1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:01.991304 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a4f56-57fb-47e9-aafd-36b76e2baea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:01.991575 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a4f56-57fb-47e9-aafd-36b76e2baea1 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:01.992350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a4f56-57fb-47e9-aafd-36b76e2baea1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:01.992648 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a4f56-57fb-47e9-aafd-36b76e2baea1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:01.994094 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a4f56-57fb-47e9-aafd-36b76e2baea1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:02.005763 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 541/1102] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:54:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:54:02.011614 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a4f56-57fb-47e9-aafd-36b76e2baea1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:02.029566 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 562/1103] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:54:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 04:54:02.030539 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9813f0d-cc12-436d-b3f9-f9c1555843ac None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:02.106270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a4f56-57fb-47e9-aafd-36b76e2baea1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:02.123079 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9813f0d-cc12-436d-b3f9-f9c1555843ac None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:02.139040 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2953287-07d2-4b9a-8e84-4804a6a26dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:02.139701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2953287-07d2-4b9a-8e84-4804a6a26dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:02.139979 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2953287-07d2-4b9a-8e84-4804a6a26dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:02.140252 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2953287-07d2-4b9a-8e84-4804a6a26dd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:02.141118 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2953287-07d2-4b9a-8e84-4804a6a26dd2 None admin] RBAC: Adding query filter params (role.id=66c1cde8141c4a1987bd171077d0ddf3, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=faac84ed9d37420c811bbf6ac7df0b35) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:02.141429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2953287-07d2-4b9a-8e84-4804a6a26dd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:02.142856 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2953287-07d2-4b9a-8e84-4804a6a26dd2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:02.148422 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 542/1104] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:54:02 2022] GET /identity/v3/role_assignments?user.id=faac84ed9d37420c811bbf6ac7df0b35&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=66c1cde8141c4a1987bd171077d0ddf3 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:54:02.156738 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cc198-7794-42bb-ba77-87b0b48b7ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:02.157980 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cc198-7794-42bb-ba77-87b0b48b7ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:02.158255 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cc198-7794-42bb-ba77-87b0b48b7ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:02.158524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cc198-7794-42bb-ba77-87b0b48b7ed3 None admin] PATH_INFO: `/v3/projects/542280f1c71b45ba8a5d0c0950b58da8` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:02.159878 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cc198-7794-42bb-ba77-87b0b48b7ed3 None admin] RBAC: Authorizing `identity:get_project(project_id=542280f1c71b45ba8a5d0c0950b58da8)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:02.161422 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cc198-7794-42bb-ba77-87b0b48b7ed3 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:02.163226 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 563/1105] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:54:02 2022] GET /identity/v3/projects/542280f1c71b45ba8a5d0c0950b58da8 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:54:02.169680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2953287-07d2-4b9a-8e84-4804a6a26dd2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:02.274013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2953287-07d2-4b9a-8e84-4804a6a26dd2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:02.312823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2faadd-6d13-47f1-a9a6-b1f6bc90f865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:02.313485 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2faadd-6d13-47f1-a9a6-b1f6bc90f865 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:02.313764 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2faadd-6d13-47f1-a9a6-b1f6bc90f865 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:02.314039 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2faadd-6d13-47f1-a9a6-b1f6bc90f865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:02.314879 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2faadd-6d13-47f1-a9a6-b1f6bc90f865 None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=542280f1c71b45ba8a5d0c0950b58da8, user.id=02a90d6c9a6b47f18ff75a9745d7ab9a) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:02.315769 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2faadd-6d13-47f1-a9a6-b1f6bc90f865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:02.317285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2faadd-6d13-47f1-a9a6-b1f6bc90f865 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:02.323704 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 543/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:54:02 2022] GET /identity/v3/role_assignments?user.id=02a90d6c9a6b47f18ff75a9745d7ab9a&scope.project.id=542280f1c71b45ba8a5d0c0950b58da8&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:04.655911 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a217c3c-db18-40d6-9d54-3d9255b47610 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:04.656435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a217c3c-db18-40d6-9d54-3d9255b47610 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:04.656435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a217c3c-db18-40d6-9d54-3d9255b47610 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:04.658256 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 564/1107] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:54:04.663999 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569052-0c70-42b8-be5e-a26d9e0a40c4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:04.664397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569052-0c70-42b8-be5e-a26d9e0a40c4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:04.664548 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c569052-0c70-42b8-be5e-a26d9e0a40c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:04.681771 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6c569052-0c70-42b8-be5e-a26d9e0a40c4 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:04.682940 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6c569052-0c70-42b8-be5e-a26d9e0a40c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:04.745445 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 544/1108] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:54:04.771432 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a217c3c-db18-40d6-9d54-3d9255b47610 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:04.866651 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a217c3c-db18-40d6-9d54-3d9255b47610 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:04.898127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0915eff-a89a-4eff-8941-934dcec8457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:04.898887 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0915eff-a89a-4eff-8941-934dcec8457e None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:04.899163 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0915eff-a89a-4eff-8941-934dcec8457e None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:04.899432 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0915eff-a89a-4eff-8941-934dcec8457e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:04.900574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0915eff-a89a-4eff-8941-934dcec8457e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:04.902028 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0915eff-a89a-4eff-8941-934dcec8457e None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:04.903586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 565/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:54:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:04.910044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c569052-0c70-42b8-be5e-a26d9e0a40c4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:05.003179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c569052-0c70-42b8-be5e-a26d9e0a40c4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:05.035528 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499f5d2-2c86-4694-8d8c-2ea43f417df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:05.036192 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499f5d2-2c86-4694-8d8c-2ea43f417df8 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:05.036470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499f5d2-2c86-4694-8d8c-2ea43f417df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:05.036740 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499f5d2-2c86-4694-8d8c-2ea43f417df8 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:05.037472 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499f5d2-2c86-4694-8d8c-2ea43f417df8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:05.038911 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499f5d2-2c86-4694-8d8c-2ea43f417df8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:05.058200 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 545/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:54:04 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:54:07.408689 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1e81e-a00d-4320-a62c-206ec36831d8 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:07.409233 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1e81e-a00d-4320-a62c-206ec36831d8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:07.409434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1e81e-a00d-4320-a62c-206ec36831d8 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:07.411222 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 566/1111] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:54:07.416306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b996993-4a11-421d-a53f-21b1a56be15b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:07.416687 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b996993-4a11-421d-a53f-21b1a56be15b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:07.416894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b996993-4a11-421d-a53f-21b1a56be15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:07.434656 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9b996993-4a11-421d-a53f-21b1a56be15b None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:07.435837 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9b996993-4a11-421d-a53f-21b1a56be15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:07.498585 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 546/1112] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:54:07.522711 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1e81e-a00d-4320-a62c-206ec36831d8 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:07.617993 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1e81e-a00d-4320-a62c-206ec36831d8 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:07.650415 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361aa03-8ced-4ade-9d6a-095c996b0905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:07.651240 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361aa03-8ced-4ade-9d6a-095c996b0905 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:07.651515 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361aa03-8ced-4ade-9d6a-095c996b0905 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:07.651783 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361aa03-8ced-4ade-9d6a-095c996b0905 None admin] PATH_INFO: `/v3/roles/20b1a2451e0a42628e0126aa881cac6b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:07.653266 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361aa03-8ced-4ade-9d6a-095c996b0905 None admin] RBAC: Authorizing `identity:get_role(role_id=20b1a2451e0a42628e0126aa881cac6b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:07.654624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361aa03-8ced-4ade-9d6a-095c996b0905 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:07.655945 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 567/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:54:07 2022] GET /identity/v3/roles/20b1a2451e0a42628e0126aa881cac6b => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:07.662305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b996993-4a11-421d-a53f-21b1a56be15b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:07.754582 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b996993-4a11-421d-a53f-21b1a56be15b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:07.786031 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b990859-d208-4b05-a751-e92eb909ff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:07.786885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b990859-d208-4b05-a751-e92eb909ff87 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:07.787158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b990859-d208-4b05-a751-e92eb909ff87 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:07.787430 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b990859-d208-4b05-a751-e92eb909ff87 None admin] PATH_INFO: `/v3/users/0bc7c8d9529f47f9aed06d7ae197e8c9` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:07.799690 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b990859-d208-4b05-a751-e92eb909ff87 None admin] RBAC: Authorizing `identity:get_user(user_id=0bc7c8d9529f47f9aed06d7ae197e8c9)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:07.801163 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b990859-d208-4b05-a751-e92eb909ff87 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:07.802929 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 547/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:54:07 2022] GET /identity/v3/users/0bc7c8d9529f47f9aed06d7ae197e8c9 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:07.808342 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361aa03-8ced-4ade-9d6a-095c996b0905 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:07.903844 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361aa03-8ced-4ade-9d6a-095c996b0905 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:07.935520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1beb8f-be46-4463-90ac-84c7c3e9e98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:07.936080 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1beb8f-be46-4463-90ac-84c7c3e9e98f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:07.936354 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1beb8f-be46-4463-90ac-84c7c3e9e98f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:07.936619 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1beb8f-be46-4463-90ac-84c7c3e9e98f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:08.001598 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1beb8f-be46-4463-90ac-84c7c3e9e98f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:08.004017 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1beb8f-be46-4463-90ac-84c7c3e9e98f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:08.094899 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 568/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:54:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:54:08.101008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b990859-d208-4b05-a751-e92eb909ff87 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:08.193997 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b990859-d208-4b05-a751-e92eb909ff87 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:08.226015 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57686104-df87-4961-afb0-d37f9bff93e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:08.226858 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57686104-df87-4961-afb0-d37f9bff93e6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:08.227135 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57686104-df87-4961-afb0-d37f9bff93e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:08.227405 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57686104-df87-4961-afb0-d37f9bff93e6 None admin] PATH_INFO: `/v3/projects/542280f1c71b45ba8a5d0c0950b58da8` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:08.228569 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57686104-df87-4961-afb0-d37f9bff93e6 None admin] RBAC: Authorizing `identity:get_project(project_id=542280f1c71b45ba8a5d0c0950b58da8)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:08.230024 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57686104-df87-4961-afb0-d37f9bff93e6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:08.231657 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 548/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:54:08 2022] GET /identity/v3/projects/542280f1c71b45ba8a5d0c0950b58da8 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:08.237773 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1beb8f-be46-4463-90ac-84c7c3e9e98f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:08.329445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1beb8f-be46-4463-90ac-84c7c3e9e98f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:08.361166 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e8bd7-c5f5-4cf3-af74-d8aa4cb82e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:08.362036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e8bd7-c5f5-4cf3-af74-d8aa4cb82e3b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:08.362313 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e8bd7-c5f5-4cf3-af74-d8aa4cb82e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:08.362583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e8bd7-c5f5-4cf3-af74-d8aa4cb82e3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:08.363399 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e8bd7-c5f5-4cf3-af74-d8aa4cb82e3b None admin] RBAC: Adding query filter params (role.id=20b1a2451e0a42628e0126aa881cac6b, scope.project.id=542280f1c71b45ba8a5d0c0950b58da8, user.id=0bc7c8d9529f47f9aed06d7ae197e8c9) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:08.363702 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e8bd7-c5f5-4cf3-af74-d8aa4cb82e3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:08.365141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e8bd7-c5f5-4cf3-af74-d8aa4cb82e3b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:08.370244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 569/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:54:08 2022] GET /identity/v3/role_assignments?user.id=0bc7c8d9529f47f9aed06d7ae197e8c9&scope.project.id=542280f1c71b45ba8a5d0c0950b58da8&role.id=20b1a2451e0a42628e0126aa881cac6b => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:10.652010 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687ff8f-c0e9-4d97-80c5-a7b25db7d634 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:10.652538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687ff8f-c0e9-4d97-80c5-a7b25db7d634 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:10.652538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687ff8f-c0e9-4d97-80c5-a7b25db7d634 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:10.654376 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 549/1118] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:54:10.659954 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5670ec-b989-41c6-8b6c-d22e8398cd58 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:10.660387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5670ec-b989-41c6-8b6c-d22e8398cd58 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:10.660608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5670ec-b989-41c6-8b6c-d22e8398cd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:10.678340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8b5670ec-b989-41c6-8b6c-d22e8398cd58 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:10.679492 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8b5670ec-b989-41c6-8b6c-d22e8398cd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:10.741722 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 570/1119] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:54:10.764379 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687ff8f-c0e9-4d97-80c5-a7b25db7d634 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:10.859371 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687ff8f-c0e9-4d97-80c5-a7b25db7d634 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:10.891605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d39d0-6631-4a85-baa0-3cba3d9ddd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:10.892444 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d39d0-6631-4a85-baa0-3cba3d9ddd71 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:10.892726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d39d0-6631-4a85-baa0-3cba3d9ddd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:10.893119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d39d0-6631-4a85-baa0-3cba3d9ddd71 None admin] PATH_INFO: `/v3/roles/20b1a2451e0a42628e0126aa881cac6b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:10.894574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d39d0-6631-4a85-baa0-3cba3d9ddd71 None admin] RBAC: Authorizing `identity:get_role(role_id=20b1a2451e0a42628e0126aa881cac6b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:10.895940 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d39d0-6631-4a85-baa0-3cba3d9ddd71 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:10.897375 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 550/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:54:10 2022] GET /identity/v3/roles/20b1a2451e0a42628e0126aa881cac6b => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:10.903118 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5670ec-b989-41c6-8b6c-d22e8398cd58 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:10.996326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5670ec-b989-41c6-8b6c-d22e8398cd58 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:11.028615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6e2c9-3c13-4399-8f64-87d49ba3af3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:11.029496 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6e2c9-3c13-4399-8f64-87d49ba3af3d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:11.029776 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6e2c9-3c13-4399-8f64-87d49ba3af3d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:11.030047 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6e2c9-3c13-4399-8f64-87d49ba3af3d None admin] PATH_INFO: `/v3/users/0bc7c8d9529f47f9aed06d7ae197e8c9` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:11.031212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6e2c9-3c13-4399-8f64-87d49ba3af3d None admin] RBAC: Authorizing `identity:get_user(user_id=0bc7c8d9529f47f9aed06d7ae197e8c9)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:11.032637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6e2c9-3c13-4399-8f64-87d49ba3af3d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:11.035042 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 571/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:54:10 2022] GET /identity/v3/users/0bc7c8d9529f47f9aed06d7ae197e8c9 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:11.041435 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d39d0-6631-4a85-baa0-3cba3d9ddd71 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:11.135597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d39d0-6631-4a85-baa0-3cba3d9ddd71 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:11.167810 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92744c0-b74b-40b6-a980-806f97ca010f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:11.168591 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92744c0-b74b-40b6-a980-806f97ca010f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:11.168894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92744c0-b74b-40b6-a980-806f97ca010f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:11.169166 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92744c0-b74b-40b6-a980-806f97ca010f None admin] PATH_INFO: `/v3/projects/542280f1c71b45ba8a5d0c0950b58da8` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:11.170324 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92744c0-b74b-40b6-a980-806f97ca010f None admin] RBAC: Authorizing `identity:get_project(project_id=542280f1c71b45ba8a5d0c0950b58da8)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:11.171740 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92744c0-b74b-40b6-a980-806f97ca010f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:11.173402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 551/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:54:11 2022] GET /identity/v3/projects/542280f1c71b45ba8a5d0c0950b58da8 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:11.179478 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6e2c9-3c13-4399-8f64-87d49ba3af3d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:11.273295 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6e2c9-3c13-4399-8f64-87d49ba3af3d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:11.305033 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad393cc6-d42f-46da-ba49-b08acc132c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:11.305889 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad393cc6-d42f-46da-ba49-b08acc132c10 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:11.306162 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad393cc6-d42f-46da-ba49-b08acc132c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:11.306429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad393cc6-d42f-46da-ba49-b08acc132c10 None admin] PATH_INFO: `/v3/projects/542280f1c71b45ba8a5d0c0950b58da8/users/0bc7c8d9529f47f9aed06d7ae197e8c9/roles/20b1a2451e0a42628e0126aa881cac6b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:11.308559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad393cc6-d42f-46da-ba49-b08acc132c10 None admin] RBAC: Authorizing `identity:create_grant(project_id=542280f1c71b45ba8a5d0c0950b58da8, user_id=0bc7c8d9529f47f9aed06d7ae197e8c9, role_id=20b1a2451e0a42628e0126aa881cac6b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:11.310000 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad393cc6-d42f-46da-ba49-b08acc132c10 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:11.322780 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 572/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:54:11 2022] PUT /identity/v3/projects/542280f1c71b45ba8a5d0c0950b58da8/users/0bc7c8d9529f47f9aed06d7ae197e8c9/roles/20b1a2451e0a42628e0126aa881cac6b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:54:13.610407 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eacfe8-6cee-45ee-ba2c-5fc387213892 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:13.610930 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eacfe8-6cee-45ee-ba2c-5fc387213892 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:13.610930 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eacfe8-6cee-45ee-ba2c-5fc387213892 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:13.613343 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 552/1124] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:54:13.618666 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e36c35-ba09-46a6-96bc-3f6f6a6df5a0 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:13.619083 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e36c35-ba09-46a6-96bc-3f6f6a6df5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:13.619194 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e36c35-ba09-46a6-96bc-3f6f6a6df5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:13.636367 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-96e36c35-ba09-46a6-96bc-3f6f6a6df5a0 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:13.637543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-96e36c35-ba09-46a6-96bc-3f6f6a6df5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:13.698375 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 573/1125] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:54:13.722227 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eacfe8-6cee-45ee-ba2c-5fc387213892 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:13.816755 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eacfe8-6cee-45ee-ba2c-5fc387213892 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:13.851790 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf3945-0802-4114-a386-9c7928665ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:13.852622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf3945-0802-4114-a386-9c7928665ede None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:13.852925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf3945-0802-4114-a386-9c7928665ede None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:13.853206 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf3945-0802-4114-a386-9c7928665ede None admin] PATH_INFO: `/v3/roles/20b1a2451e0a42628e0126aa881cac6b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:13.854664 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf3945-0802-4114-a386-9c7928665ede None admin] RBAC: Authorizing `identity:get_role(role_id=20b1a2451e0a42628e0126aa881cac6b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:13.856048 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf3945-0802-4114-a386-9c7928665ede None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:13.857412 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 553/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:54:13 2022] GET /identity/v3/roles/20b1a2451e0a42628e0126aa881cac6b => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:13.863778 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e36c35-ba09-46a6-96bc-3f6f6a6df5a0 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:13.955322 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e36c35-ba09-46a6-96bc-3f6f6a6df5a0 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:13.988593 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e44880-4046-4522-8df0-3e78baac2941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:13.989493 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e44880-4046-4522-8df0-3e78baac2941 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:13.989803 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e44880-4046-4522-8df0-3e78baac2941 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:13.990075 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e44880-4046-4522-8df0-3e78baac2941 None admin] PATH_INFO: `/v3/users/0bc7c8d9529f47f9aed06d7ae197e8c9` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:13.991272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e44880-4046-4522-8df0-3e78baac2941 None admin] RBAC: Authorizing `identity:get_user(user_id=0bc7c8d9529f47f9aed06d7ae197e8c9)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:13.992707 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e44880-4046-4522-8df0-3e78baac2941 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:13.994356 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 574/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:54:13 2022] GET /identity/v3/users/0bc7c8d9529f47f9aed06d7ae197e8c9 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:14.000216 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf3945-0802-4114-a386-9c7928665ede None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:14.093161 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf3945-0802-4114-a386-9c7928665ede None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:14.125436 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f636e3-2cb6-4c0d-bbca-3a79f24c3ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:14.126014 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f636e3-2cb6-4c0d-bbca-3a79f24c3ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:14.126293 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f636e3-2cb6-4c0d-bbca-3a79f24c3ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:14.126565 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f636e3-2cb6-4c0d-bbca-3a79f24c3ed8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:14.189312 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f636e3-2cb6-4c0d-bbca-3a79f24c3ed8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:14.191314 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f636e3-2cb6-4c0d-bbca-3a79f24c3ed8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:14.282347 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 554/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:54:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:54:14.288171 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e44880-4046-4522-8df0-3e78baac2941 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:14.382197 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e44880-4046-4522-8df0-3e78baac2941 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:14.414315 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e3dee-face-454b-aa32-fa98acd0a3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:14.415164 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e3dee-face-454b-aa32-fa98acd0a3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:14.415466 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e3dee-face-454b-aa32-fa98acd0a3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:14.415739 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e3dee-face-454b-aa32-fa98acd0a3d4 None admin] PATH_INFO: `/v3/projects/542280f1c71b45ba8a5d0c0950b58da8` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:14.416922 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e3dee-face-454b-aa32-fa98acd0a3d4 None admin] RBAC: Authorizing `identity:get_project(project_id=542280f1c71b45ba8a5d0c0950b58da8)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:14.418348 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e3dee-face-454b-aa32-fa98acd0a3d4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:14.420015 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 575/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:54:14 2022] GET /identity/v3/projects/542280f1c71b45ba8a5d0c0950b58da8 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:14.427706 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f636e3-2cb6-4c0d-bbca-3a79f24c3ed8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:14.519439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f636e3-2cb6-4c0d-bbca-3a79f24c3ed8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:14.550693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2789b72-d8bf-4346-a981-b9669d944087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:14.551319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789b72-d8bf-4346-a981-b9669d944087 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:14.551593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789b72-d8bf-4346-a981-b9669d944087 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:14.551869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2789b72-d8bf-4346-a981-b9669d944087 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:14.552677 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2789b72-d8bf-4346-a981-b9669d944087 None admin] RBAC: Adding query filter params (role.id=20b1a2451e0a42628e0126aa881cac6b, scope.project.id=542280f1c71b45ba8a5d0c0950b58da8, user.id=0bc7c8d9529f47f9aed06d7ae197e8c9) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:14.553008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2789b72-d8bf-4346-a981-b9669d944087 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:14.554409 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2789b72-d8bf-4346-a981-b9669d944087 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:14.559809 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 555/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:54:14 2022] GET /identity/v3/role_assignments?user.id=0bc7c8d9529f47f9aed06d7ae197e8c9&scope.project.id=542280f1c71b45ba8a5d0c0950b58da8&role.id=20b1a2451e0a42628e0126aa881cac6b => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:16.883416 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76446734-f05d-4dff-b21f-dcb90ea3a049 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:16.883974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76446734-f05d-4dff-b21f-dcb90ea3a049 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:16.883974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76446734-f05d-4dff-b21f-dcb90ea3a049 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:16.885779 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 576/1131] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:54:16.891218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24172ad8-12a0-4f81-ab03-26574a53f65b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:16.891626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24172ad8-12a0-4f81-ab03-26574a53f65b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:16.891767 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24172ad8-12a0-4f81-ab03-26574a53f65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:16.908710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-24172ad8-12a0-4f81-ab03-26574a53f65b None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:16.909919 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-24172ad8-12a0-4f81-ab03-26574a53f65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:16.971670 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 556/1132] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:54:16.995097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76446734-f05d-4dff-b21f-dcb90ea3a049 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:17.089944 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76446734-f05d-4dff-b21f-dcb90ea3a049 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:17.121303 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e039d-d165-4d4b-ab91-11f2de679b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:17.122071 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e039d-d165-4d4b-ab91-11f2de679b7c None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:17.122348 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e039d-d165-4d4b-ab91-11f2de679b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:17.122876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e039d-d165-4d4b-ab91-11f2de679b7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:17.124024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e039d-d165-4d4b-ab91-11f2de679b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:17.125473 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e039d-d165-4d4b-ab91-11f2de679b7c None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:17.127034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 577/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:54:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:17.133551 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24172ad8-12a0-4f81-ab03-26574a53f65b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:17.224746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24172ad8-12a0-4f81-ab03-26574a53f65b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:17.257734 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c9e5e-8c1c-4ad6-9a5f-459c60e3f6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:17.258386 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9e5e-8c1c-4ad6-9a5f-459c60e3f6d1 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:17.258666 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9e5e-8c1c-4ad6-9a5f-459c60e3f6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:17.258940 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9e5e-8c1c-4ad6-9a5f-459c60e3f6d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:17.259648 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c9e5e-8c1c-4ad6-9a5f-459c60e3f6d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:17.261095 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c9e5e-8c1c-4ad6-9a5f-459c60e3f6d1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:17.284601 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 557/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 27 04:54:17 2022] POST /identity/v3/projects => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:54:19.625245 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad907822-001f-4015-8834-ccfcf7554b61 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:19.626087 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad907822-001f-4015-8834-ccfcf7554b61 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:19.626087 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad907822-001f-4015-8834-ccfcf7554b61 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:19.628512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 578/1135] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:54:19.633699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb49b7-2b5a-4631-ac33-9baac67b857d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:19.634075 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb49b7-2b5a-4631-ac33-9baac67b857d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:19.634367 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb49b7-2b5a-4631-ac33-9baac67b857d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:19.652218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-aebb49b7-2b5a-4631-ac33-9baac67b857d None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:19.653408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-aebb49b7-2b5a-4631-ac33-9baac67b857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:19.714959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 558/1136] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:54:19.740070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad907822-001f-4015-8834-ccfcf7554b61 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:19.835095 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad907822-001f-4015-8834-ccfcf7554b61 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:19.866447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895465b7-1a58-4bae-9a5d-1a2561a60c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:19.867208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895465b7-1a58-4bae-9a5d-1a2561a60c17 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:19.867485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895465b7-1a58-4bae-9a5d-1a2561a60c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:19.867764 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895465b7-1a58-4bae-9a5d-1a2561a60c17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:19.868937 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895465b7-1a58-4bae-9a5d-1a2561a60c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:19.870354 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895465b7-1a58-4bae-9a5d-1a2561a60c17 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:19.871906 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 579/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:54:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:19.878531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb49b7-2b5a-4631-ac33-9baac67b857d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:19.969835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb49b7-2b5a-4631-ac33-9baac67b857d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:20.001858 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d175d2-7d82-445d-8d39-789f1be3686c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:20.002576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d175d2-7d82-445d-8d39-789f1be3686c None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:20.002911 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d175d2-7d82-445d-8d39-789f1be3686c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:20.003221 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d175d2-7d82-445d-8d39-789f1be3686c None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:20.003927 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d175d2-7d82-445d-8d39-789f1be3686c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:20.005392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d175d2-7d82-445d-8d39-789f1be3686c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:20.025085 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 559/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:54:19 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:54:22.380865 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd32eb-2bd3-4887-b24d-a0b3d8102319 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:22.381398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd32eb-2bd3-4887-b24d-a0b3d8102319 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:22.381398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd32eb-2bd3-4887-b24d-a0b3d8102319 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:22.383189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 580/1139] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:54:22.388565 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4bc70-4ddc-4a9f-94a2-1dea09fe57e3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:22.389017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4bc70-4ddc-4a9f-94a2-1dea09fe57e3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:22.389166 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4bc70-4ddc-4a9f-94a2-1dea09fe57e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:22.406443 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e8c4bc70-4ddc-4a9f-94a2-1dea09fe57e3 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:22.407607 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e8c4bc70-4ddc-4a9f-94a2-1dea09fe57e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:22.471035 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 560/1140] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:54:22.494924 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd32eb-2bd3-4887-b24d-a0b3d8102319 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:22.590459 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd32eb-2bd3-4887-b24d-a0b3d8102319 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:22.621542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6e7f2-f6d8-48ce-9633-88c6605b1761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:22.622302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6e7f2-f6d8-48ce-9633-88c6605b1761 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:22.622578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6e7f2-f6d8-48ce-9633-88c6605b1761 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:22.623102 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6e7f2-f6d8-48ce-9633-88c6605b1761 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:22.633371 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6e7f2-f6d8-48ce-9633-88c6605b1761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:54:22.640033 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-bfe6e7f2-f6d8-48ce-9633-88c6605b1761 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:54:22.641195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 581/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:54:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:54:22.647791 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4bc70-4ddc-4a9f-94a2-1dea09fe57e3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:22.741486 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4bc70-4ddc-4a9f-94a2-1dea09fe57e3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:22.772769 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df481a-447e-4bde-8a77-989c5adf052c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:22.773453 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df481a-447e-4bde-8a77-989c5adf052c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:22.773734 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df481a-447e-4bde-8a77-989c5adf052c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:22.774007 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df481a-447e-4bde-8a77-989c5adf052c None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:22.774741 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df481a-447e-4bde-8a77-989c5adf052c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:22.775045 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df481a-447e-4bde-8a77-989c5adf052c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:22.776407 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df481a-447e-4bde-8a77-989c5adf052c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:22.784815 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 561/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:54:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:22.790410 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6e7f2-f6d8-48ce-9633-88c6605b1761 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:22.884202 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6e7f2-f6d8-48ce-9633-88c6605b1761 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:22.915297 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c7784-bdd9-40bf-882c-0fe379449212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:22.916135 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c7784-bdd9-40bf-882c-0fe379449212 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:22.916414 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c7784-bdd9-40bf-882c-0fe379449212 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:22.916688 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c7784-bdd9-40bf-882c-0fe379449212 None admin] PATH_INFO: `/v3/users/84f6ecc963a04fdcb52eebcef9290d87` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:22.929091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c7784-bdd9-40bf-882c-0fe379449212 None admin] RBAC: Authorizing `identity:get_user(user_id=84f6ecc963a04fdcb52eebcef9290d87)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:22.930530 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c7784-bdd9-40bf-882c-0fe379449212 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:22.932122 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 582/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:54:22 2022] GET /identity/v3/users/84f6ecc963a04fdcb52eebcef9290d87 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:22.937726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df481a-447e-4bde-8a77-989c5adf052c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:23.033376 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df481a-447e-4bde-8a77-989c5adf052c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:23.065449 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31917591-4c1a-4ede-bd21-1d040b68962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:23.066085 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31917591-4c1a-4ede-bd21-1d040b68962e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:23.066362 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31917591-4c1a-4ede-bd21-1d040b68962e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:23.066630 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31917591-4c1a-4ede-bd21-1d040b68962e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:23.129697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31917591-4c1a-4ede-bd21-1d040b68962e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:23.131113 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31917591-4c1a-4ede-bd21-1d040b68962e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:23.225257 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 562/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:54:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:54:23.231085 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c7784-bdd9-40bf-882c-0fe379449212 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:23.323925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c7784-bdd9-40bf-882c-0fe379449212 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:23.355673 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a90b7-6f05-4f8e-b6cb-7b519d63a292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:23.356509 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a90b7-6f05-4f8e-b6cb-7b519d63a292 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:23.356785 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a90b7-6f05-4f8e-b6cb-7b519d63a292 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:23.357082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a90b7-6f05-4f8e-b6cb-7b519d63a292 None admin] PATH_INFO: `/v3/projects/4b89fa06112f478ca0eabbb4f1b69224` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:23.358238 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a90b7-6f05-4f8e-b6cb-7b519d63a292 None admin] RBAC: Authorizing `identity:get_project(project_id=4b89fa06112f478ca0eabbb4f1b69224)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:23.359658 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a90b7-6f05-4f8e-b6cb-7b519d63a292 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:23.361318 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 583/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:54:23 2022] GET /identity/v3/projects/4b89fa06112f478ca0eabbb4f1b69224 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:23.367255 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31917591-4c1a-4ede-bd21-1d040b68962e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:23.460259 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31917591-4c1a-4ede-bd21-1d040b68962e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:23.491472 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b7014-0960-4d34-b365-0b673f52e69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:23.492052 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b7014-0960-4d34-b365-0b673f52e69c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:23.492325 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b7014-0960-4d34-b365-0b673f52e69c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:23.492597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b7014-0960-4d34-b365-0b673f52e69c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:23.493441 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b7014-0960-4d34-b365-0b673f52e69c None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=4b89fa06112f478ca0eabbb4f1b69224, user.id=84f6ecc963a04fdcb52eebcef9290d87) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:23.493746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b7014-0960-4d34-b365-0b673f52e69c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:23.495154 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b7014-0960-4d34-b365-0b673f52e69c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:23.500708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 563/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:54:23 2022] GET /identity/v3/role_assignments?user.id=84f6ecc963a04fdcb52eebcef9290d87&scope.project.id=4b89fa06112f478ca0eabbb4f1b69224&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:25.790600 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebfb4c-bf4d-4071-af75-24da2aaecfbc None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:25.791175 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebfb4c-bf4d-4071-af75-24da2aaecfbc None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:25.791175 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebfb4c-bf4d-4071-af75-24da2aaecfbc None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:25.792952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 584/1147] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:54:25.798352 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366aee0-b5a0-4ec0-bd53-d0bd0ff40854 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:25.798739 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366aee0-b5a0-4ec0-bd53-d0bd0ff40854 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:25.798896 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366aee0-b5a0-4ec0-bd53-d0bd0ff40854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:25.815851 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9366aee0-b5a0-4ec0-bd53-d0bd0ff40854 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:25.817052 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9366aee0-b5a0-4ec0-bd53-d0bd0ff40854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:25.879152 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 564/1148] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:54:25.901433 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebfb4c-bf4d-4071-af75-24da2aaecfbc None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:25.997254 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebfb4c-bf4d-4071-af75-24da2aaecfbc None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:26.030624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e473e0-7b26-4c4f-b10c-c78cd3a12886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:26.031401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e473e0-7b26-4c4f-b10c-c78cd3a12886 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:26.031682 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e473e0-7b26-4c4f-b10c-c78cd3a12886 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:26.031955 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e473e0-7b26-4c4f-b10c-c78cd3a12886 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:26.042434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e473e0-7b26-4c4f-b10c-c78cd3a12886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:54:26.049263 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-32e473e0-7b26-4c4f-b10c-c78cd3a12886 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:54:26.051121 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 585/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:54:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:54:26.057217 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366aee0-b5a0-4ec0-bd53-d0bd0ff40854 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:26.150356 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366aee0-b5a0-4ec0-bd53-d0bd0ff40854 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:26.181828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477c2ba-64a5-425b-9dde-cf62992f0e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:26.182481 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477c2ba-64a5-425b-9dde-cf62992f0e20 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:26.182759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477c2ba-64a5-425b-9dde-cf62992f0e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:26.183033 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477c2ba-64a5-425b-9dde-cf62992f0e20 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:26.183763 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477c2ba-64a5-425b-9dde-cf62992f0e20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:26.184062 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477c2ba-64a5-425b-9dde-cf62992f0e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:26.185441 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477c2ba-64a5-425b-9dde-cf62992f0e20 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:26.193718 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 565/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:54:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:26.199754 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e473e0-7b26-4c4f-b10c-c78cd3a12886 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:26.291878 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e473e0-7b26-4c4f-b10c-c78cd3a12886 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:26.323905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776271f-fe06-4cf0-9e58-ccca547ba329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:26.324692 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776271f-fe06-4cf0-9e58-ccca547ba329 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:26.325008 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776271f-fe06-4cf0-9e58-ccca547ba329 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:26.325279 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776271f-fe06-4cf0-9e58-ccca547ba329 None admin] PATH_INFO: `/v3/users/84f6ecc963a04fdcb52eebcef9290d87` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:26.326440 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776271f-fe06-4cf0-9e58-ccca547ba329 None admin] RBAC: Authorizing `identity:get_user(user_id=84f6ecc963a04fdcb52eebcef9290d87)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:26.327859 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776271f-fe06-4cf0-9e58-ccca547ba329 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:26.329482 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 586/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:54:26 2022] GET /identity/v3/users/84f6ecc963a04fdcb52eebcef9290d87 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:26.335256 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477c2ba-64a5-425b-9dde-cf62992f0e20 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:26.430374 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477c2ba-64a5-425b-9dde-cf62992f0e20 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:26.462238 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1778e-156f-402f-ba67-7fa0fa2f0142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:26.463082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1778e-156f-402f-ba67-7fa0fa2f0142 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:26.463357 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1778e-156f-402f-ba67-7fa0fa2f0142 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:26.463626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1778e-156f-402f-ba67-7fa0fa2f0142 None admin] PATH_INFO: `/v3/projects/4b89fa06112f478ca0eabbb4f1b69224` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:26.464774 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1778e-156f-402f-ba67-7fa0fa2f0142 None admin] RBAC: Authorizing `identity:get_project(project_id=4b89fa06112f478ca0eabbb4f1b69224)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:26.466226 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1778e-156f-402f-ba67-7fa0fa2f0142 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:26.467869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 566/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:54:26 2022] GET /identity/v3/projects/4b89fa06112f478ca0eabbb4f1b69224 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:26.474391 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776271f-fe06-4cf0-9e58-ccca547ba329 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:26.568191 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776271f-fe06-4cf0-9e58-ccca547ba329 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:26.599275 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ecb12-417b-44e3-874a-26b023b99894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:26.600108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ecb12-417b-44e3-874a-26b023b99894 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:26.600376 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ecb12-417b-44e3-874a-26b023b99894 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:26.600640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ecb12-417b-44e3-874a-26b023b99894 None admin] PATH_INFO: `/v3/projects/4b89fa06112f478ca0eabbb4f1b69224/users/84f6ecc963a04fdcb52eebcef9290d87/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:26.602610 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ecb12-417b-44e3-874a-26b023b99894 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b89fa06112f478ca0eabbb4f1b69224, user_id=84f6ecc963a04fdcb52eebcef9290d87, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:26.604043 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ecb12-417b-44e3-874a-26b023b99894 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:26.617206 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 587/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:54:26 2022] PUT /identity/v3/projects/4b89fa06112f478ca0eabbb4f1b69224/users/84f6ecc963a04fdcb52eebcef9290d87/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:54:28.914193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2093d73-e96f-40d6-ba96-6ec128e04206 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:28.914739 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2093d73-e96f-40d6-ba96-6ec128e04206 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:28.914739 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2093d73-e96f-40d6-ba96-6ec128e04206 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:28.916540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 567/1154] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:54:28.921609 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1440d38-5bc0-4110-93cf-d53ddf95d88e None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:28.921998 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1440d38-5bc0-4110-93cf-d53ddf95d88e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:28.922159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1440d38-5bc0-4110-93cf-d53ddf95d88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:28.938967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b1440d38-5bc0-4110-93cf-d53ddf95d88e None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:28.940193 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b1440d38-5bc0-4110-93cf-d53ddf95d88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:29.003647 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 588/1155] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:54:29.027380 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2093d73-e96f-40d6-ba96-6ec128e04206 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:29.121908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2093d73-e96f-40d6-ba96-6ec128e04206 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:29.153294 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f21da-5abf-426f-bd77-3700f7ee6eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:29.154069 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f21da-5abf-426f-bd77-3700f7ee6eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:29.154348 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f21da-5abf-426f-bd77-3700f7ee6eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:29.154622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f21da-5abf-426f-bd77-3700f7ee6eb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:29.164740 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f21da-5abf-426f-bd77-3700f7ee6eb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:54:29.171502 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-4a2f21da-5abf-426f-bd77-3700f7ee6eb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:54:29.172640 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 568/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:54:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:54:29.179090 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1440d38-5bc0-4110-93cf-d53ddf95d88e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:29.273956 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1440d38-5bc0-4110-93cf-d53ddf95d88e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:29.305544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9f09f-3590-4e70-8a63-969256e8be55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:29.306199 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9f09f-3590-4e70-8a63-969256e8be55 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:29.306481 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9f09f-3590-4e70-8a63-969256e8be55 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:29.306756 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9f09f-3590-4e70-8a63-969256e8be55 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:29.307493 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9f09f-3590-4e70-8a63-969256e8be55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:29.307797 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9f09f-3590-4e70-8a63-969256e8be55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:29.309185 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9f09f-3590-4e70-8a63-969256e8be55 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:29.317536 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 589/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:54:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:29.323246 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f21da-5abf-426f-bd77-3700f7ee6eb5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:29.416759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f21da-5abf-426f-bd77-3700f7ee6eb5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:29.448390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950170b-e696-4261-b3e3-cb36afcf0f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:29.449264 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950170b-e696-4261-b3e3-cb36afcf0f00 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:29.449542 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950170b-e696-4261-b3e3-cb36afcf0f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:29.449812 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950170b-e696-4261-b3e3-cb36afcf0f00 None admin] PATH_INFO: `/v3/users/84f6ecc963a04fdcb52eebcef9290d87` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:29.450972 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950170b-e696-4261-b3e3-cb36afcf0f00 None admin] RBAC: Authorizing `identity:get_user(user_id=84f6ecc963a04fdcb52eebcef9290d87)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:29.452410 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950170b-e696-4261-b3e3-cb36afcf0f00 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:29.454019 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 569/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:54:29 2022] GET /identity/v3/users/84f6ecc963a04fdcb52eebcef9290d87 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:29.460250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9f09f-3590-4e70-8a63-969256e8be55 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:29.555559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9f09f-3590-4e70-8a63-969256e8be55 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:29.586988 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d2ad5-da96-4e4e-96b7-b9e72dcbe707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:29.587611 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d2ad5-da96-4e4e-96b7-b9e72dcbe707 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:29.587886 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d2ad5-da96-4e4e-96b7-b9e72dcbe707 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:29.588157 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d2ad5-da96-4e4e-96b7-b9e72dcbe707 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:29.650594 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d2ad5-da96-4e4e-96b7-b9e72dcbe707 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:29.652022 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d2ad5-da96-4e4e-96b7-b9e72dcbe707 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:29.743587 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 590/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:54:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:54:29.749614 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950170b-e696-4261-b3e3-cb36afcf0f00 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:29.842079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950170b-e696-4261-b3e3-cb36afcf0f00 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:29.873554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c2195-18c2-4094-ab90-a80d10355649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:29.874389 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c2195-18c2-4094-ab90-a80d10355649 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:29.874666 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c2195-18c2-4094-ab90-a80d10355649 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:29.874937 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c2195-18c2-4094-ab90-a80d10355649 None admin] PATH_INFO: `/v3/projects/4b89fa06112f478ca0eabbb4f1b69224` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:29.876080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c2195-18c2-4094-ab90-a80d10355649 None admin] RBAC: Authorizing `identity:get_project(project_id=4b89fa06112f478ca0eabbb4f1b69224)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:29.877659 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c2195-18c2-4094-ab90-a80d10355649 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:29.879289 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 570/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:54:29 2022] GET /identity/v3/projects/4b89fa06112f478ca0eabbb4f1b69224 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:29.885210 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d2ad5-da96-4e4e-96b7-b9e72dcbe707 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:29.977980 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d2ad5-da96-4e4e-96b7-b9e72dcbe707 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:30.010979 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea5f0f-40d5-42dc-a047-0c7746536f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:30.011556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea5f0f-40d5-42dc-a047-0c7746536f18 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:30.011830 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea5f0f-40d5-42dc-a047-0c7746536f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:30.012097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea5f0f-40d5-42dc-a047-0c7746536f18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:30.012934 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea5f0f-40d5-42dc-a047-0c7746536f18 None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=4b89fa06112f478ca0eabbb4f1b69224, user.id=84f6ecc963a04fdcb52eebcef9290d87) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:30.013242 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea5f0f-40d5-42dc-a047-0c7746536f18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:30.014649 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea5f0f-40d5-42dc-a047-0c7746536f18 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:30.020516 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 591/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:54:29 2022] GET /identity/v3/role_assignments?user.id=84f6ecc963a04fdcb52eebcef9290d87&scope.project.id=4b89fa06112f478ca0eabbb4f1b69224&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:32.363126 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec769cab-9c00-4f18-b8c3-48a9b4c68934 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:32.363644 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec769cab-9c00-4f18-b8c3-48a9b4c68934 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:32.363736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec769cab-9c00-4f18-b8c3-48a9b4c68934 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:32.365497 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 571/1162] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:54:32.370587 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7d565-ac2e-4354-9c20-68302c38826c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:32.370956 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7d565-ac2e-4354-9c20-68302c38826c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:32.371147 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7d565-ac2e-4354-9c20-68302c38826c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:32.388287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e0b7d565-ac2e-4354-9c20-68302c38826c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:32.389487 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e0b7d565-ac2e-4354-9c20-68302c38826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:32.451693 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 592/1163] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:54:32.476133 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec769cab-9c00-4f18-b8c3-48a9b4c68934 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:32.572237 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec769cab-9c00-4f18-b8c3-48a9b4c68934 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:32.604168 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01781c71-147b-4b30-83e9-46222db24cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:32.604823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01781c71-147b-4b30-83e9-46222db24cba None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:32.605111 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01781c71-147b-4b30-83e9-46222db24cba None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:32.605385 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01781c71-147b-4b30-83e9-46222db24cba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:32.668395 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01781c71-147b-4b30-83e9-46222db24cba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:32.669813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01781c71-147b-4b30-83e9-46222db24cba None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:32.761389 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 572/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:54:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:54:32.767473 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7d565-ac2e-4354-9c20-68302c38826c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:32.860320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7d565-ac2e-4354-9c20-68302c38826c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:32.891866 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5816da7-6eb0-4869-b509-0db935c494be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:32.893202 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5816da7-6eb0-4869-b509-0db935c494be None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:32.893558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5816da7-6eb0-4869-b509-0db935c494be None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:32.893828 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5816da7-6eb0-4869-b509-0db935c494be None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:32.900220 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5816da7-6eb0-4869-b509-0db935c494be None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:32.901686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5816da7-6eb0-4869-b509-0db935c494be None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:32.914793 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-d5816da7-6eb0-4869-b509-0db935c494be None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 27 04:54:32.915919 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 593/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 27 04:54:32 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:54:32.921735 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01781c71-147b-4b30-83e9-46222db24cba None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:33.016584 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01781c71-147b-4b30-83e9-46222db24cba None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:33.048085 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d623c-62dd-477b-a575-4d3cfe9658ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:33.048736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d623c-62dd-477b-a575-4d3cfe9658ee None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:33.049567 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d623c-62dd-477b-a575-4d3cfe9658ee None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:33.049836 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d623c-62dd-477b-a575-4d3cfe9658ee None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:33.050543 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d623c-62dd-477b-a575-4d3cfe9658ee None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:33.050842 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d623c-62dd-477b-a575-4d3cfe9658ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:33.052190 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d623c-62dd-477b-a575-4d3cfe9658ee None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:33.058984 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 573/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Sep 27 04:54:32 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:35.505795 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775363e-61ea-4373-8c96-b7eb1215fac2 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:35.506338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775363e-61ea-4373-8c96-b7eb1215fac2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:35.506338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775363e-61ea-4373-8c96-b7eb1215fac2 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:35.508109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 594/1167] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:54:35.513218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bd8ef-341c-4b15-9473-732e1077af13 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:35.513581 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bd8ef-341c-4b15-9473-732e1077af13 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:35.513783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bd8ef-341c-4b15-9473-732e1077af13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:35.530738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e86bd8ef-341c-4b15-9473-732e1077af13 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:35.531915 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e86bd8ef-341c-4b15-9473-732e1077af13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:35.594375 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 574/1168] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:54:35.618108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775363e-61ea-4373-8c96-b7eb1215fac2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:35.714657 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775363e-61ea-4373-8c96-b7eb1215fac2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:35.745838 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e957c38-fe1b-4abf-b495-bfcd0ae63765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:35.746534 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e957c38-fe1b-4abf-b495-bfcd0ae63765 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:35.746743 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e957c38-fe1b-4abf-b495-bfcd0ae63765 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:35.747009 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e957c38-fe1b-4abf-b495-bfcd0ae63765 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:35.747724 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e957c38-fe1b-4abf-b495-bfcd0ae63765 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:35.749378 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e957c38-fe1b-4abf-b495-bfcd0ae63765 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:35.764743 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 595/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Tue Sep 27 04:54:35 2022] POST /identity/v3/domains => generated 267 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:54:38.087560 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033199dc-12aa-4b63-8ee1-dfe79a384cff None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:38.088070 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033199dc-12aa-4b63-8ee1-dfe79a384cff None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:38.088158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033199dc-12aa-4b63-8ee1-dfe79a384cff None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:38.090050 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 575/1170] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:54:38.095182 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc6cdd-7260-47b1-85d2-bc383921ba33 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:38.095608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc6cdd-7260-47b1-85d2-bc383921ba33 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:38.095798 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc6cdd-7260-47b1-85d2-bc383921ba33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:38.114255 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a0bc6cdd-7260-47b1-85d2-bc383921ba33 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:38.117764 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a0bc6cdd-7260-47b1-85d2-bc383921ba33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:38.183269 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 596/1171] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:54:38.207312 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033199dc-12aa-4b63-8ee1-dfe79a384cff None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:38.306235 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033199dc-12aa-4b63-8ee1-dfe79a384cff None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:38.338653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cf5d9-ec6e-4fd7-83fe-b32967853ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:38.339508 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cf5d9-ec6e-4fd7-83fe-b32967853ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:38.339782 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cf5d9-ec6e-4fd7-83fe-b32967853ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:38.340052 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cf5d9-ec6e-4fd7-83fe-b32967853ef5 None admin] PATH_INFO: `/v3/domains/b05efd997c6a438490f369b4bde7b625` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:38.350527 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cf5d9-ec6e-4fd7-83fe-b32967853ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b05efd997c6a438490f369b4bde7b625)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:38.351974 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cf5d9-ec6e-4fd7-83fe-b32967853ef5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:38.353610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 576/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Tue Sep 27 04:54:38 2022] GET /identity/v3/domains/b05efd997c6a438490f369b4bde7b625 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:38.359439 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc6cdd-7260-47b1-85d2-bc383921ba33 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:38.453155 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc6cdd-7260-47b1-85d2-bc383921ba33 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:38.485494 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1176d91-6647-4db5-a3cc-a30db3785bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:38.486129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1176d91-6647-4db5-a3cc-a30db3785bae None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:38.486484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1176d91-6647-4db5-a3cc-a30db3785bae None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:38.486992 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1176d91-6647-4db5-a3cc-a30db3785bae None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:38.487702 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1176d91-6647-4db5-a3cc-a30db3785bae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:38.489180 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1176d91-6647-4db5-a3cc-a30db3785bae None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:38.513440 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 597/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 27 04:54:38 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:54:40.863810 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f581b-bca0-4c05-93aa-ced7e8492969 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:40.864369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f581b-bca0-4c05-93aa-ced7e8492969 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:40.864369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f581b-bca0-4c05-93aa-ced7e8492969 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:40.866156 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 577/1174] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:54:40.871465 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ffbef-0e08-42a7-a709-975f2aa66939 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:40.871882 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ffbef-0e08-42a7-a709-975f2aa66939 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:40.872024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ffbef-0e08-42a7-a709-975f2aa66939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:40.888853 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-829ffbef-0e08-42a7-a709-975f2aa66939 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:40.890025 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-829ffbef-0e08-42a7-a709-975f2aa66939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:40.952131 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 598/1175] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:54:40.978247 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f581b-bca0-4c05-93aa-ced7e8492969 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:41.073138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f581b-bca0-4c05-93aa-ced7e8492969 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:41.105071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cf2f2-7d4c-4a92-aa79-6eba08d0f981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:41.105921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cf2f2-7d4c-4a92-aa79-6eba08d0f981 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:41.106198 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cf2f2-7d4c-4a92-aa79-6eba08d0f981 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:41.106472 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cf2f2-7d4c-4a92-aa79-6eba08d0f981 None admin] PATH_INFO: `/v3/domains/b05efd997c6a438490f369b4bde7b625` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:41.107638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cf2f2-7d4c-4a92-aa79-6eba08d0f981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b05efd997c6a438490f369b4bde7b625)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:41.109088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cf2f2-7d4c-4a92-aa79-6eba08d0f981 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:41.110673 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 578/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Tue Sep 27 04:54:40 2022] GET /identity/v3/domains/b05efd997c6a438490f369b4bde7b625 => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:41.116578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ffbef-0e08-42a7-a709-975f2aa66939 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:41.208872 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ffbef-0e08-42a7-a709-975f2aa66939 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:41.245963 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da9293-fd6c-4dfd-9c5e-b2ef84eadbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:41.246621 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da9293-fd6c-4dfd-9c5e-b2ef84eadbb7 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:41.246899 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da9293-fd6c-4dfd-9c5e-b2ef84eadbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:41.247170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da9293-fd6c-4dfd-9c5e-b2ef84eadbb7 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:41.247870 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da9293-fd6c-4dfd-9c5e-b2ef84eadbb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:41.249575 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da9293-fd6c-4dfd-9c5e-b2ef84eadbb7 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:41.268976 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 599/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:54:41 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:54:43.625734 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17359075-91e8-4d01-a428-b2de0d521489 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:43.626283 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17359075-91e8-4d01-a428-b2de0d521489 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:43.626283 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17359075-91e8-4d01-a428-b2de0d521489 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:43.628673 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 579/1178] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:54:43.633894 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4a85a-796e-44ae-bb82-36a7030871a3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:43.634294 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4a85a-796e-44ae-bb82-36a7030871a3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:43.634447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4a85a-796e-44ae-bb82-36a7030871a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:43.651644 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f8a4a85a-796e-44ae-bb82-36a7030871a3 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:43.652847 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f8a4a85a-796e-44ae-bb82-36a7030871a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:43.715241 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 600/1179] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:54:43.738756 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17359075-91e8-4d01-a428-b2de0d521489 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:43.833560 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17359075-91e8-4d01-a428-b2de0d521489 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:43.864431 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920087c-9e9c-4179-a535-cb54cbbfa636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:43.865231 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920087c-9e9c-4179-a535-cb54cbbfa636 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:43.865506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920087c-9e9c-4179-a535-cb54cbbfa636 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:43.865778 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920087c-9e9c-4179-a535-cb54cbbfa636 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:43.875896 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920087c-9e9c-4179-a535-cb54cbbfa636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:54:43.883340 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-a920087c-9e9c-4179-a535-cb54cbbfa636 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:54:43.884477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 580/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:54:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:54:43.890294 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4a85a-796e-44ae-bb82-36a7030871a3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:43.983031 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4a85a-796e-44ae-bb82-36a7030871a3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:44.017332 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f956b-fab3-41c8-bac9-d2b4d49fffba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:44.018274 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f956b-fab3-41c8-bac9-d2b4d49fffba None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:44.018556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f956b-fab3-41c8-bac9-d2b4d49fffba None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:44.018824 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f956b-fab3-41c8-bac9-d2b4d49fffba None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:44.019552 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f956b-fab3-41c8-bac9-d2b4d49fffba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:44.019849 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f956b-fab3-41c8-bac9-d2b4d49fffba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:44.021225 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f956b-fab3-41c8-bac9-d2b4d49fffba None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:44.028702 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 601/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:54:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:44.034467 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920087c-9e9c-4179-a535-cb54cbbfa636 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:44.129191 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920087c-9e9c-4179-a535-cb54cbbfa636 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:44.160249 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94990b4-1eb5-48d5-893e-b4a2b54d6973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:44.161124 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94990b4-1eb5-48d5-893e-b4a2b54d6973 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:44.161402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94990b4-1eb5-48d5-893e-b4a2b54d6973 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:44.161674 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94990b4-1eb5-48d5-893e-b4a2b54d6973 None admin] PATH_INFO: `/v3/users/c06ab4363e664f25aa3de750c881b1b3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:44.174363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94990b4-1eb5-48d5-893e-b4a2b54d6973 None admin] RBAC: Authorizing `identity:get_user(user_id=c06ab4363e664f25aa3de750c881b1b3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:44.175973 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94990b4-1eb5-48d5-893e-b4a2b54d6973 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:44.177598 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 581/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:54:44 2022] GET /identity/v3/users/c06ab4363e664f25aa3de750c881b1b3 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:54:44.183185 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f956b-fab3-41c8-bac9-d2b4d49fffba None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:44.276829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f956b-fab3-41c8-bac9-d2b4d49fffba None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:44.308009 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d337f-9a05-4c99-ac8a-bbc2ebfa6d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:44.308633 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d337f-9a05-4c99-ac8a-bbc2ebfa6d1d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:44.308938 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d337f-9a05-4c99-ac8a-bbc2ebfa6d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:44.309212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d337f-9a05-4c99-ac8a-bbc2ebfa6d1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:44.372405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d337f-9a05-4c99-ac8a-bbc2ebfa6d1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:44.374129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d337f-9a05-4c99-ac8a-bbc2ebfa6d1d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:44.465989 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 602/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:54:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:54:44.472562 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94990b4-1eb5-48d5-893e-b4a2b54d6973 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:44.566154 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94990b4-1eb5-48d5-893e-b4a2b54d6973 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:44.599940 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f857c71-af5b-441a-83b5-8de27d832f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:44.600798 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f857c71-af5b-441a-83b5-8de27d832f56 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:44.601094 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f857c71-af5b-441a-83b5-8de27d832f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:44.601380 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f857c71-af5b-441a-83b5-8de27d832f56 None admin] PATH_INFO: `/v3/projects/d1119ee158f644b58b95715d3df33d2b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:44.602562 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f857c71-af5b-441a-83b5-8de27d832f56 None admin] RBAC: Authorizing `identity:get_project(project_id=d1119ee158f644b58b95715d3df33d2b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:44.603989 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f857c71-af5b-441a-83b5-8de27d832f56 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:44.605662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 582/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:54:44 2022] GET /identity/v3/projects/d1119ee158f644b58b95715d3df33d2b => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:54:44.612110 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d337f-9a05-4c99-ac8a-bbc2ebfa6d1d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:44.706850 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d337f-9a05-4c99-ac8a-bbc2ebfa6d1d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:44.739084 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abff0e-0984-4b2b-bf10-433edc3cec11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:44.739682 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abff0e-0984-4b2b-bf10-433edc3cec11 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:44.739955 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abff0e-0984-4b2b-bf10-433edc3cec11 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:44.740222 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abff0e-0984-4b2b-bf10-433edc3cec11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:44.741055 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abff0e-0984-4b2b-bf10-433edc3cec11 None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=d1119ee158f644b58b95715d3df33d2b, user.id=c06ab4363e664f25aa3de750c881b1b3) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:44.741356 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abff0e-0984-4b2b-bf10-433edc3cec11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:44.742764 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abff0e-0984-4b2b-bf10-433edc3cec11 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:44.747890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 603/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:54:44 2022] GET /identity/v3/role_assignments?user.id=c06ab4363e664f25aa3de750c881b1b3&scope.project.id=d1119ee158f644b58b95715d3df33d2b&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:47.038731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e9902-3da6-49f4-a012-45d82c9507b1 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:47.039329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e9902-3da6-49f4-a012-45d82c9507b1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:47.039329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e9902-3da6-49f4-a012-45d82c9507b1 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:47.041054 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 583/1186] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:54:47.046190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490d63f-73d5-4b83-bd5a-eadd884637cf None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:47.046574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490d63f-73d5-4b83-bd5a-eadd884637cf None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:47.046745 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490d63f-73d5-4b83-bd5a-eadd884637cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:47.063644 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a490d63f-73d5-4b83-bd5a-eadd884637cf None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:47.065518 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a490d63f-73d5-4b83-bd5a-eadd884637cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:47.127807 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 604/1187] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:54:47.150300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e9902-3da6-49f4-a012-45d82c9507b1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:47.246374 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e9902-3da6-49f4-a012-45d82c9507b1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:47.278384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc4edf-5281-43af-8d5f-2fa62fe9c588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:47.279156 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc4edf-5281-43af-8d5f-2fa62fe9c588 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:47.279430 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc4edf-5281-43af-8d5f-2fa62fe9c588 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:47.279699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc4edf-5281-43af-8d5f-2fa62fe9c588 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:47.289407 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc4edf-5281-43af-8d5f-2fa62fe9c588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:54:47.296109 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-38fc4edf-5281-43af-8d5f-2fa62fe9c588 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:54:47.297270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 584/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:54:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:54:47.303893 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490d63f-73d5-4b83-bd5a-eadd884637cf None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:47.396882 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490d63f-73d5-4b83-bd5a-eadd884637cf None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:47.429628 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683cb42-f710-4488-890e-185c6a66e172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:47.430271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683cb42-f710-4488-890e-185c6a66e172 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:47.430547 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683cb42-f710-4488-890e-185c6a66e172 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:47.430819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683cb42-f710-4488-890e-185c6a66e172 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:47.431543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683cb42-f710-4488-890e-185c6a66e172 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:47.431844 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683cb42-f710-4488-890e-185c6a66e172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:47.433235 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683cb42-f710-4488-890e-185c6a66e172 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:47.441653 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 605/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:54:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:47.447394 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc4edf-5281-43af-8d5f-2fa62fe9c588 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:47.540430 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc4edf-5281-43af-8d5f-2fa62fe9c588 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:47.571729 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5d5fb-a620-4cc7-ab6f-0be2af6b1377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:47.572583 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5d5fb-a620-4cc7-ab6f-0be2af6b1377 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:47.572873 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5d5fb-a620-4cc7-ab6f-0be2af6b1377 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:47.573150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5d5fb-a620-4cc7-ab6f-0be2af6b1377 None admin] PATH_INFO: `/v3/users/c06ab4363e664f25aa3de750c881b1b3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:47.574319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5d5fb-a620-4cc7-ab6f-0be2af6b1377 None admin] RBAC: Authorizing `identity:get_user(user_id=c06ab4363e664f25aa3de750c881b1b3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:47.575743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5d5fb-a620-4cc7-ab6f-0be2af6b1377 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:47.577351 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 585/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:54:47 2022] GET /identity/v3/users/c06ab4363e664f25aa3de750c881b1b3 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:47.583268 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683cb42-f710-4488-890e-185c6a66e172 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:47.676186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683cb42-f710-4488-890e-185c6a66e172 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:47.707320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d8bdb-f2f0-45d1-ba54-c9be67a07b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:47.708163 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d8bdb-f2f0-45d1-ba54-c9be67a07b95 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:47.708441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d8bdb-f2f0-45d1-ba54-c9be67a07b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:47.708714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d8bdb-f2f0-45d1-ba54-c9be67a07b95 None admin] PATH_INFO: `/v3/projects/d1119ee158f644b58b95715d3df33d2b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:47.709912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d8bdb-f2f0-45d1-ba54-c9be67a07b95 None admin] RBAC: Authorizing `identity:get_project(project_id=d1119ee158f644b58b95715d3df33d2b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:47.711332 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d8bdb-f2f0-45d1-ba54-c9be67a07b95 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:47.713011 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 606/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:54:47 2022] GET /identity/v3/projects/d1119ee158f644b58b95715d3df33d2b => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:47.718704 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5d5fb-a620-4cc7-ab6f-0be2af6b1377 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:47.811855 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5d5fb-a620-4cc7-ab6f-0be2af6b1377 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:47.843055 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ea805-d913-45b5-ba61-ab0aacc2950a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:47.843921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ea805-d913-45b5-ba61-ab0aacc2950a None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:47.844199 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ea805-d913-45b5-ba61-ab0aacc2950a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:47.844471 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ea805-d913-45b5-ba61-ab0aacc2950a None admin] PATH_INFO: `/v3/projects/d1119ee158f644b58b95715d3df33d2b/users/c06ab4363e664f25aa3de750c881b1b3/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:47.847052 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ea805-d913-45b5-ba61-ab0aacc2950a None admin] RBAC: Authorizing `identity:create_grant(project_id=d1119ee158f644b58b95715d3df33d2b, user_id=c06ab4363e664f25aa3de750c881b1b3, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:47.848470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ea805-d913-45b5-ba61-ab0aacc2950a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:47.860931 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 586/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:54:47 2022] PUT /identity/v3/projects/d1119ee158f644b58b95715d3df33d2b/users/c06ab4363e664f25aa3de750c881b1b3/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:54:50.164774 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208f3d7-92e9-4f0c-a650-5180c8aafdd5 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:50.165338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208f3d7-92e9-4f0c-a650-5180c8aafdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:50.165338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208f3d7-92e9-4f0c-a650-5180c8aafdd5 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:50.167119 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 607/1193] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:54:50.172234 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333823e2-5863-46c6-98c2-5939218b7881 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:50.172638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333823e2-5863-46c6-98c2-5939218b7881 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:50.172810 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333823e2-5863-46c6-98c2-5939218b7881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:50.190857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-333823e2-5863-46c6-98c2-5939218b7881 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:54:50.192020 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-333823e2-5863-46c6-98c2-5939218b7881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:54:50.254508 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 587/1194] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:54:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:54:50.277333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208f3d7-92e9-4f0c-a650-5180c8aafdd5 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:50.373190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208f3d7-92e9-4f0c-a650-5180c8aafdd5 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:50.404697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d83d22-38d5-49a4-809f-36cd347bd834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:50.405491 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d83d22-38d5-49a4-809f-36cd347bd834 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:50.405774 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d83d22-38d5-49a4-809f-36cd347bd834 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:50.406045 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d83d22-38d5-49a4-809f-36cd347bd834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:50.416429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d83d22-38d5-49a4-809f-36cd347bd834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:54:50.423202 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-93d83d22-38d5-49a4-809f-36cd347bd834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:54:50.424596 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 608/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:54:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:54:50.430492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333823e2-5863-46c6-98c2-5939218b7881 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:50.522583 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333823e2-5863-46c6-98c2-5939218b7881 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:50.553316 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4116e0b-a573-4e07-8366-b4ab2bc3a417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:50.553962 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4116e0b-a573-4e07-8366-b4ab2bc3a417 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:50.554238 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4116e0b-a573-4e07-8366-b4ab2bc3a417 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:50.554510 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4116e0b-a573-4e07-8366-b4ab2bc3a417 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:50.555241 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4116e0b-a573-4e07-8366-b4ab2bc3a417 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:50.555541 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4116e0b-a573-4e07-8366-b4ab2bc3a417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:50.556920 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4116e0b-a573-4e07-8366-b4ab2bc3a417 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:50.564922 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 588/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:54:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:50.570488 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d83d22-38d5-49a4-809f-36cd347bd834 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:50.664169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d83d22-38d5-49a4-809f-36cd347bd834 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:50.696500 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d060f-8fcd-4fd2-9a52-00d2a83c9f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:50.697373 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d060f-8fcd-4fd2-9a52-00d2a83c9f72 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:50.697661 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d060f-8fcd-4fd2-9a52-00d2a83c9f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:50.697933 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d060f-8fcd-4fd2-9a52-00d2a83c9f72 None admin] PATH_INFO: `/v3/users/c06ab4363e664f25aa3de750c881b1b3` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:50.699105 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d060f-8fcd-4fd2-9a52-00d2a83c9f72 None admin] RBAC: Authorizing `identity:get_user(user_id=c06ab4363e664f25aa3de750c881b1b3)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:50.700536 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d060f-8fcd-4fd2-9a52-00d2a83c9f72 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:50.702158 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 609/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Sep 27 04:54:50 2022] GET /identity/v3/users/c06ab4363e664f25aa3de750c881b1b3 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:50.708493 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4116e0b-a573-4e07-8366-b4ab2bc3a417 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:50.802987 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4116e0b-a573-4e07-8366-b4ab2bc3a417 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:50.834332 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaeb1d-cc44-4a6b-93d7-99faafd24030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:50.834961 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaeb1d-cc44-4a6b-93d7-99faafd24030 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:50.835238 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaeb1d-cc44-4a6b-93d7-99faafd24030 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:50.835510 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaeb1d-cc44-4a6b-93d7-99faafd24030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:50.898451 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caaeb1d-cc44-4a6b-93d7-99faafd24030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:50.899898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caaeb1d-cc44-4a6b-93d7-99faafd24030 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:50.991359 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 589/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:54:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:54:50.997322 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d060f-8fcd-4fd2-9a52-00d2a83c9f72 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:51.091303 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d060f-8fcd-4fd2-9a52-00d2a83c9f72 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:51.124677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156adee5-b477-4fc0-a58e-cd24981450a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:51.125541 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156adee5-b477-4fc0-a58e-cd24981450a0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:51.125819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156adee5-b477-4fc0-a58e-cd24981450a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:51.126092 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156adee5-b477-4fc0-a58e-cd24981450a0 None admin] PATH_INFO: `/v3/projects/d1119ee158f644b58b95715d3df33d2b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:51.127308 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156adee5-b477-4fc0-a58e-cd24981450a0 None admin] RBAC: Authorizing `identity:get_project(project_id=d1119ee158f644b58b95715d3df33d2b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:51.128767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156adee5-b477-4fc0-a58e-cd24981450a0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:51.130457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 610/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Sep 27 04:54:50 2022] GET /identity/v3/projects/d1119ee158f644b58b95715d3df33d2b => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:54:51.136506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaeb1d-cc44-4a6b-93d7-99faafd24030 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:54:51.228369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaeb1d-cc44-4a6b-93d7-99faafd24030 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:54:51.260395 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112552c-4fd5-47bd-8f06-339fcf52c25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:54:51.261066 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112552c-4fd5-47bd-8f06-339fcf52c25c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:54:51.261346 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112552c-4fd5-47bd-8f06-339fcf52c25c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:54:51.261617 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112552c-4fd5-47bd-8f06-339fcf52c25c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:54:51.262434 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112552c-4fd5-47bd-8f06-339fcf52c25c None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=d1119ee158f644b58b95715d3df33d2b, user.id=c06ab4363e664f25aa3de750c881b1b3) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:54:51.262742 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112552c-4fd5-47bd-8f06-339fcf52c25c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:54:51.264162 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112552c-4fd5-47bd-8f06-339fcf52c25c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:54:51.269696 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 590/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:54:51 2022] GET /identity/v3/role_assignments?user.id=c06ab4363e664f25aa3de750c881b1b3&scope.project.id=d1119ee158f644b58b95715d3df33d2b&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:55:54.132281 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c2027-dde2-4971-a606-d5d2953ffde4 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:54.132867 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c2027-dde2-4971-a606-d5d2953ffde4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:54.132867 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c2027-dde2-4971-a606-d5d2953ffde4 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:54.134683 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 611/1201] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:55:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:55:54.140383 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb04f74-3de0-42a6-ac21-6bb408db1a35 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:54.140929 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb04f74-3de0-42a6-ac21-6bb408db1a35 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:54.141024 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb04f74-3de0-42a6-ac21-6bb408db1a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:54.164924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-eeb04f74-3de0-42a6-ac21-6bb408db1a35 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:55:54.166775 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-eeb04f74-3de0-42a6-ac21-6bb408db1a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:55:54.265032 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 591/1202] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:55:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:55:54.296593 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c2027-dde2-4971-a606-d5d2953ffde4 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:55:54.439949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c2027-dde2-4971-a606-d5d2953ffde4 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:55:54.481384 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a2061-3ab4-4b90-8d63-b4a0c2dfca5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:55:54.482328 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a2061-3ab4-4b90-8d63-b4a0c2dfca5a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:54.482676 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a2061-3ab4-4b90-8d63-b4a0c2dfca5a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:54.482970 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a2061-3ab4-4b90-8d63-b4a0c2dfca5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:54.494892 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a2061-3ab4-4b90-8d63-b4a0c2dfca5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:55:54.496525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a2061-3ab4-4b90-8d63-b4a0c2dfca5a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:55:54.516374 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-113a2061-3ab4-4b90-8d63-b4a0c2dfca5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:55:54.518581 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 612/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:55:54.524634 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb04f74-3de0-42a6-ac21-6bb408db1a35 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:55:54.636911 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb04f74-3de0-42a6-ac21-6bb408db1a35 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:55:54.679556 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2662a-9a86-4879-9a97-093081d5d41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:55:54.680305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2662a-9a86-4879-9a97-093081d5d41e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:54.680589 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2662a-9a86-4879-9a97-093081d5d41e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:54.680985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2662a-9a86-4879-9a97-093081d5d41e None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:54.681748 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2662a-9a86-4879-9a97-093081d5d41e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:55:54.682076 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2662a-9a86-4879-9a97-093081d5d41e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:55:54.683622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2662a-9a86-4879-9a97-093081d5d41e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:55:54.700717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 592/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:55:54.707463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a2061-3ab4-4b90-8d63-b4a0c2dfca5a None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:55:54.838870 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a2061-3ab4-4b90-8d63-b4a0c2dfca5a None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:55:54.878432 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225684da-a62a-4a3c-9174-b04943fe9a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:55:54.879126 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225684da-a62a-4a3c-9174-b04943fe9a60 None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:54.879432 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225684da-a62a-4a3c-9174-b04943fe9a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:54.879734 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225684da-a62a-4a3c-9174-b04943fe9a60 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:54.880695 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225684da-a62a-4a3c-9174-b04943fe9a60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:55:54.882655 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225684da-a62a-4a3c-9174-b04943fe9a60 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:55:54.920836 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 613/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Sep 27 04:55:54 2022] POST /identity/v3/users => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 04:55:57.598729 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f33108-9566-4667-9fef-7b130462892b None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:57.599313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f33108-9566-4667-9fef-7b130462892b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:57.599313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f33108-9566-4667-9fef-7b130462892b None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:57.601232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 593/1206] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:55:57.606394 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecf1db-8f78-4e13-91c2-2e3abadbfb0b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:57.606855 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecf1db-8f78-4e13-91c2-2e3abadbfb0b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:57.606952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecf1db-8f78-4e13-91c2-2e3abadbfb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:57.625651 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a3ecf1db-8f78-4e13-91c2-2e3abadbfb0b None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:55:57.627767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a3ecf1db-8f78-4e13-91c2-2e3abadbfb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:55:57.703353 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 614/1207] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:55:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:55:57.728644 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f33108-9566-4667-9fef-7b130462892b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:55:57.844023 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f33108-9566-4667-9fef-7b130462892b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:55:57.886111 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728e785-f468-4ef5-b7a1-686d96086881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:55:57.887314 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e785-f468-4ef5-b7a1-686d96086881 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:57.887530 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e785-f468-4ef5-b7a1-686d96086881 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:57.887922 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728e785-f468-4ef5-b7a1-686d96086881 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:57.901728 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728e785-f468-4ef5-b7a1-686d96086881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:55:57.909613 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-2728e785-f468-4ef5-b7a1-686d96086881 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:55:57.911996 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 594/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:55:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:55:57.918414 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecf1db-8f78-4e13-91c2-2e3abadbfb0b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:55:58.040208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecf1db-8f78-4e13-91c2-2e3abadbfb0b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:55:58.080628 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c5fc8-90b2-414b-aba7-964c145bc741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:55:58.081431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c5fc8-90b2-414b-aba7-964c145bc741 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:58.081779 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c5fc8-90b2-414b-aba7-964c145bc741 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:58.082119 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c5fc8-90b2-414b-aba7-964c145bc741 None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:58.082962 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c5fc8-90b2-414b-aba7-964c145bc741 None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:55:58.083333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c5fc8-90b2-414b-aba7-964c145bc741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:55:58.084762 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c5fc8-90b2-414b-aba7-964c145bc741 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:55:58.098669 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 615/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:55:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:55:58.101151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728e785-f468-4ef5-b7a1-686d96086881 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:55:58.334490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728e785-f468-4ef5-b7a1-686d96086881 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:55:58.371708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931bbe9-6a39-4cd4-95b3-ce07928a1271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:55:58.372498 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931bbe9-6a39-4cd4-95b3-ce07928a1271 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:58.372775 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931bbe9-6a39-4cd4-95b3-ce07928a1271 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:58.373083 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931bbe9-6a39-4cd4-95b3-ce07928a1271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:58.383705 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931bbe9-6a39-4cd4-95b3-ce07928a1271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:55:58.385477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931bbe9-6a39-4cd4-95b3-ce07928a1271 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:55:58.403454 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-e931bbe9-6a39-4cd4-95b3-ce07928a1271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:55:58.404875 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 595/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:55:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:55:58.410609 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c5fc8-90b2-414b-aba7-964c145bc741 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:55:58.520425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c5fc8-90b2-414b-aba7-964c145bc741 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:55:58.558386 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d0227-2182-4162-b556-6f5b5bf6da03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:55:58.559065 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d0227-2182-4162-b556-6f5b5bf6da03 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:58.559344 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d0227-2182-4162-b556-6f5b5bf6da03 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:58.559619 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d0227-2182-4162-b556-6f5b5bf6da03 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:58.560381 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d0227-2182-4162-b556-6f5b5bf6da03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:55:58.560657 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d0227-2182-4162-b556-6f5b5bf6da03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:55:58.562092 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d0227-2182-4162-b556-6f5b5bf6da03 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:55:58.577663 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 616/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:55:58.584200 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931bbe9-6a39-4cd4-95b3-ce07928a1271 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:55:58.691315 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931bbe9-6a39-4cd4-95b3-ce07928a1271 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:55:58.728738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5358c7d-c35e-44ca-9159-d3f4f80934c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:55:58.729924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5358c7d-c35e-44ca-9159-d3f4f80934c1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:58.730387 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5358c7d-c35e-44ca-9159-d3f4f80934c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:58.730869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5358c7d-c35e-44ca-9159-d3f4f80934c1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:58.739254 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5358c7d-c35e-44ca-9159-d3f4f80934c1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:55:58.740867 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5358c7d-c35e-44ca-9159-d3f4f80934c1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:55:58.755721 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-f5358c7d-c35e-44ca-9159-d3f4f80934c1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:55:58.761606 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 596/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:55:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:55:58.762978 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d0227-2182-4162-b556-6f5b5bf6da03 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:55:58.868210 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d0227-2182-4162-b556-6f5b5bf6da03 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:55:58.909650 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1873a9-6ef7-48bc-91e6-3b7e85db66c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:55:58.910566 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1873a9-6ef7-48bc-91e6-3b7e85db66c1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:58.911095 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1873a9-6ef7-48bc-91e6-3b7e85db66c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:58.911557 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1873a9-6ef7-48bc-91e6-3b7e85db66c1 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:58.912599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1873a9-6ef7-48bc-91e6-3b7e85db66c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:55:58.913033 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1873a9-6ef7-48bc-91e6-3b7e85db66c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:55:58.914652 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1873a9-6ef7-48bc-91e6-3b7e85db66c1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:55:58.934092 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 617/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Sep 27 04:55:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:55:58.940553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5358c7d-c35e-44ca-9159-d3f4f80934c1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:55:59.049934 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5358c7d-c35e-44ca-9159-d3f4f80934c1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:55:59.085014 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ab3ff-ad7b-41a8-be8a-684dc639537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:55:59.085726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ab3ff-ad7b-41a8-be8a-684dc639537d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:59.085979 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ab3ff-ad7b-41a8-be8a-684dc639537d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:59.086229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ab3ff-ad7b-41a8-be8a-684dc639537d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:59.160750 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ab3ff-ad7b-41a8-be8a-684dc639537d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:55:59.162573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ab3ff-ad7b-41a8-be8a-684dc639537d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:55:59.280336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 597/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:55:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:55:59.286789 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1873a9-6ef7-48bc-91e6-3b7e85db66c1 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:55:59.404334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1873a9-6ef7-48bc-91e6-3b7e85db66c1 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:55:59.441958 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96276ef-22d2-47db-99f7-2e04d4bc1149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:55:59.442820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96276ef-22d2-47db-99f7-2e04d4bc1149 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:59.443093 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96276ef-22d2-47db-99f7-2e04d4bc1149 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:59.445995 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96276ef-22d2-47db-99f7-2e04d4bc1149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:59.458794 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96276ef-22d2-47db-99f7-2e04d4bc1149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:55:59.460276 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96276ef-22d2-47db-99f7-2e04d4bc1149 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:55:59.481520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-b96276ef-22d2-47db-99f7-2e04d4bc1149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:55:59.488208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 618/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:55:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:55:59.489429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ab3ff-ad7b-41a8-be8a-684dc639537d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:55:59.608870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ab3ff-ad7b-41a8-be8a-684dc639537d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:55:59.649208 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94f695-613d-4c69-9b43-725f23cdf48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:55:59.650010 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94f695-613d-4c69-9b43-725f23cdf48d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:59.650387 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94f695-613d-4c69-9b43-725f23cdf48d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:59.650831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94f695-613d-4c69-9b43-725f23cdf48d None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:59.651789 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94f695-613d-4c69-9b43-725f23cdf48d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:55:59.652089 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94f695-613d-4c69-9b43-725f23cdf48d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:55:59.653787 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94f695-613d-4c69-9b43-725f23cdf48d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:55:59.667696 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 598/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:55:59.674040 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96276ef-22d2-47db-99f7-2e04d4bc1149 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:55:59.782837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96276ef-22d2-47db-99f7-2e04d4bc1149 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:55:59.820631 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b2e4a-7966-44ea-b42e-1216cba1d4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:55:59.821472 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b2e4a-7966-44ea-b42e-1216cba1d4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:59.821759 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b2e4a-7966-44ea-b42e-1216cba1d4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:59.822040 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b2e4a-7966-44ea-b42e-1216cba1d4a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:59.830550 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b2e4a-7966-44ea-b42e-1216cba1d4a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:55:59.832046 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b2e4a-7966-44ea-b42e-1216cba1d4a1 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:55:59.847646 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-022b2e4a-7966-44ea-b42e-1216cba1d4a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:55:59.849467 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 619/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:55:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:55:59.855337 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94f695-613d-4c69-9b43-725f23cdf48d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:55:59.957894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94f695-613d-4c69-9b43-725f23cdf48d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:55:59.994633 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044c096-ae66-4d55-9588-b794cd0ab40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:55:59.995437 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044c096-ae66-4d55-9588-b794cd0ab40e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:55:59.995783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044c096-ae66-4d55-9588-b794cd0ab40e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:55:59.996119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044c096-ae66-4d55-9588-b794cd0ab40e None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:55:59.997017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044c096-ae66-4d55-9588-b794cd0ab40e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:55:59.997514 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044c096-ae66-4d55-9588-b794cd0ab40e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:55:59.998881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044c096-ae66-4d55-9588-b794cd0ab40e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:00.012121 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 599/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:55:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:00.018721 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b2e4a-7966-44ea-b42e-1216cba1d4a1 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:00.132235 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b2e4a-7966-44ea-b42e-1216cba1d4a1 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:00.169112 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6ea57-88fe-4e16-9974-524546ae3049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:00.170080 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ea57-88fe-4e16-9974-524546ae3049 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:00.170560 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ea57-88fe-4e16-9974-524546ae3049 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:00.171017 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ea57-88fe-4e16-9974-524546ae3049 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:00.172038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6ea57-88fe-4e16-9974-524546ae3049 None admin] RBAC: Adding query filter params (role.id=22681aa004f8450f964af121fc87d40a, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=8489647547d544a681131dad99e058bc) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:00.172509 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6ea57-88fe-4e16-9974-524546ae3049 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:00.174337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6ea57-88fe-4e16-9974-524546ae3049 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:00.189029 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 620/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:56:00 2022] GET /identity/v3/role_assignments?user.id=8489647547d544a681131dad99e058bc&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=22681aa004f8450f964af121fc87d40a => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:56:02.642183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad69d2-74eb-41c6-91e5-49a10709060b None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:02.642907 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad69d2-74eb-41c6-91e5-49a10709060b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:02.642907 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad69d2-74eb-41c6-91e5-49a10709060b None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:02.644746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 600/1220] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:56:02.650709 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed708855-8c1e-4659-8c30-4be7d4111b7b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:02.651158 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed708855-8c1e-4659-8c30-4be7d4111b7b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:02.651259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed708855-8c1e-4659-8c30-4be7d4111b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:02.670288 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ed708855-8c1e-4659-8c30-4be7d4111b7b None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:56:02.671520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ed708855-8c1e-4659-8c30-4be7d4111b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:56:02.744314 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 621/1221] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:56:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:56:02.769291 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad69d2-74eb-41c6-91e5-49a10709060b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:02.876025 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad69d2-74eb-41c6-91e5-49a10709060b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:02.912558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778683fd-882f-4b12-bff5-8a447ad2ebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:02.913343 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778683fd-882f-4b12-bff5-8a447ad2ebc7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:02.913695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778683fd-882f-4b12-bff5-8a447ad2ebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:02.913968 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778683fd-882f-4b12-bff5-8a447ad2ebc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:02.924270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778683fd-882f-4b12-bff5-8a447ad2ebc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:56:02.931214 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-778683fd-882f-4b12-bff5-8a447ad2ebc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:56:02.932409 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 601/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:56:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:02.938961 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed708855-8c1e-4659-8c30-4be7d4111b7b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:03.053135 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed708855-8c1e-4659-8c30-4be7d4111b7b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:03.091178 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c469033-0892-4041-a123-b1629701689f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:03.091893 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c469033-0892-4041-a123-b1629701689f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:03.092197 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c469033-0892-4041-a123-b1629701689f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:03.092466 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c469033-0892-4041-a123-b1629701689f None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:03.093306 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c469033-0892-4041-a123-b1629701689f None admin] RBAC: Adding query filter params (name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:03.093585 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c469033-0892-4041-a123-b1629701689f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:03.095195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c469033-0892-4041-a123-b1629701689f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:03.104184 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 622/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:56:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:03.110196 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778683fd-882f-4b12-bff5-8a447ad2ebc7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:03.215239 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778683fd-882f-4b12-bff5-8a447ad2ebc7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:03.254602 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8950e7-41da-4665-adaa-9e9133b305f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:03.255387 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8950e7-41da-4665-adaa-9e9133b305f0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:03.255664 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8950e7-41da-4665-adaa-9e9133b305f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:03.255945 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8950e7-41da-4665-adaa-9e9133b305f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:03.268906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8950e7-41da-4665-adaa-9e9133b305f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:03.270433 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8950e7-41da-4665-adaa-9e9133b305f0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:03.289671 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-ba8950e7-41da-4665-adaa-9e9133b305f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:56:03.291051 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 602/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:03.296950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c469033-0892-4041-a123-b1629701689f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:03.400601 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c469033-0892-4041-a123-b1629701689f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:03.435117 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bcb5e-dd1a-40e7-8693-b75868858ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:03.435769 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bcb5e-dd1a-40e7-8693-b75868858ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:03.436046 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bcb5e-dd1a-40e7-8693-b75868858ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:03.436316 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bcb5e-dd1a-40e7-8693-b75868858ce0 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:03.437061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bcb5e-dd1a-40e7-8693-b75868858ce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:03.437367 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bcb5e-dd1a-40e7-8693-b75868858ce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:03.439153 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bcb5e-dd1a-40e7-8693-b75868858ce0 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:03.451617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 623/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:03.459421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8950e7-41da-4665-adaa-9e9133b305f0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:03.561061 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8950e7-41da-4665-adaa-9e9133b305f0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:03.597664 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6d3db-7b9c-4cd3-a8ab-8350376b74c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:03.598509 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6d3db-7b9c-4cd3-a8ab-8350376b74c7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:03.598785 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6d3db-7b9c-4cd3-a8ab-8350376b74c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:03.599058 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6d3db-7b9c-4cd3-a8ab-8350376b74c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:03.606605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6d3db-7b9c-4cd3-a8ab-8350376b74c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:03.608101 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6d3db-7b9c-4cd3-a8ab-8350376b74c7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:03.622012 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-b6c6d3db-7b9c-4cd3-a8ab-8350376b74c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:56:03.623477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 603/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:56:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:56:03.630275 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bcb5e-dd1a-40e7-8693-b75868858ce0 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:03.731168 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bcb5e-dd1a-40e7-8693-b75868858ce0 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:03.768129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6bfdc-7d93-4a67-9376-7cffed6e0f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:03.768910 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6bfdc-7d93-4a67-9376-7cffed6e0f56 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:03.769195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6bfdc-7d93-4a67-9376-7cffed6e0f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:03.769468 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef6bfdc-7d93-4a67-9376-7cffed6e0f56 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:03.770387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6bfdc-7d93-4a67-9376-7cffed6e0f56 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:03.770725 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6bfdc-7d93-4a67-9376-7cffed6e0f56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:03.772241 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef6bfdc-7d93-4a67-9376-7cffed6e0f56 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:03.790798 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 624/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Sep 27 04:56:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:03.797382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6d3db-7b9c-4cd3-a8ab-8350376b74c7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:03.900169 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6d3db-7b9c-4cd3-a8ab-8350376b74c7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:03.936320 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cb9f8-e97f-45de-8261-8af6d8fcdf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:03.937143 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cb9f8-e97f-45de-8261-8af6d8fcdf68 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:03.937417 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cb9f8-e97f-45de-8261-8af6d8fcdf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:03.937688 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cb9f8-e97f-45de-8261-8af6d8fcdf68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:03.948122 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cb9f8-e97f-45de-8261-8af6d8fcdf68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:03.949584 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cb9f8-e97f-45de-8261-8af6d8fcdf68 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:03.966600 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-d46cb9f8-e97f-45de-8261-8af6d8fcdf68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:56:03.967825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 604/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:03.974544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6bfdc-7d93-4a67-9376-7cffed6e0f56 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:04.085026 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef6bfdc-7d93-4a67-9376-7cffed6e0f56 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:04.120840 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170dcc9-1b7a-4a3e-a674-a56ce25304d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:04.121497 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170dcc9-1b7a-4a3e-a674-a56ce25304d5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:04.121783 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170dcc9-1b7a-4a3e-a674-a56ce25304d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:04.122045 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170dcc9-1b7a-4a3e-a674-a56ce25304d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:04.122770 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170dcc9-1b7a-4a3e-a674-a56ce25304d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:04.123049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170dcc9-1b7a-4a3e-a674-a56ce25304d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:04.124525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170dcc9-1b7a-4a3e-a674-a56ce25304d5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:04.136724 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 625/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:56:04.142734 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cb9f8-e97f-45de-8261-8af6d8fcdf68 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:04.255225 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cb9f8-e97f-45de-8261-8af6d8fcdf68 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:04.298611 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699ca83-30bb-4fd9-a26d-8b5384d06dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:04.299436 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699ca83-30bb-4fd9-a26d-8b5384d06dbb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:04.299803 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699ca83-30bb-4fd9-a26d-8b5384d06dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:04.300013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699ca83-30bb-4fd9-a26d-8b5384d06dbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:04.307461 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699ca83-30bb-4fd9-a26d-8b5384d06dbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:04.308937 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699ca83-30bb-4fd9-a26d-8b5384d06dbb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:04.323272 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-7699ca83-30bb-4fd9-a26d-8b5384d06dbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:56:04.324477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 605/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:56:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:04.331152 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170dcc9-1b7a-4a3e-a674-a56ce25304d5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:04.435357 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170dcc9-1b7a-4a3e-a674-a56ce25304d5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:04.468719 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a56eff-fc2f-43b7-8915-02b7d66b17f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:04.469432 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a56eff-fc2f-43b7-8915-02b7d66b17f6 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:04.470354 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a56eff-fc2f-43b7-8915-02b7d66b17f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:04.470582 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a56eff-fc2f-43b7-8915-02b7d66b17f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:04.471260 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a56eff-fc2f-43b7-8915-02b7d66b17f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:04.471637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a56eff-fc2f-43b7-8915-02b7d66b17f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:04.473182 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a56eff-fc2f-43b7-8915-02b7d66b17f6 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:04.486106 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 626/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:56:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:04.492058 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699ca83-30bb-4fd9-a26d-8b5384d06dbb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:04.600358 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699ca83-30bb-4fd9-a26d-8b5384d06dbb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:04.638805 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40594ac6-b28d-4d07-8107-1cdaf7f569de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:04.639753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40594ac6-b28d-4d07-8107-1cdaf7f569de None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:04.640062 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40594ac6-b28d-4d07-8107-1cdaf7f569de None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:04.640410 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40594ac6-b28d-4d07-8107-1cdaf7f569de None admin] PATH_INFO: `/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/8489647547d544a681131dad99e058bc/roles/22681aa004f8450f964af121fc87d40a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:04.660466 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40594ac6-b28d-4d07-8107-1cdaf7f569de None admin] RBAC: Authorizing `identity:create_grant(project_id=470fa8cf5f4a443faea9cfc628ff6003, user_id=8489647547d544a681131dad99e058bc, role_id=22681aa004f8450f964af121fc87d40a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:04.662319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40594ac6-b28d-4d07-8107-1cdaf7f569de None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:04.676300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 606/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:56:04 2022] PUT /identity/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/8489647547d544a681131dad99e058bc/roles/22681aa004f8450f964af121fc87d40a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 04:56:07.301243 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc85dca-471b-4f41-a2d5-0ab064b8b942 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:07.301772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc85dca-471b-4f41-a2d5-0ab064b8b942 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:07.301772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc85dca-471b-4f41-a2d5-0ab064b8b942 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:07.303526 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 627/1233] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:56:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:56:07.310825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f3e16-9f1f-4a6c-b115-2336c33bb252 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:07.310825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f3e16-9f1f-4a6c-b115-2336c33bb252 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:07.310825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f3e16-9f1f-4a6c-b115-2336c33bb252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:07.326370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3a7f3e16-9f1f-4a6c-b115-2336c33bb252 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:56:07.328915 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3a7f3e16-9f1f-4a6c-b115-2336c33bb252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:56:07.399021 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 607/1234] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:56:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:56:07.424315 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc85dca-471b-4f41-a2d5-0ab064b8b942 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:07.530412 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc85dca-471b-4f41-a2d5-0ab064b8b942 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:07.569402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66057b-c575-4a6f-8fbf-a43b5c9ddf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:07.570168 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66057b-c575-4a6f-8fbf-a43b5c9ddf06 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:07.570489 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66057b-c575-4a6f-8fbf-a43b5c9ddf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:07.570829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66057b-c575-4a6f-8fbf-a43b5c9ddf06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:07.582313 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66057b-c575-4a6f-8fbf-a43b5c9ddf06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:56:07.589887 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-0f66057b-c575-4a6f-8fbf-a43b5c9ddf06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 27 04:56:07.591335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 628/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Sep 27 04:56:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:56:07.598420 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f3e16-9f1f-4a6c-b115-2336c33bb252 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:07.704250 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f3e16-9f1f-4a6c-b115-2336c33bb252 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:07.740203 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdb421-7f0a-4bbc-925a-6419ae513ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:07.740932 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdb421-7f0a-4bbc-925a-6419ae513ebd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:07.741286 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdb421-7f0a-4bbc-925a-6419ae513ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:07.741669 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdb421-7f0a-4bbc-925a-6419ae513ebd None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:07.742409 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdb421-7f0a-4bbc-925a-6419ae513ebd None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:07.742720 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdb421-7f0a-4bbc-925a-6419ae513ebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:07.744261 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdb421-7f0a-4bbc-925a-6419ae513ebd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:07.754710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 608/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Sep 27 04:56:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:07.760536 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66057b-c575-4a6f-8fbf-a43b5c9ddf06 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:07.867227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66057b-c575-4a6f-8fbf-a43b5c9ddf06 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:07.902936 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9430ba-94c3-4c12-b694-727634bc752b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:07.903744 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9430ba-94c3-4c12-b694-727634bc752b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:07.904100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9430ba-94c3-4c12-b694-727634bc752b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:07.904374 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9430ba-94c3-4c12-b694-727634bc752b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:07.917178 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9430ba-94c3-4c12-b694-727634bc752b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:07.918981 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9430ba-94c3-4c12-b694-727634bc752b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:07.937911 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-7e9430ba-94c3-4c12-b694-727634bc752b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:56:07.939698 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 629/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:07.945855 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdb421-7f0a-4bbc-925a-6419ae513ebd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:08.055054 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdb421-7f0a-4bbc-925a-6419ae513ebd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:08.092094 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaaf8b-5c00-47c4-b1db-a12308a1a8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:08.092886 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaaf8b-5c00-47c4-b1db-a12308a1a8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:08.093226 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaaf8b-5c00-47c4-b1db-a12308a1a8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:08.093501 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaaf8b-5c00-47c4-b1db-a12308a1a8a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:08.094280 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaaaf8b-5c00-47c4-b1db-a12308a1a8a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:08.094634 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaaaf8b-5c00-47c4-b1db-a12308a1a8a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:08.096872 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaaaf8b-5c00-47c4-b1db-a12308a1a8a6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:08.109436 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 609/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:08.115012 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9430ba-94c3-4c12-b694-727634bc752b None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:08.223869 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9430ba-94c3-4c12-b694-727634bc752b None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:08.278745 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f126d-1644-4984-b0a9-40ce8bf60ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:08.279742 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f126d-1644-4984-b0a9-40ce8bf60ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:08.280210 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f126d-1644-4984-b0a9-40ce8bf60ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:08.280425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f126d-1644-4984-b0a9-40ce8bf60ea5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:08.288967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f126d-1644-4984-b0a9-40ce8bf60ea5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:08.290410 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f126d-1644-4984-b0a9-40ce8bf60ea5 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:08.304384 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-652f126d-1644-4984-b0a9-40ce8bf60ea5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:56:08.305760 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 630/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:56:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:08.311639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaaf8b-5c00-47c4-b1db-a12308a1a8a6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:08.419355 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaaf8b-5c00-47c4-b1db-a12308a1a8a6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:08.457956 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46ac8e-41fc-4b23-a899-c3be1d876372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:08.458626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46ac8e-41fc-4b23-a899-c3be1d876372 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:08.458905 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46ac8e-41fc-4b23-a899-c3be1d876372 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:08.459175 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46ac8e-41fc-4b23-a899-c3be1d876372 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:08.460182 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46ac8e-41fc-4b23-a899-c3be1d876372 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:08.460517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46ac8e-41fc-4b23-a899-c3be1d876372 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:08.462268 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46ac8e-41fc-4b23-a899-c3be1d876372 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:08.481211 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 610/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Sep 27 04:56:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:08.487014 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f126d-1644-4984-b0a9-40ce8bf60ea5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:08.595152 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f126d-1644-4984-b0a9-40ce8bf60ea5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:08.629956 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33257b-050a-4048-a251-265641fa12fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:08.630667 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33257b-050a-4048-a251-265641fa12fa None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:08.630947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33257b-050a-4048-a251-265641fa12fa None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:08.631222 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33257b-050a-4048-a251-265641fa12fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:08.701907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33257b-050a-4048-a251-265641fa12fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:08.703297 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33257b-050a-4048-a251-265641fa12fa None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:08.809365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 631/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:56:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 04:56:08.815795 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46ac8e-41fc-4b23-a899-c3be1d876372 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:08.920914 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46ac8e-41fc-4b23-a899-c3be1d876372 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:08.962737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a73de-4595-42a0-bec5-2425b2c3a5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:08.963531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a73de-4595-42a0-bec5-2425b2c3a5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:08.963810 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a73de-4595-42a0-bec5-2425b2c3a5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:08.964088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a73de-4595-42a0-bec5-2425b2c3a5c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:08.975472 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a73de-4595-42a0-bec5-2425b2c3a5c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:08.977193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a73de-4595-42a0-bec5-2425b2c3a5c5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:08.996447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-337a73de-4595-42a0-bec5-2425b2c3a5c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:56:08.997681 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 611/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:56:09.005491 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33257b-050a-4048-a251-265641fa12fa None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:09.124487 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33257b-050a-4048-a251-265641fa12fa None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:09.167278 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65369c-94ce-4c1e-8330-a4bf08e73a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:09.168347 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65369c-94ce-4c1e-8330-a4bf08e73a4f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:09.168851 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65369c-94ce-4c1e-8330-a4bf08e73a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:09.169318 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65369c-94ce-4c1e-8330-a4bf08e73a4f None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:09.170436 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65369c-94ce-4c1e-8330-a4bf08e73a4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:09.170900 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65369c-94ce-4c1e-8330-a4bf08e73a4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:09.173430 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65369c-94ce-4c1e-8330-a4bf08e73a4f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:09.185769 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 632/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:09.191509 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a73de-4595-42a0-bec5-2425b2c3a5c5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:09.311552 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a73de-4595-42a0-bec5-2425b2c3a5c5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:09.347982 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842d7c8-a24d-4bb3-9e31-85d9f9189b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:09.348829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842d7c8-a24d-4bb3-9e31-85d9f9189b2b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:09.349209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842d7c8-a24d-4bb3-9e31-85d9f9189b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:09.349610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842d7c8-a24d-4bb3-9e31-85d9f9189b2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:09.356614 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842d7c8-a24d-4bb3-9e31-85d9f9189b2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:09.358108 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842d7c8-a24d-4bb3-9e31-85d9f9189b2b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:09.371735 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-b842d7c8-a24d-4bb3-9e31-85d9f9189b2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:56:09.373232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 612/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:56:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:09.380714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65369c-94ce-4c1e-8330-a4bf08e73a4f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:09.486356 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65369c-94ce-4c1e-8330-a4bf08e73a4f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:09.520686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451ad3e-6a8c-4687-8c0c-e84d21723997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:09.521418 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451ad3e-6a8c-4687-8c0c-e84d21723997 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:09.521713 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451ad3e-6a8c-4687-8c0c-e84d21723997 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:09.522010 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451ad3e-6a8c-4687-8c0c-e84d21723997 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:09.522859 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451ad3e-6a8c-4687-8c0c-e84d21723997 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:09.523166 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451ad3e-6a8c-4687-8c0c-e84d21723997 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:09.524579 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451ad3e-6a8c-4687-8c0c-e84d21723997 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:09.539270 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 633/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:56:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:56:09.545548 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842d7c8-a24d-4bb3-9e31-85d9f9189b2b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:09.651357 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842d7c8-a24d-4bb3-9e31-85d9f9189b2b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:09.687759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a94f2-3093-4d25-9b80-62fb9b17140a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:09.688512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a94f2-3093-4d25-9b80-62fb9b17140a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:09.688867 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a94f2-3093-4d25-9b80-62fb9b17140a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:09.689260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a94f2-3093-4d25-9b80-62fb9b17140a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:09.690098 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a94f2-3093-4d25-9b80-62fb9b17140a None admin] RBAC: Adding query filter params (role.id=22681aa004f8450f964af121fc87d40a, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=8489647547d544a681131dad99e058bc) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:09.690415 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a94f2-3093-4d25-9b80-62fb9b17140a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:09.692050 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a94f2-3093-4d25-9b80-62fb9b17140a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:09.698522 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 613/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:56:09 2022] GET /identity/v3/role_assignments?user.id=8489647547d544a681131dad99e058bc&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=22681aa004f8450f964af121fc87d40a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:12.308527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ed754-7644-41f2-9e4f-ca9d7a5b5cfd None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:12.309039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ed754-7644-41f2-9e4f-ca9d7a5b5cfd None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:12.309116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ed754-7644-41f2-9e4f-ca9d7a5b5cfd None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:12.311021 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 634/1247] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:56:12.316929 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448fa33-a179-4361-b64a-ecf2a54cd9f2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:12.317404 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448fa33-a179-4361-b64a-ecf2a54cd9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:12.317491 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448fa33-a179-4361-b64a-ecf2a54cd9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:12.335017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6448fa33-a179-4361-b64a-ecf2a54cd9f2 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:56:12.336210 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6448fa33-a179-4361-b64a-ecf2a54cd9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:56:12.401443 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 614/1248] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:56:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:56:12.425284 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ed754-7644-41f2-9e4f-ca9d7a5b5cfd None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:12.521482 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ed754-7644-41f2-9e4f-ca9d7a5b5cfd None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:12.553448 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea826d15-6f23-4573-9596-8641344b94d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:12.554224 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea826d15-6f23-4573-9596-8641344b94d5 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:12.554505 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea826d15-6f23-4573-9596-8641344b94d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:12.554779 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea826d15-6f23-4573-9596-8641344b94d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:12.565217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea826d15-6f23-4573-9596-8641344b94d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:56:12.572034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-ea826d15-6f23-4573-9596-8641344b94d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:56:12.573234 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 635/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:56:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:12.579874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448fa33-a179-4361-b64a-ecf2a54cd9f2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:12.672460 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448fa33-a179-4361-b64a-ecf2a54cd9f2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:12.703505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb69bd-b497-4efc-994b-5f7b24565ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:12.704688 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb69bd-b497-4efc-994b-5f7b24565ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:12.704991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb69bd-b497-4efc-994b-5f7b24565ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:12.705268 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb69bd-b497-4efc-994b-5f7b24565ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:12.706009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb69bd-b497-4efc-994b-5f7b24565ea0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:12.706313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb69bd-b497-4efc-994b-5f7b24565ea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:12.707678 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb69bd-b497-4efc-994b-5f7b24565ea0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:12.715340 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 615/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:56:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:12.721659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea826d15-6f23-4573-9596-8641344b94d5 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:12.815914 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea826d15-6f23-4573-9596-8641344b94d5 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:12.847656 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328426f-98cd-41ec-9cc2-b668e2deb7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:12.848416 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328426f-98cd-41ec-9cc2-b668e2deb7cb None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:12.848691 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328426f-98cd-41ec-9cc2-b668e2deb7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:12.848993 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328426f-98cd-41ec-9cc2-b668e2deb7cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:12.858920 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328426f-98cd-41ec-9cc2-b668e2deb7cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:12.860505 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328426f-98cd-41ec-9cc2-b668e2deb7cb None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:12.876921 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-a328426f-98cd-41ec-9cc2-b668e2deb7cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:56:12.878040 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 636/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:56:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:12.883661 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb69bd-b497-4efc-994b-5f7b24565ea0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:12.976205 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb69bd-b497-4efc-994b-5f7b24565ea0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:13.007947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68c8fc-6972-4f54-86fb-15a592fc095c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:13.008591 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68c8fc-6972-4f54-86fb-15a592fc095c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:13.008969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68c8fc-6972-4f54-86fb-15a592fc095c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:13.009245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68c8fc-6972-4f54-86fb-15a592fc095c None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:13.009948 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68c8fc-6972-4f54-86fb-15a592fc095c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:13.010245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68c8fc-6972-4f54-86fb-15a592fc095c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:13.011615 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68c8fc-6972-4f54-86fb-15a592fc095c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:13.022723 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 616/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:13.028494 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328426f-98cd-41ec-9cc2-b668e2deb7cb None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:13.123210 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328426f-98cd-41ec-9cc2-b668e2deb7cb None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:13.155380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aaed8d-8eed-44a7-b7fb-a6518602c65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:13.156154 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaed8d-8eed-44a7-b7fb-a6518602c65f None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:13.156431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaed8d-8eed-44a7-b7fb-a6518602c65f None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:13.156701 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aaed8d-8eed-44a7-b7fb-a6518602c65f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:13.165558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aaed8d-8eed-44a7-b7fb-a6518602c65f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:13.166976 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aaed8d-8eed-44a7-b7fb-a6518602c65f None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:13.180472 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-06aaed8d-8eed-44a7-b7fb-a6518602c65f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:56:13.181640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 637/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:56:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:13.187558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68c8fc-6972-4f54-86fb-15a592fc095c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:13.286374 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68c8fc-6972-4f54-86fb-15a592fc095c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:13.319185 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4e9c7-7b6d-47c7-bb2f-0fe4fffb9b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:13.319834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4e9c7-7b6d-47c7-bb2f-0fe4fffb9b30 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:13.320113 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4e9c7-7b6d-47c7-bb2f-0fe4fffb9b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:13.320390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4e9c7-7b6d-47c7-bb2f-0fe4fffb9b30 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:13.321254 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4e9c7-7b6d-47c7-bb2f-0fe4fffb9b30 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:13.321564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4e9c7-7b6d-47c7-bb2f-0fe4fffb9b30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:13.322986 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4e9c7-7b6d-47c7-bb2f-0fe4fffb9b30 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:13.340102 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 617/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Sep 27 04:56:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:13.346106 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aaed8d-8eed-44a7-b7fb-a6518602c65f None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:13.441460 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aaed8d-8eed-44a7-b7fb-a6518602c65f None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:13.472655 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249e91b-b41c-4ce7-99e5-05b4cca9aa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:13.473316 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249e91b-b41c-4ce7-99e5-05b4cca9aa60 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:13.473597 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249e91b-b41c-4ce7-99e5-05b4cca9aa60 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:13.473871 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249e91b-b41c-4ce7-99e5-05b4cca9aa60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:13.536947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249e91b-b41c-4ce7-99e5-05b4cca9aa60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:13.538384 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249e91b-b41c-4ce7-99e5-05b4cca9aa60 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:13.631698 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 638/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:56:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 27 04:56:13.637482 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4e9c7-7b6d-47c7-bb2f-0fe4fffb9b30 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:13.729324 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4e9c7-7b6d-47c7-bb2f-0fe4fffb9b30 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:13.761016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e9aff-b18e-4360-b3b7-4b47ee0557ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:13.761794 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e9aff-b18e-4360-b3b7-4b47ee0557ce None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:13.762071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e9aff-b18e-4360-b3b7-4b47ee0557ce None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:13.762342 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e9aff-b18e-4360-b3b7-4b47ee0557ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:13.771747 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e9aff-b18e-4360-b3b7-4b47ee0557ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:13.773218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e9aff-b18e-4360-b3b7-4b47ee0557ce None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:13.789781 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-4f9e9aff-b18e-4360-b3b7-4b47ee0557ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:56:13.790915 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 618/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:13.796494 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249e91b-b41c-4ce7-99e5-05b4cca9aa60 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:13.889158 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249e91b-b41c-4ce7-99e5-05b4cca9aa60 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:13.921112 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6df6c-c780-41c3-b22b-1dd066624961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:13.921746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6df6c-c780-41c3-b22b-1dd066624961 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:13.922024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6df6c-c780-41c3-b22b-1dd066624961 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:13.922296 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6df6c-c780-41c3-b22b-1dd066624961 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:13.923541 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6df6c-c780-41c3-b22b-1dd066624961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:13.923839 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6df6c-c780-41c3-b22b-1dd066624961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:13.925212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6df6c-c780-41c3-b22b-1dd066624961 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:13.935841 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 639/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:13.941538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e9aff-b18e-4360-b3b7-4b47ee0557ce None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:14.034675 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e9aff-b18e-4360-b3b7-4b47ee0557ce None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:14.066488 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e730b-b306-4b01-b670-ed0f0ce3ecc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:14.067256 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e730b-b306-4b01-b670-ed0f0ce3ecc5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:14.067529 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e730b-b306-4b01-b670-ed0f0ce3ecc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:14.067791 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e730b-b306-4b01-b670-ed0f0ce3ecc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:14.074100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e730b-b306-4b01-b670-ed0f0ce3ecc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:14.075515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e730b-b306-4b01-b670-ed0f0ce3ecc5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:14.088190 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-ca4e730b-b306-4b01-b670-ed0f0ce3ecc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:56:14.089339 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 619/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:56:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:14.095369 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6df6c-c780-41c3-b22b-1dd066624961 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:14.189113 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6df6c-c780-41c3-b22b-1dd066624961 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:14.220040 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa41f4-dc23-4d13-9466-a6931815fa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:14.220674 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa41f4-dc23-4d13-9466-a6931815fa22 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:14.220986 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa41f4-dc23-4d13-9466-a6931815fa22 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:14.221260 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa41f4-dc23-4d13-9466-a6931815fa22 None admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:14.222032 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa41f4-dc23-4d13-9466-a6931815fa22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:14.222337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa41f4-dc23-4d13-9466-a6931815fa22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:14.223754 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa41f4-dc23-4d13-9466-a6931815fa22 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:14.237195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 640/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:56:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 04:56:14.243685 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e730b-b306-4b01-b670-ed0f0ce3ecc5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:14.344341 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e730b-b306-4b01-b670-ed0f0ce3ecc5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:14.376246 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a61b81-11f0-4958-b7b3-46be13a31888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:14.376914 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a61b81-11f0-4958-b7b3-46be13a31888 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:14.377195 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a61b81-11f0-4958-b7b3-46be13a31888 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:14.377468 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a61b81-11f0-4958-b7b3-46be13a31888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:14.378282 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a61b81-11f0-4958-b7b3-46be13a31888 None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=8489647547d544a681131dad99e058bc) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:14.378587 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a61b81-11f0-4958-b7b3-46be13a31888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:14.380005 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a61b81-11f0-4958-b7b3-46be13a31888 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:14.385159 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 620/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:56:14 2022] GET /identity/v3/role_assignments?user.id=8489647547d544a681131dad99e058bc&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:16.710192 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3660fe-09a2-4dd7-9a34-43e3872b7187 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:16.710723 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3660fe-09a2-4dd7-9a34-43e3872b7187 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:16.710723 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3660fe-09a2-4dd7-9a34-43e3872b7187 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:16.712521 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 641/1261] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:56:16.717723 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05ef6a-5188-4bd6-b9de-fba223677229 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:16.718110 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05ef6a-5188-4bd6-b9de-fba223677229 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:16.718310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05ef6a-5188-4bd6-b9de-fba223677229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:16.736174 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8b05ef6a-5188-4bd6-b9de-fba223677229 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:56:16.737389 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8b05ef6a-5188-4bd6-b9de-fba223677229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:56:16.800732 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 621/1262] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:56:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 27 04:56:16.823656 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3660fe-09a2-4dd7-9a34-43e3872b7187 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:16.919393 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3660fe-09a2-4dd7-9a34-43e3872b7187 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:16.950863 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be60e0b-659b-43cb-b66c-cd9f414d2287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:16.951625 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be60e0b-659b-43cb-b66c-cd9f414d2287 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:16.951898 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be60e0b-659b-43cb-b66c-cd9f414d2287 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:16.952167 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be60e0b-659b-43cb-b66c-cd9f414d2287 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:16.962159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be60e0b-659b-43cb-b66c-cd9f414d2287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:56:16.968913 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-4be60e0b-659b-43cb-b66c-cd9f414d2287 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:56:16.970100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 642/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:56:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:16.976207 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05ef6a-5188-4bd6-b9de-fba223677229 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:17.070883 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05ef6a-5188-4bd6-b9de-fba223677229 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:17.102490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bff035-a55f-49a2-8805-94a00b45d9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:17.103150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bff035-a55f-49a2-8805-94a00b45d9ee None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:17.103432 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bff035-a55f-49a2-8805-94a00b45d9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:17.103706 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bff035-a55f-49a2-8805-94a00b45d9ee None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:17.104444 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bff035-a55f-49a2-8805-94a00b45d9ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:17.104749 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bff035-a55f-49a2-8805-94a00b45d9ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:17.106137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bff035-a55f-49a2-8805-94a00b45d9ee None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:17.114319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 622/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:56:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:17.120019 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be60e0b-659b-43cb-b66c-cd9f414d2287 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:17.214992 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be60e0b-659b-43cb-b66c-cd9f414d2287 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:17.256153 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc899d8-cdfd-47cb-9212-9ab3071ac9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:17.257169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc899d8-cdfd-47cb-9212-9ab3071ac9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:17.257627 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc899d8-cdfd-47cb-9212-9ab3071ac9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:17.257937 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc899d8-cdfd-47cb-9212-9ab3071ac9f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:17.272210 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc899d8-cdfd-47cb-9212-9ab3071ac9f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:17.274159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc899d8-cdfd-47cb-9212-9ab3071ac9f4 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:17.296580 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-2dc899d8-cdfd-47cb-9212-9ab3071ac9f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:56:17.298686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 643/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:17.305121 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bff035-a55f-49a2-8805-94a00b45d9ee None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:17.401363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bff035-a55f-49a2-8805-94a00b45d9ee None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:17.433346 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97792c-8a4b-47a4-815a-2c148872891e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:17.433988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97792c-8a4b-47a4-815a-2c148872891e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:17.434266 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97792c-8a4b-47a4-815a-2c148872891e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:17.434533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97792c-8a4b-47a4-815a-2c148872891e None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:17.435233 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97792c-8a4b-47a4-815a-2c148872891e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:17.435529 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97792c-8a4b-47a4-815a-2c148872891e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:17.436888 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97792c-8a4b-47a4-815a-2c148872891e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:17.447939 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 623/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:17.453617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc899d8-cdfd-47cb-9212-9ab3071ac9f4 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:17.548391 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc899d8-cdfd-47cb-9212-9ab3071ac9f4 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:17.579496 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7ade3-e9b3-46d8-91cd-1ddf20ba62ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:17.580272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ade3-e9b3-46d8-91cd-1ddf20ba62ce None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:17.580546 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ade3-e9b3-46d8-91cd-1ddf20ba62ce None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:17.580835 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7ade3-e9b3-46d8-91cd-1ddf20ba62ce None admin] PATH_INFO: `/v3/users/placement` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:17.588002 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7ade3-e9b3-46d8-91cd-1ddf20ba62ce None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:17.589524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7ade3-e9b3-46d8-91cd-1ddf20ba62ce None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:17.603606 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-eff7ade3-e9b3-46d8-91cd-1ddf20ba62ce None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:56:17.604979 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 644/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:56:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:17.611027 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97792c-8a4b-47a4-815a-2c148872891e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:17.702945 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97792c-8a4b-47a4-815a-2c148872891e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:17.734423 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504f43f-d814-4db2-8548-2e19f503e693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:17.735078 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504f43f-d814-4db2-8548-2e19f503e693 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:17.735854 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504f43f-d814-4db2-8548-2e19f503e693 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:17.736271 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504f43f-d814-4db2-8548-2e19f503e693 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:17.737132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504f43f-d814-4db2-8548-2e19f503e693 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:17.737439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504f43f-d814-4db2-8548-2e19f503e693 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:17.738846 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504f43f-d814-4db2-8548-2e19f503e693 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:17.755192 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 624/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Sep 27 04:56:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:17.760661 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7ade3-e9b3-46d8-91cd-1ddf20ba62ce None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:17.856020 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7ade3-e9b3-46d8-91cd-1ddf20ba62ce None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:17.887211 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b968f4c-88c0-47ba-ab69-04b4cb9f9f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:17.887979 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b968f4c-88c0-47ba-ab69-04b4cb9f9f15 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:17.888260 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b968f4c-88c0-47ba-ab69-04b4cb9f9f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:17.888536 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b968f4c-88c0-47ba-ab69-04b4cb9f9f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:17.899207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b968f4c-88c0-47ba-ab69-04b4cb9f9f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:17.900676 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b968f4c-88c0-47ba-ab69-04b4cb9f9f15 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:17.917136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-8b968f4c-88c0-47ba-ab69-04b4cb9f9f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:56:17.918272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 645/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:17.923936 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504f43f-d814-4db2-8548-2e19f503e693 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:18.017860 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504f43f-d814-4db2-8548-2e19f503e693 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:18.049713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735aee2-5ff2-4086-bc32-18902f21cc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:18.050359 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735aee2-5ff2-4086-bc32-18902f21cc04 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:18.050639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735aee2-5ff2-4086-bc32-18902f21cc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:18.050910 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735aee2-5ff2-4086-bc32-18902f21cc04 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:18.051610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735aee2-5ff2-4086-bc32-18902f21cc04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:18.051913 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735aee2-5ff2-4086-bc32-18902f21cc04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:18.053294 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735aee2-5ff2-4086-bc32-18902f21cc04 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:18.064384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 625/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:18.069942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b968f4c-88c0-47ba-ab69-04b4cb9f9f15 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:18.166830 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b968f4c-88c0-47ba-ab69-04b4cb9f9f15 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:18.198027 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a442b3d-7583-43bf-a78c-ba56ab626bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:18.198797 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a442b3d-7583-43bf-a78c-ba56ab626bbf None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:18.199073 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a442b3d-7583-43bf-a78c-ba56ab626bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:18.199344 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a442b3d-7583-43bf-a78c-ba56ab626bbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:18.205979 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a442b3d-7583-43bf-a78c-ba56ab626bbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:18.207402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a442b3d-7583-43bf-a78c-ba56ab626bbf None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:18.220816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-1a442b3d-7583-43bf-a78c-ba56ab626bbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:56:18.221930 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 646/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:56:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:18.227731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735aee2-5ff2-4086-bc32-18902f21cc04 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:18.330771 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735aee2-5ff2-4086-bc32-18902f21cc04 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:18.362935 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39dc3b-5bb9-45b2-b5a4-fbd0313cd3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:18.363581 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39dc3b-5bb9-45b2-b5a4-fbd0313cd3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:18.363859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39dc3b-5bb9-45b2-b5a4-fbd0313cd3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:18.364132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39dc3b-5bb9-45b2-b5a4-fbd0313cd3f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:18.364936 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39dc3b-5bb9-45b2-b5a4-fbd0313cd3f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:18.365244 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39dc3b-5bb9-45b2-b5a4-fbd0313cd3f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:18.366672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39dc3b-5bb9-45b2-b5a4-fbd0313cd3f4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:18.378281 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 626/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:56:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:18.384316 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a442b3d-7583-43bf-a78c-ba56ab626bbf None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:18.478582 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a442b3d-7583-43bf-a78c-ba56ab626bbf None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:18.510368 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aae269-3c46-4127-9c75-b9e137c914c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:18.511231 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aae269-3c46-4127-9c75-b9e137c914c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:18.511515 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aae269-3c46-4127-9c75-b9e137c914c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:18.511794 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aae269-3c46-4127-9c75-b9e137c914c6 None admin] PATH_INFO: `/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/8489647547d544a681131dad99e058bc/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:18.513755 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aae269-3c46-4127-9c75-b9e137c914c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=470fa8cf5f4a443faea9cfc628ff6003, user_id=8489647547d544a681131dad99e058bc, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:18.515187 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aae269-3c46-4127-9c75-b9e137c914c6 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:18.528063 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 647/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Sep 27 04:56:18 2022] PUT /identity/v3/projects/470fa8cf5f4a443faea9cfc628ff6003/users/8489647547d544a681131dad99e058bc/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 04:56:20.806652 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50a39a-42fe-4f46-97c1-c614fe649eb6 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:20.807211 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50a39a-42fe-4f46-97c1-c614fe649eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:20.807211 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50a39a-42fe-4f46-97c1-c614fe649eb6 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:20.808990 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 627/1274] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:56:20.814660 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774283d1-4990-47a0-8d00-677f11b471bd None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:20.815068 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774283d1-4990-47a0-8d00-677f11b471bd None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:20.815216 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774283d1-4990-47a0-8d00-677f11b471bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:20.831627 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-774283d1-4990-47a0-8d00-677f11b471bd None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:56:20.832819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-774283d1-4990-47a0-8d00-677f11b471bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:56:20.896229 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 648/1275] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:56:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:56:20.919172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50a39a-42fe-4f46-97c1-c614fe649eb6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:21.016211 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50a39a-42fe-4f46-97c1-c614fe649eb6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:21.048967 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485796c-dbc7-4967-b55a-41e130e6d7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:21.049732 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485796c-dbc7-4967-b55a-41e130e6d7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:21.050005 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485796c-dbc7-4967-b55a-41e130e6d7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:21.050273 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485796c-dbc7-4967-b55a-41e130e6d7f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:21.059879 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485796c-dbc7-4967-b55a-41e130e6d7f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 27 04:56:21.067401 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-c485796c-dbc7-4967-b55a-41e130e6d7f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 27 04:56:21.068557 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 628/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Sep 27 04:56:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:21.074713 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774283d1-4990-47a0-8d00-677f11b471bd None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:21.167453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774283d1-4990-47a0-8d00-677f11b471bd None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:21.199383 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5f73c-f568-4d10-9739-426037b4c0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:21.200037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5f73c-f568-4d10-9739-426037b4c0ad None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:21.200317 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5f73c-f568-4d10-9739-426037b4c0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:21.200590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5f73c-f568-4d10-9739-426037b4c0ad None admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:21.201360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5f73c-f568-4d10-9739-426037b4c0ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:21.201667 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5f73c-f568-4d10-9739-426037b4c0ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:21.203028 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5f73c-f568-4d10-9739-426037b4c0ad None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:21.210846 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 649/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Sep 27 04:56:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:21.216326 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485796c-dbc7-4967-b55a-41e130e6d7f0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:21.324406 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485796c-dbc7-4967-b55a-41e130e6d7f0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:21.355736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255b9ff-6d50-4079-807c-860dc70060d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:21.356518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255b9ff-6d50-4079-807c-860dc70060d0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:21.356820 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255b9ff-6d50-4079-807c-860dc70060d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:21.357096 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255b9ff-6d50-4079-807c-860dc70060d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:21.367537 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255b9ff-6d50-4079-807c-860dc70060d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:21.368988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255b9ff-6d50-4079-807c-860dc70060d0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:21.384654 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-8255b9ff-6d50-4079-807c-860dc70060d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:56:21.385813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 629/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:56:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:21.391589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5f73c-f568-4d10-9739-426037b4c0ad None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:21.485300 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5f73c-f568-4d10-9739-426037b4c0ad None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:21.516822 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d432fe6-b1ce-42df-b4a1-ff0a907b3409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:21.517493 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d432fe6-b1ce-42df-b4a1-ff0a907b3409 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:21.517770 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d432fe6-b1ce-42df-b4a1-ff0a907b3409 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:21.518044 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d432fe6-b1ce-42df-b4a1-ff0a907b3409 None admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:21.518748 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d432fe6-b1ce-42df-b4a1-ff0a907b3409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:21.519048 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d432fe6-b1ce-42df-b4a1-ff0a907b3409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:21.520406 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d432fe6-b1ce-42df-b4a1-ff0a907b3409 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:21.531543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 650/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:21.537095 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255b9ff-6d50-4079-807c-860dc70060d0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:21.631620 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255b9ff-6d50-4079-807c-860dc70060d0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:21.662662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1444a-0d6a-4096-8eb6-cfb799a169f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:21.663439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1444a-0d6a-4096-8eb6-cfb799a169f5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:21.663714 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1444a-0d6a-4096-8eb6-cfb799a169f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:21.663983 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1444a-0d6a-4096-8eb6-cfb799a169f5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:21.671046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1444a-0d6a-4096-8eb6-cfb799a169f5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:21.672465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1444a-0d6a-4096-8eb6-cfb799a169f5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:21.686055 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-70e1444a-0d6a-4096-8eb6-cfb799a169f5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 27 04:56:21.687184 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 630/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:56:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:21.693091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d432fe6-b1ce-42df-b4a1-ff0a907b3409 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:21.787411 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d432fe6-b1ce-42df-b4a1-ff0a907b3409 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:21.819775 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f5f36-eb4f-48a3-b2f8-2cdafab15355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:21.820433 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f5f36-eb4f-48a3-b2f8-2cdafab15355 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:21.820707 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f5f36-eb4f-48a3-b2f8-2cdafab15355 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:21.821006 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f5f36-eb4f-48a3-b2f8-2cdafab15355 None admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:21.821819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f5f36-eb4f-48a3-b2f8-2cdafab15355 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:21.822121 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f5f36-eb4f-48a3-b2f8-2cdafab15355 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:21.823532 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f5f36-eb4f-48a3-b2f8-2cdafab15355 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:21.840305 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 651/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Sep 27 04:56:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:21.846070 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1444a-0d6a-4096-8eb6-cfb799a169f5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:21.938928 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1444a-0d6a-4096-8eb6-cfb799a169f5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:21.969915 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc08f5-3050-4395-be36-270e75b8ff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:21.970490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc08f5-3050-4395-be36-270e75b8ff20 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:21.970769 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc08f5-3050-4395-be36-270e75b8ff20 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:21.971044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc08f5-3050-4395-be36-270e75b8ff20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:22.039925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc08f5-3050-4395-be36-270e75b8ff20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:22.041406 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc08f5-3050-4395-be36-270e75b8ff20 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:22.132639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 631/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Sep 27 04:56:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 27 04:56:22.138394 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f5f36-eb4f-48a3-b2f8-2cdafab15355 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:22.233246 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f5f36-eb4f-48a3-b2f8-2cdafab15355 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:22.265813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf97cb-b6e2-495d-a771-5c4ab8e72413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:22.266611 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf97cb-b6e2-495d-a771-5c4ab8e72413 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:22.266886 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf97cb-b6e2-495d-a771-5c4ab8e72413 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:22.267150 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf97cb-b6e2-495d-a771-5c4ab8e72413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:22.276560 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf97cb-b6e2-495d-a771-5c4ab8e72413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:22.278030 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf97cb-b6e2-495d-a771-5c4ab8e72413 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:22.294022 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-fbcf97cb-b6e2-495d-a771-5c4ab8e72413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 27 04:56:22.295164 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 652/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:22.301571 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc08f5-3050-4395-be36-270e75b8ff20 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:22.395898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc08f5-3050-4395-be36-270e75b8ff20 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:22.427667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062427af-0579-4681-b048-7aecc3043bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:22.428309 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062427af-0579-4681-b048-7aecc3043bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:22.428586 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062427af-0579-4681-b048-7aecc3043bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:22.428885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062427af-0579-4681-b048-7aecc3043bb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:22.429596 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062427af-0579-4681-b048-7aecc3043bb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:22.429898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062427af-0579-4681-b048-7aecc3043bb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:22.431251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062427af-0579-4681-b048-7aecc3043bb7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:22.442440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 632/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Sep 27 04:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:22.447962 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf97cb-b6e2-495d-a771-5c4ab8e72413 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:22.542129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf97cb-b6e2-495d-a771-5c4ab8e72413 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:22.574190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb54ab2-b36e-48d1-ae72-1c0efb77e81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:22.574957 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb54ab2-b36e-48d1-ae72-1c0efb77e81d None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:22.575233 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb54ab2-b36e-48d1-ae72-1c0efb77e81d None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:22.575501 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb54ab2-b36e-48d1-ae72-1c0efb77e81d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:22.581894 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb54ab2-b36e-48d1-ae72-1c0efb77e81d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:22.583313 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb54ab2-b36e-48d1-ae72-1c0efb77e81d None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:22.596270 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING keystone.server.flask.application [None req-8bb54ab2-b36e-48d1-ae72-1c0efb77e81d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 27 04:56:22.597404 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 653/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Sep 27 04:56:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:22.603127 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062427af-0579-4681-b048-7aecc3043bb7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:22.699250 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062427af-0579-4681-b048-7aecc3043bb7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:22.730607 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc285fd-16fb-4352-96bd-1e1141fd8df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:22.731251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc285fd-16fb-4352-96bd-1e1141fd8df3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:22.731528 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc285fd-16fb-4352-96bd-1e1141fd8df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:22.731798 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc285fd-16fb-4352-96bd-1e1141fd8df3 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:22.732572 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc285fd-16fb-4352-96bd-1e1141fd8df3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:22.732904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc285fd-16fb-4352-96bd-1e1141fd8df3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:22.734315 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc285fd-16fb-4352-96bd-1e1141fd8df3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:22.746231 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 633/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Sep 27 04:56:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:22.752369 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb54ab2-b36e-48d1-ae72-1c0efb77e81d None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:22.847988 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb54ab2-b36e-48d1-ae72-1c0efb77e81d None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:22.879504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec5709-2e1d-46d3-b02a-8c307b531258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:22.880128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec5709-2e1d-46d3-b02a-8c307b531258 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:22.880407 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec5709-2e1d-46d3-b02a-8c307b531258 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:22.880673 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec5709-2e1d-46d3-b02a-8c307b531258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:22.881508 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec5709-2e1d-46d3-b02a-8c307b531258 None admin] RBAC: Adding query filter params (role.id=8f26dfbf7a9b44e79ee1fc909b0a058d, scope.project.id=470fa8cf5f4a443faea9cfc628ff6003, user.id=8489647547d544a681131dad99e058bc) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:22.881810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec5709-2e1d-46d3-b02a-8c307b531258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:22.883216 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec5709-2e1d-46d3-b02a-8c307b531258 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:22.888625 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 654/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Sep 27 04:56:22 2022] GET /identity/v3/role_assignments?user.id=8489647547d544a681131dad99e058bc&scope.project.id=470fa8cf5f4a443faea9cfc628ff6003&role.id=8f26dfbf7a9b44e79ee1fc909b0a058d => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:25.233948 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b2a8a-3f3d-4144-b4d2-ed944adda504 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:25.234618 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b2a8a-3f3d-4144-b4d2-ed944adda504 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:25.234618 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b2a8a-3f3d-4144-b4d2-ed944adda504 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:25.236438 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 634/1288] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:56:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:56:25.242057 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec106f7c-9d2c-4baa-a076-6a556cfd030f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:25.242490 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec106f7c-9d2c-4baa-a076-6a556cfd030f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:25.242612 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec106f7c-9d2c-4baa-a076-6a556cfd030f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:25.261842 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ec106f7c-9d2c-4baa-a076-6a556cfd030f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:56:25.263069 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ec106f7c-9d2c-4baa-a076-6a556cfd030f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:56:25.332061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 655/1289] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:56:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:56:25.355113 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b2a8a-3f3d-4144-b4d2-ed944adda504 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:25.449915 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b2a8a-3f3d-4144-b4d2-ed944adda504 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:25.482004 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226697-f727-4494-a79c-ad4cdf51cafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:25.482780 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226697-f727-4494-a79c-ad4cdf51cafb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:25.483056 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226697-f727-4494-a79c-ad4cdf51cafb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:25.483323 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b226697-f727-4494-a79c-ad4cdf51cafb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:25.484010 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b226697-f727-4494-a79c-ad4cdf51cafb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:25.485861 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b226697-f727-4494-a79c-ad4cdf51cafb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:25.496470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-9b226697-f727-4494-a79c-ad4cdf51cafb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 04:56:25.497615 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 635/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 27 04:56:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:25.503920 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec106f7c-9d2c-4baa-a076-6a556cfd030f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:25.596111 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec106f7c-9d2c-4baa-a076-6a556cfd030f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:25.627560 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0b9f9-d522-43f7-8352-0a625a7bd049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:25.628199 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b9f9-d522-43f7-8352-0a625a7bd049 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:25.628475 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b9f9-d522-43f7-8352-0a625a7bd049 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:25.628744 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0b9f9-d522-43f7-8352-0a625a7bd049 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:25.629456 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0b9f9-d522-43f7-8352-0a625a7bd049 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:25.629753 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0b9f9-d522-43f7-8352-0a625a7bd049 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:25.631093 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0b9f9-d522-43f7-8352-0a625a7bd049 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:25.635704 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 656/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Sep 27 04:56:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:25.641259 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226697-f727-4494-a79c-ad4cdf51cafb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:25.734420 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b226697-f727-4494-a79c-ad4cdf51cafb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:25.765500 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e40e7-6db1-4361-88d2-ebd95c7c8826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:25.766137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e40e7-6db1-4361-88d2-ebd95c7c8826 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:25.766519 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e40e7-6db1-4361-88d2-ebd95c7c8826 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:25.766950 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e40e7-6db1-4361-88d2-ebd95c7c8826 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:25.767646 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e40e7-6db1-4361-88d2-ebd95c7c8826 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:25.767951 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e40e7-6db1-4361-88d2-ebd95c7c8826 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:25.769332 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e40e7-6db1-4361-88d2-ebd95c7c8826 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:25.773518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 636/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Sep 27 04:56:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:28.090827 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15428932-a68b-4e01-ac2f-ff3b278baedb None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:28.091383 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15428932-a68b-4e01-ac2f-ff3b278baedb None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:28.091383 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15428932-a68b-4e01-ac2f-ff3b278baedb None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:28.093181 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 657/1293] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:56:28.098399 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e70244-8063-4c9d-a349-93620ce04434 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:28.098846 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e70244-8063-4c9d-a349-93620ce04434 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:28.098945 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e70244-8063-4c9d-a349-93620ce04434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:28.115338 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-39e70244-8063-4c9d-a349-93620ce04434 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:56:28.116511 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-39e70244-8063-4c9d-a349-93620ce04434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:56:28.179554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 637/1294] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:56:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:56:28.202570 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15428932-a68b-4e01-ac2f-ff3b278baedb None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:28.314421 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15428932-a68b-4e01-ac2f-ff3b278baedb None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:28.345855 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4c304-0093-4358-92ba-4b0186740a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:28.346510 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4c304-0093-4358-92ba-4b0186740a0b None admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:28.346792 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4c304-0093-4358-92ba-4b0186740a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:28.347067 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4c304-0093-4358-92ba-4b0186740a0b None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:28.347792 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4c304-0093-4358-92ba-4b0186740a0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:28.349204 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4c304-0093-4358-92ba-4b0186740a0b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:28.362308 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 658/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Sep 27 04:56:28 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:56:30.688903 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a00d7-a27f-4007-8db7-dc6ed9df2a57 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:30.689456 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a00d7-a27f-4007-8db7-dc6ed9df2a57 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:30.689575 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a00d7-a27f-4007-8db7-dc6ed9df2a57 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:30.691359 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 638/1296] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:56:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:56:30.696470 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763855cc-9982-4843-87fa-dc3bee3044ac None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:30.696918 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763855cc-9982-4843-87fa-dc3bee3044ac None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:30.697025 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763855cc-9982-4843-87fa-dc3bee3044ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:30.714233 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-763855cc-9982-4843-87fa-dc3bee3044ac None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:56:30.715386 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-763855cc-9982-4843-87fa-dc3bee3044ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:56:30.785767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 659/1297] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:56:30 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:56:30.808261 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a00d7-a27f-4007-8db7-dc6ed9df2a57 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:30.903117 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a00d7-a27f-4007-8db7-dc6ed9df2a57 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:30.934862 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a5a9b-f661-4ce6-bc72-29749b6aee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:30.935636 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a5a9b-f661-4ce6-bc72-29749b6aee3d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:30.935909 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a5a9b-f661-4ce6-bc72-29749b6aee3d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:30.936172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a5a9b-f661-4ce6-bc72-29749b6aee3d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:30.936825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a5a9b-f661-4ce6-bc72-29749b6aee3d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:30.938691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a5a9b-f661-4ce6-bc72-29749b6aee3d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:30.949354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-5e7a5a9b-f661-4ce6-bc72-29749b6aee3d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 04:56:30.950780 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 639/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 27 04:56:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 27 04:56:30.956739 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763855cc-9982-4843-87fa-dc3bee3044ac None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:31.051444 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763855cc-9982-4843-87fa-dc3bee3044ac None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:31.082656 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875de86-15f6-442a-8b03-34f31f119368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:31.083325 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875de86-15f6-442a-8b03-34f31f119368 None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:31.083605 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875de86-15f6-442a-8b03-34f31f119368 None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:31.083882 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875de86-15f6-442a-8b03-34f31f119368 None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:31.084578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875de86-15f6-442a-8b03-34f31f119368 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:31.084912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875de86-15f6-442a-8b03-34f31f119368 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:31.086392 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875de86-15f6-442a-8b03-34f31f119368 None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:31.091348 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 660/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Sep 27 04:56:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:31.097955 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a5a9b-f661-4ce6-bc72-29749b6aee3d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:31.190803 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a5a9b-f661-4ce6-bc72-29749b6aee3d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:31.221655 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f7fa9-5d05-4061-b1dd-81115662a331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:31.222231 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f7fa9-5d05-4061-b1dd-81115662a331 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:31.222505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f7fa9-5d05-4061-b1dd-81115662a331 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:31.222773 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f7fa9-5d05-4061-b1dd-81115662a331 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:31.223536 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f7fa9-5d05-4061-b1dd-81115662a331 None admin] RBAC: Adding query filter params (interface=public, service_id=741459b083074c5b898c125266732a07, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:31.223838 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f7fa9-5d05-4061-b1dd-81115662a331 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:31.225209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f7fa9-5d05-4061-b1dd-81115662a331 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:31.230022 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 640/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Sep 27 04:56:31 2022] GET /identity/v3/endpoints?service_id=741459b083074c5b898c125266732a07&interface=public®ion_id=RegionOne => generated 194 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:31.237023 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875de86-15f6-442a-8b03-34f31f119368 None admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:31.341525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875de86-15f6-442a-8b03-34f31f119368 None admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:31.373505 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454526e3-69fb-42d1-bc2a-d28bbf93985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:31.374155 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454526e3-69fb-42d1-bc2a-d28bbf93985b None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:31.374432 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454526e3-69fb-42d1-bc2a-d28bbf93985b None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:31.374703 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454526e3-69fb-42d1-bc2a-d28bbf93985b None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:31.375370 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454526e3-69fb-42d1-bc2a-d28bbf93985b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:31.377595 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454526e3-69fb-42d1-bc2a-d28bbf93985b None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:31.384099 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 661/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Sep 27 04:56:31 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:56:33.700328 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492748f-eb99-4591-844d-9847e4ee7887 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:33.700906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492748f-eb99-4591-844d-9847e4ee7887 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:33.700906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492748f-eb99-4591-844d-9847e4ee7887 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:33.702654 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 641/1302] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:56:33.708458 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab20a7-8a47-4293-a414-d8fa5a476581 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:33.708917 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab20a7-8a47-4293-a414-d8fa5a476581 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:33.709028 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab20a7-8a47-4293-a414-d8fa5a476581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:33.726074 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-02ab20a7-8a47-4293-a414-d8fa5a476581 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:56:33.727233 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-02ab20a7-8a47-4293-a414-d8fa5a476581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:56:33.791018 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 662/1303] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:56:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 27 04:56:33.815017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492748f-eb99-4591-844d-9847e4ee7887 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:33.917079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492748f-eb99-4591-844d-9847e4ee7887 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:33.948170 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38baa2f4-952c-4bab-83fd-bc49c9f5b269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:33.948983 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baa2f4-952c-4bab-83fd-bc49c9f5b269 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:33.949261 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baa2f4-952c-4bab-83fd-bc49c9f5b269 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:33.949535 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baa2f4-952c-4bab-83fd-bc49c9f5b269 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:33.950179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38baa2f4-952c-4bab-83fd-bc49c9f5b269 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:33.951577 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38baa2f4-952c-4bab-83fd-bc49c9f5b269 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:33.962732 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.application [None req-38baa2f4-952c-4bab-83fd-bc49c9f5b269 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 27 04:56:33.963859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 642/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Sep 27 04:56:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 27 04:56:33.969772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab20a7-8a47-4293-a414-d8fa5a476581 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:34.061490 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab20a7-8a47-4293-a414-d8fa5a476581 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:34.093233 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f69b79-0590-40ea-85b0-13f8d1f3cb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:34.093877 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f69b79-0590-40ea-85b0-13f8d1f3cb4a None admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:34.094153 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f69b79-0590-40ea-85b0-13f8d1f3cb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:34.094485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f69b79-0590-40ea-85b0-13f8d1f3cb4a None admin] PATH_INFO: `/v3/services` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:34.095262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f69b79-0590-40ea-85b0-13f8d1f3cb4a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 04:56:34.095563 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f69b79-0590-40ea-85b0-13f8d1f3cb4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:34.096949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f69b79-0590-40ea-85b0-13f8d1f3cb4a None admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:34.101783 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 663/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Sep 27 04:56:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 04:56:34.107597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38baa2f4-952c-4bab-83fd-bc49c9f5b269 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:56:34.202238 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38baa2f4-952c-4bab-83fd-bc49c9f5b269 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:56:34.232784 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b13e0-4a36-43cd-a3ec-18d1e48f2721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:56:34.233450 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b13e0-4a36-43cd-a3ec-18d1e48f2721 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:56:34.233725 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b13e0-4a36-43cd-a3ec-18d1e48f2721 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:56:34.233994 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b13e0-4a36-43cd-a3ec-18d1e48f2721 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:56:34.234731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b13e0-4a36-43cd-a3ec-18d1e48f2721 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:56:34.236731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b13e0-4a36-43cd-a3ec-18d1e48f2721 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:56:34.254540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 643/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 04:56:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 04:57:38.857226 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d52dfd-93f5-4d8d-845c-e09d1712f868 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:38.858257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d52dfd-93f5-4d8d-845c-e09d1712f868 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:38.859283 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d52dfd-93f5-4d8d-845c-e09d1712f868 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:38.865213 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 664/1307] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:57:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:57:38.866622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928902e-2f0f-45a2-bc67-63ca414b6ceb None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:38.867486 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928902e-2f0f-45a2-bc67-63ca414b6ceb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:38.868073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928902e-2f0f-45a2-bc67-63ca414b6ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:38.963541 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7928902e-2f0f-45a2-bc67-63ca414b6ceb None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:57:38.969441 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7928902e-2f0f-45a2-bc67-63ca414b6ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:39.173852 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 644/1308] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:57:39.194953 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d52dfd-93f5-4d8d-845c-e09d1712f868 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:57:39.196714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e5d52dfd-93f5-4d8d-845c-e09d1712f868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:39.350671 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d52dfd-93f5-4d8d-845c-e09d1712f868 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:57:39.473700 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ba1f4-80b7-4c4c-8ca5-532326d4c290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:57:39.474810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ba1f4-80b7-4c4c-8ca5-532326d4c290 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:39.475246 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ba1f4-80b7-4c4c-8ca5-532326d4c290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:39.475661 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ba1f4-80b7-4c4c-8ca5-532326d4c290 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:39.476533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ba1f4-80b7-4c4c-8ca5-532326d4c290 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:57:39.478441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING py.warnings [None req-a61ba1f4-80b7-4c4c-8ca5-532326d4c290 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 04:57:39.478441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: warnings.warn(msg) Sep 27 04:57:39.478441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: Sep 27 04:57:39.479911 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ba1f4-80b7-4c4c-8ca5-532326d4c290 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:57:39.515759 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 665/1309] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 04:57:39 2022] GET /identity/v3/projects => generated 2553 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 04:57:41.891481 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef28c-f8b4-4be9-bad1-5f7d821bcaa2 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:41.892032 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef28c-f8b4-4be9-bad1-5f7d821bcaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:41.892032 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bef28c-f8b4-4be9-bad1-5f7d821bcaa2 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:41.893868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 645/1310] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:57:41.899082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183b637-9948-4ec5-a56f-95f1312acdc8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:41.899489 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183b637-9948-4ec5-a56f-95f1312acdc8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:41.899648 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183b637-9948-4ec5-a56f-95f1312acdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:41.972665 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4183b637-9948-4ec5-a56f-95f1312acdc8 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:57:41.973949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4183b637-9948-4ec5-a56f-95f1312acdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:42.095981 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 666/1311] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:57:42.150894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb714c-2639-4149-b020-63cb424fc663 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:42.151927 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb714c-2639-4149-b020-63cb424fc663 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:42.152211 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb714c-2639-4149-b020-63cb424fc663 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:42.155004 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 646/1312] 10.222.0.27 () {54 vars in 963 bytes} [Tue Sep 27 04:57:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:57:42.161659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb6434-3058-4394-87e8-2cddb15e5752 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:42.161959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb6434-3058-4394-87e8-2cddb15e5752 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:42.162240 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb6434-3058-4394-87e8-2cddb15e5752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:42.237557 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e4eb6434-3058-4394-87e8-2cddb15e5752 None None] MFA Rules not processed for user `639126e5b13345cda6490073ec57f4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:57:42.238797 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e4eb6434-3058-4394-87e8-2cddb15e5752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:42.318412 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 667/1313] 10.222.0.27 () {58 vars in 1060 bytes} [Tue Sep 27 04:57:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:57:42.326912 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb714c-2639-4149-b020-63cb424fc663 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:57:42.328654 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-28bb714c-2639-4149-b020-63cb424fc663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:42.439772 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb714c-2639-4149-b020-63cb424fc663 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:57:42.511559 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12617d5a-6321-4783-90cd-92c49a48b8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:57:42.512350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12617d5a-6321-4783-90cd-92c49a48b8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:42.512637 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12617d5a-6321-4783-90cd-92c49a48b8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:42.512954 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12617d5a-6321-4783-90cd-92c49a48b8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:42.514593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-12617d5a-6321-4783-90cd-92c49a48b8a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:42.620125 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12617d5a-6321-4783-90cd-92c49a48b8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:57:42.621662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12617d5a-6321-4783-90cd-92c49a48b8a9 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:57:42.639429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 647/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:57:45.295170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d49e7-1f0f-4f1e-8f25-7137b43ada46 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:45.295714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d49e7-1f0f-4f1e-8f25-7137b43ada46 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:45.295714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d49e7-1f0f-4f1e-8f25-7137b43ada46 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:45.297937 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 668/1315] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:57:45.303212 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1ecf2-5ef5-46aa-b2e4-29438f6e3787 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:45.303663 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1ecf2-5ef5-46aa-b2e4-29438f6e3787 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:45.303752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1ecf2-5ef5-46aa-b2e4-29438f6e3787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:45.369003 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-87d1ecf2-5ef5-46aa-b2e4-29438f6e3787 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:57:45.370250 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-87d1ecf2-5ef5-46aa-b2e4-29438f6e3787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:45.467146 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 648/1316] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:57:45.505447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d49e7-1f0f-4f1e-8f25-7137b43ada46 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:57:45.506974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5b8d49e7-1f0f-4f1e-8f25-7137b43ada46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:45.607859 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d49e7-1f0f-4f1e-8f25-7137b43ada46 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:57:45.679177 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499290e-b49a-4973-966d-3bfe8d80b77f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:57:45.679814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499290e-b49a-4973-966d-3bfe8d80b77f service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:45.680095 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499290e-b49a-4973-966d-3bfe8d80b77f service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:45.680372 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499290e-b49a-4973-966d-3bfe8d80b77f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:45.682045 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d499290e-b49a-4973-966d-3bfe8d80b77f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:45.788655 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499290e-b49a-4973-966d-3bfe8d80b77f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:57:45.790124 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499290e-b49a-4973-966d-3bfe8d80b77f service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:57:45.807360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 669/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:57:48.445240 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceb9e0-1527-4b40-8229-0d7967678778 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:48.445808 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceb9e0-1527-4b40-8229-0d7967678778 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:48.445808 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceb9e0-1527-4b40-8229-0d7967678778 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:48.447543 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 649/1318] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:57:48.453467 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ff30c-c02d-4609-8c75-9c74a233a754 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:48.453853 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ff30c-c02d-4609-8c75-9c74a233a754 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:48.454009 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ff30c-c02d-4609-8c75-9c74a233a754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:48.516852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-818ff30c-c02d-4609-8c75-9c74a233a754 None None] MFA Rules not processed for user `c4274e0f0eb24597b73957609b982ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:57:48.518037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-818ff30c-c02d-4609-8c75-9c74a233a754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:48.610021 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 670/1319] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:57:48 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:57:48.650988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daceb9e0-1527-4b40-8229-0d7967678778 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:57:48.652498 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-daceb9e0-1527-4b40-8229-0d7967678778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:48.750421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daceb9e0-1527-4b40-8229-0d7967678778 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:57:48.820011 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0e29c-e036-4a2c-a77f-c40d3ad84194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:57:48.820649 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0e29c-e036-4a2c-a77f-c40d3ad84194 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:48.820958 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0e29c-e036-4a2c-a77f-c40d3ad84194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:48.821235 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0e29c-e036-4a2c-a77f-c40d3ad84194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:48.822841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-48c0e29c-e036-4a2c-a77f-c40d3ad84194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:48.924593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0e29c-e036-4a2c-a77f-c40d3ad84194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:57:48.926057 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0e29c-e036-4a2c-a77f-c40d3ad84194 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:57:48.943487 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 650/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:57:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:57:51.812167 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d66c1-dc7b-46bd-b1a9-e405e77b72d3 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:51.812738 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d66c1-dc7b-46bd-b1a9-e405e77b72d3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:51.812853 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d66c1-dc7b-46bd-b1a9-e405e77b72d3 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:51.814639 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 671/1321] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:57:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:57:51.819753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9501380-9d28-40ff-8bcb-d1e4f6894068 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:51.820153 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9501380-9d28-40ff-8bcb-d1e4f6894068 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:51.820306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9501380-9d28-40ff-8bcb-d1e4f6894068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:51.882461 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d9501380-9d28-40ff-8bcb-d1e4f6894068 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:57:51.883637 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d9501380-9d28-40ff-8bcb-d1e4f6894068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:51.974182 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 651/1322] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:57:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:57:52.013474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d66c1-dc7b-46bd-b1a9-e405e77b72d3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:57:52.015768 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-539d66c1-dc7b-46bd-b1a9-e405e77b72d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:52.114953 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d66c1-dc7b-46bd-b1a9-e405e77b72d3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:57:52.184667 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9b60b-db8d-4525-81a6-1b1a0976e28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:57:52.185324 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9b60b-db8d-4525-81a6-1b1a0976e28c service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:52.185602 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9b60b-db8d-4525-81a6-1b1a0976e28c service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:52.185872 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9b60b-db8d-4525-81a6-1b1a0976e28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:52.188279 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2bf9b60b-db8d-4525-81a6-1b1a0976e28c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:52.292319 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9b60b-db8d-4525-81a6-1b1a0976e28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:57:52.293787 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9b60b-db8d-4525-81a6-1b1a0976e28c service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:57:52.310828 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 672/1323] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:57:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:57:55.307571 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0e8da-af97-4c37-b053-d46561120142 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:55.308158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0e8da-af97-4c37-b053-d46561120142 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:55.308158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0e8da-af97-4c37-b053-d46561120142 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:55.309920 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 652/1324] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:57:55.316172 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d885e2-7b97-4775-90df-2ec788cb104d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:55.316570 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d885e2-7b97-4775-90df-2ec788cb104d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:55.316760 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d885e2-7b97-4775-90df-2ec788cb104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:55.379540 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-88d885e2-7b97-4775-90df-2ec788cb104d None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:57:55.380717 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-88d885e2-7b97-4775-90df-2ec788cb104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:55.474411 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 673/1325] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:57:55.527510 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f5938-f63d-4fb6-9375-5f89d20c43d7 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:55.527799 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f5938-f63d-4fb6-9375-5f89d20c43d7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:55.528080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f5938-f63d-4fb6-9375-5f89d20c43d7 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:55.529932 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 653/1326] 10.222.0.27 () {54 vars in 963 bytes} [Tue Sep 27 04:57:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:57:55.536107 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e15a8-dfa4-44fc-b5c1-18ddf0eff5c6 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:55.536398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e15a8-dfa4-44fc-b5c1-18ddf0eff5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:55.536677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e15a8-dfa4-44fc-b5c1-18ddf0eff5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:55.611151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-429e15a8-dfa4-44fc-b5c1-18ddf0eff5c6 None None] MFA Rules not processed for user `639126e5b13345cda6490073ec57f4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:57:55.612256 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-429e15a8-dfa4-44fc-b5c1-18ddf0eff5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:55.684272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 674/1327] 10.222.0.27 () {58 vars in 1060 bytes} [Tue Sep 27 04:57:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:57:55.693449 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f5938-f63d-4fb6-9375-5f89d20c43d7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:57:55.695037 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7a3f5938-f63d-4fb6-9375-5f89d20c43d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:55.798603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f5938-f63d-4fb6-9375-5f89d20c43d7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:57:55.869141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafe259-1242-476f-8604-c318243b2aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:57:55.869794 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafe259-1242-476f-8604-c318243b2aaa service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:55.870077 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafe259-1242-476f-8604-c318243b2aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:55.870352 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafe259-1242-476f-8604-c318243b2aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:55.871989 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2cafe259-1242-476f-8604-c318243b2aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:55.980203 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafe259-1242-476f-8604-c318243b2aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:57:55.981692 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafe259-1242-476f-8604-c318243b2aaa service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:57:55.999612 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 654/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:57:58.642491 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaf61c-29fa-48a2-a32d-bf815e6dabd1 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:58.643148 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaf61c-29fa-48a2-a32d-bf815e6dabd1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:58.643148 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaf61c-29fa-48a2-a32d-bf815e6dabd1 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:58.644948 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 675/1329] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:57:58.650091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013d3ae-f2e1-4759-ad2e-43cdd32f7314 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:58.650524 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013d3ae-f2e1-4759-ad2e-43cdd32f7314 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:58.650652 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013d3ae-f2e1-4759-ad2e-43cdd32f7314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:58.714245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f013d3ae-f2e1-4759-ad2e-43cdd32f7314 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:57:58.715418 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f013d3ae-f2e1-4759-ad2e-43cdd32f7314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:58.809504 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 655/1330] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:57:58.845897 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaf61c-29fa-48a2-a32d-bf815e6dabd1 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:57:58.847425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0bfaf61c-29fa-48a2-a32d-bf815e6dabd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:58.950777 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaf61c-29fa-48a2-a32d-bf815e6dabd1 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:57:59.024895 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ca33b-944e-454f-91db-2cafd80c948a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:57:59.025538 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ca33b-944e-454f-91db-2cafd80c948a service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:57:59.025813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ca33b-944e-454f-91db-2cafd80c948a service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:57:59.026083 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ca33b-944e-454f-91db-2cafd80c948a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:57:59.027687 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c70ca33b-944e-454f-91db-2cafd80c948a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:57:59.134030 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ca33b-944e-454f-91db-2cafd80c948a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:57:59.135486 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ca33b-944e-454f-91db-2cafd80c948a service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:57:59.153787 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 676/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:58:01.552732 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5f3fe-3404-4fb4-ad18-3492f278a68f None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:01.553309 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5f3fe-3404-4fb4-ad18-3492f278a68f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:01.553309 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5f3fe-3404-4fb4-ad18-3492f278a68f None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:01.555133 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 656/1332] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:01.561130 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b786d-d961-44ed-9536-8c2d3c6781c4 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:01.561801 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b786d-d961-44ed-9536-8c2d3c6781c4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:01.561801 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b786d-d961-44ed-9536-8c2d3c6781c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:01.625489 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-026b786d-d961-44ed-9536-8c2d3c6781c4 None None] MFA Rules not processed for user `c4274e0f0eb24597b73957609b982ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:01.626925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-026b786d-d961-44ed-9536-8c2d3c6781c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:01.719930 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 677/1333] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:58:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:01.758177 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5f3fe-3404-4fb4-ad18-3492f278a68f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:58:01.759778 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8fc5f3fe-3404-4fb4-ad18-3492f278a68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:01.859246 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5f3fe-3404-4fb4-ad18-3492f278a68f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:58:01.930643 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba19060-67ae-4ace-8da5-bef865029167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:58:01.931287 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba19060-67ae-4ace-8da5-bef865029167 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:01.931569 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba19060-67ae-4ace-8da5-bef865029167 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:01.931847 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba19060-67ae-4ace-8da5-bef865029167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:01.933515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fba19060-67ae-4ace-8da5-bef865029167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:02.042579 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba19060-67ae-4ace-8da5-bef865029167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:58:02.044048 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba19060-67ae-4ace-8da5-bef865029167 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:58:02.064099 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 657/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:58:01 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:58:04.848392 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158398d8-13a3-45ed-864d-e52a92a1e986 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:04.848889 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158398d8-13a3-45ed-864d-e52a92a1e986 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:04.848889 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158398d8-13a3-45ed-864d-e52a92a1e986 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:04.850830 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 678/1335] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:04.855803 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98b22d-5acd-485b-a458-7998ba87f870 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:04.856197 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98b22d-5acd-485b-a458-7998ba87f870 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:04.856363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98b22d-5acd-485b-a458-7998ba87f870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:04.922329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6c98b22d-5acd-485b-a458-7998ba87f870 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:04.923760 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6c98b22d-5acd-485b-a458-7998ba87f870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:05.022538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 658/1336] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:05.059326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158398d8-13a3-45ed-864d-e52a92a1e986 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:58:05.061825 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-158398d8-13a3-45ed-864d-e52a92a1e986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:05.177469 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158398d8-13a3-45ed-864d-e52a92a1e986 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:58:05.250505 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42436a-a370-4ea7-939d-e03dac1f5c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:58:05.251156 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42436a-a370-4ea7-939d-e03dac1f5c38 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:05.251688 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42436a-a370-4ea7-939d-e03dac1f5c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:05.251968 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42436a-a370-4ea7-939d-e03dac1f5c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:05.253650 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ea42436a-a370-4ea7-939d-e03dac1f5c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:05.359913 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42436a-a370-4ea7-939d-e03dac1f5c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:58:05.361397 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42436a-a370-4ea7-939d-e03dac1f5c38 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:58:05.379856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 679/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:58:07.796097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054933d8-b488-4658-ab34-5796cf0ebc2c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:07.796652 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054933d8-b488-4658-ab34-5796cf0ebc2c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:07.796652 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054933d8-b488-4658-ab34-5796cf0ebc2c None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:07.798478 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 659/1338] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:07.803764 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289222-c0b0-4ae1-9e3c-7e1fe86114f9 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:07.804191 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289222-c0b0-4ae1-9e3c-7e1fe86114f9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:07.804318 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e289222-c0b0-4ae1-9e3c-7e1fe86114f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:07.867586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2e289222-c0b0-4ae1-9e3c-7e1fe86114f9 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:07.868766 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2e289222-c0b0-4ae1-9e3c-7e1fe86114f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:07.962985 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 680/1339] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:08.005891 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054933d8-b488-4658-ab34-5796cf0ebc2c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:58:08.007401 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-054933d8-b488-4658-ab34-5796cf0ebc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:08.108719 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054933d8-b488-4658-ab34-5796cf0ebc2c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:58:08.179537 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ccacb-5af1-4b3f-b2c4-ae0370071d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:58:08.180176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ccacb-5af1-4b3f-b2c4-ae0370071d96 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:08.180450 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ccacb-5af1-4b3f-b2c4-ae0370071d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:08.180719 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ccacb-5af1-4b3f-b2c4-ae0370071d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:08.182370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-352ccacb-5af1-4b3f-b2c4-ae0370071d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:08.288298 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ccacb-5af1-4b3f-b2c4-ae0370071d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:58:08.289752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ccacb-5af1-4b3f-b2c4-ae0370071d96 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:58:08.306869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 660/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:58:11.115340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afb003-6c40-412b-9fb3-3ce7deb5f061 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:11.115861 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afb003-6c40-412b-9fb3-3ce7deb5f061 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:11.115861 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afb003-6c40-412b-9fb3-3ce7deb5f061 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:11.117693 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 681/1341] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:11.123577 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68257ad7-6802-47f1-b82f-c4a4c1d4251d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:11.124019 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68257ad7-6802-47f1-b82f-c4a4c1d4251d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:11.124124 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68257ad7-6802-47f1-b82f-c4a4c1d4251d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:11.191944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-68257ad7-6802-47f1-b82f-c4a4c1d4251d None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:11.193171 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-68257ad7-6802-47f1-b82f-c4a4c1d4251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:11.295436 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 661/1342] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:58:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:11.331825 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afb003-6c40-412b-9fb3-3ce7deb5f061 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:58:11.334014 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b9afb003-6c40-412b-9fb3-3ce7deb5f061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:11.427847 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afb003-6c40-412b-9fb3-3ce7deb5f061 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:58:11.431394 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2bb61-8d74-43fd-a011-95c2653a666e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:58:11.432031 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2bb61-8d74-43fd-a011-95c2653a666e service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:11.432310 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2bb61-8d74-43fd-a011-95c2653a666e service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:11.432586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2bb61-8d74-43fd-a011-95c2653a666e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:11.441424 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2bb61-8d74-43fd-a011-95c2653a666e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:58:11.442861 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2bb61-8d74-43fd-a011-95c2653a666e service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:58:11.452150 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 682/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:58:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:58:15.757753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227bad3-4942-421a-a012-49504008bd38 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:15.758294 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227bad3-4942-421a-a012-49504008bd38 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:15.758294 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227bad3-4942-421a-a012-49504008bd38 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:15.760088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 662/1344] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:15.766074 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de1687-072c-4035-9285-750d9b6feb99 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:15.766513 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de1687-072c-4035-9285-750d9b6feb99 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:15.766688 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de1687-072c-4035-9285-750d9b6feb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:15.796053 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-94de1687-072c-4035-9285-750d9b6feb99 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:15.797258 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-94de1687-072c-4035-9285-750d9b6feb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:15.872856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 683/1345] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:15.912578 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227bad3-4942-421a-a012-49504008bd38 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:58:15.923649 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227bad3-4942-421a-a012-49504008bd38 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:58:15.927164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde4286-2327-458e-b2dc-cc2d1b2ddd69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:58:15.927799 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde4286-2327-458e-b2dc-cc2d1b2ddd69 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:15.928077 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde4286-2327-458e-b2dc-cc2d1b2ddd69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:15.928351 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde4286-2327-458e-b2dc-cc2d1b2ddd69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:15.937266 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde4286-2327-458e-b2dc-cc2d1b2ddd69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:58:15.938702 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde4286-2327-458e-b2dc-cc2d1b2ddd69 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:58:15.947911 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 663/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:58:18.890421 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da35759-fe0a-445a-80f4-378e8966bef6 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:18.890959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da35759-fe0a-445a-80f4-378e8966bef6 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:18.890959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da35759-fe0a-445a-80f4-378e8966bef6 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:18.892860 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 684/1347] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:18.898230 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f04828-7c57-4b22-9af4-69efd7963e8b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:18.898645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f04828-7c57-4b22-9af4-69efd7963e8b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:18.898885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f04828-7c57-4b22-9af4-69efd7963e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:18.916314 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e2f04828-7c57-4b22-9af4-69efd7963e8b None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:18.917533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e2f04828-7c57-4b22-9af4-69efd7963e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:18.925406 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 664/1348] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:58:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:18.963249 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da35759-fe0a-445a-80f4-378e8966bef6 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:58:18.976772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da35759-fe0a-445a-80f4-378e8966bef6 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:58:18.980307 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc7415-7381-4552-88e7-ead4b58f8126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:58:18.980972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7415-7381-4552-88e7-ead4b58f8126 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:18.981268 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7415-7381-4552-88e7-ead4b58f8126 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:18.981534 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7415-7381-4552-88e7-ead4b58f8126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:18.991442 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc7415-7381-4552-88e7-ead4b58f8126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:58:18.992914 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc7415-7381-4552-88e7-ead4b58f8126 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:58:19.004037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 685/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:58:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:58:23.404416 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf983a8-3faa-4805-af1f-acdc1454735c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:23.404990 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf983a8-3faa-4805-af1f-acdc1454735c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:23.405166 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf983a8-3faa-4805-af1f-acdc1454735c None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:23.407008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 665/1350] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:58:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:23.412194 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e3179-9d3c-4704-a45e-ef0d82bc1c22 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:23.412628 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e3179-9d3c-4704-a45e-ef0d82bc1c22 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:23.412728 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e3179-9d3c-4704-a45e-ef0d82bc1c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:23.430250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7d2e3179-9d3c-4704-a45e-ef0d82bc1c22 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:23.431421 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7d2e3179-9d3c-4704-a45e-ef0d82bc1c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:23.439809 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 686/1351] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:23.478704 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf983a8-3faa-4805-af1f-acdc1454735c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:58:23.489783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf983a8-3faa-4805-af1f-acdc1454735c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:58:23.493254 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16db117-fcc2-412e-b42a-2b2e73ff434f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:58:23.493888 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16db117-fcc2-412e-b42a-2b2e73ff434f service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:23.494168 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16db117-fcc2-412e-b42a-2b2e73ff434f service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:23.494442 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16db117-fcc2-412e-b42a-2b2e73ff434f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:23.503933 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16db117-fcc2-412e-b42a-2b2e73ff434f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:58:23.505408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16db117-fcc2-412e-b42a-2b2e73ff434f service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:58:23.514674 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 666/1352] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:58:28.960269 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821fb9-37d0-45cf-b241-d0061a9bb795 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:28.961185 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821fb9-37d0-45cf-b241-d0061a9bb795 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:28.961612 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821fb9-37d0-45cf-b241-d0061a9bb795 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:28.964696 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 687/1353] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 27 04:58:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:28.971613 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455c60e-5995-4be6-b760-2a4f0c421c2e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:28.978857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455c60e-5995-4be6-b760-2a4f0c421c2e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:28.979310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455c60e-5995-4be6-b760-2a4f0c421c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:29.061744 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e455c60e-5995-4be6-b760-2a4f0c421c2e None None] MFA Rules not processed for user `8489647547d544a681131dad99e058bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:29.063170 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e455c60e-5995-4be6-b760-2a4f0c421c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:29.156695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 667/1354] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 27 04:58:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:58:33.548042 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6208f1-2a35-422e-ab7a-675a0374aeb7 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:33.548639 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6208f1-2a35-422e-ab7a-675a0374aeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:33.548639 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6208f1-2a35-422e-ab7a-675a0374aeb7 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:33.552881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 688/1355] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 27 04:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:33.560585 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e625c51-cd4a-4517-b646-aef9d19fc17d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:33.561172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e625c51-cd4a-4517-b646-aef9d19fc17d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:33.561172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e625c51-cd4a-4517-b646-aef9d19fc17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:33.581121 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8e625c51-cd4a-4517-b646-aef9d19fc17d None None] MFA Rules not processed for user `8489647547d544a681131dad99e058bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:33.582411 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8e625c51-cd4a-4517-b646-aef9d19fc17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:33.592131 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 668/1356] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 27 04:58:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:35.151826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e94d1-dda5-4a64-900e-3e133ffb512d None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:35.152341 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e94d1-dda5-4a64-900e-3e133ffb512d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:35.152441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e94d1-dda5-4a64-900e-3e133ffb512d None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:35.154225 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 689/1357] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 27 04:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:35.159265 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5df519-e36f-409d-bbdd-cfea63ae9023 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:35.159685 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5df519-e36f-409d-bbdd-cfea63ae9023 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:35.159939 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5df519-e36f-409d-bbdd-cfea63ae9023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:35.179741 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6c5df519-e36f-409d-bbdd-cfea63ae9023 None None] MFA Rules not processed for user `8489647547d544a681131dad99e058bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:35.181007 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6c5df519-e36f-409d-bbdd-cfea63ae9023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:35.193873 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 669/1358] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 27 04:58:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:39.212693 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2b0de-e09c-4ef8-bc9b-3b7db9ab26d3 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:39.213358 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2b0de-e09c-4ef8-bc9b-3b7db9ab26d3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:39.213358 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2b0de-e09c-4ef8-bc9b-3b7db9ab26d3 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:39.215463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 690/1359] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:39.220679 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f36f7-5eab-4fa8-bbc3-c3c5ad2ea304 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:39.221169 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f36f7-5eab-4fa8-bbc3-c3c5ad2ea304 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:39.221263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f36f7-5eab-4fa8-bbc3-c3c5ad2ea304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:39.240850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9f0f36f7-5eab-4fa8-bbc3-c3c5ad2ea304 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:39.242349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9f0f36f7-5eab-4fa8-bbc3-c3c5ad2ea304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:39.253456 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 670/1360] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:39.305620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaf260-4927-40f7-b105-e85442d2fc52 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:39.306268 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaf260-4927-40f7-b105-e85442d2fc52 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:39.306984 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaf260-4927-40f7-b105-e85442d2fc52 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:39.310609 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 691/1361] 10.222.0.27 () {54 vars in 959 bytes} [Tue Sep 27 04:58:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:39.317134 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8127a05-8020-4458-a17e-d78091aa5679 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:39.317657 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8127a05-8020-4458-a17e-d78091aa5679 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:39.318100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8127a05-8020-4458-a17e-d78091aa5679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:39.372693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e8127a05-8020-4458-a17e-d78091aa5679 None None] MFA Rules not processed for user `faac84ed9d37420c811bbf6ac7df0b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:39.374062 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e8127a05-8020-4458-a17e-d78091aa5679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:39.465385 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 671/1362] 10.222.0.27 () {58 vars in 1056 bytes} [Tue Sep 27 04:58:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:39.473555 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eaf260-4927-40f7-b105-e85442d2fc52 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:58:39.489587 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eaf260-4927-40f7-b105-e85442d2fc52 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:58:39.496463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f295c-cad1-4826-b398-bd4aa779bf89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:58:39.497188 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f295c-cad1-4826-b398-bd4aa779bf89 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:39.497634 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f295c-cad1-4826-b398-bd4aa779bf89 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:39.497942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f295c-cad1-4826-b398-bd4aa779bf89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:39.507934 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f295c-cad1-4826-b398-bd4aa779bf89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:58:39.509656 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f295c-cad1-4826-b398-bd4aa779bf89 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:58:39.523520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 692/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:58:42.150254 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9ff60-55dd-4a15-849f-d610bab78cfb None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:42.150758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9ff60-55dd-4a15-849f-d610bab78cfb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:42.150884 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9ff60-55dd-4a15-849f-d610bab78cfb None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:42.152752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 672/1364] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:42.157889 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e593baf-869e-4e84-93d2-d752c9299627 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:42.158334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e593baf-869e-4e84-93d2-d752c9299627 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:42.158425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e593baf-869e-4e84-93d2-d752c9299627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:42.176261 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0e593baf-869e-4e84-93d2-d752c9299627 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:42.177441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0e593baf-869e-4e84-93d2-d752c9299627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:42.185977 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 693/1365] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:42.230163 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9ff60-55dd-4a15-849f-d610bab78cfb None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:58:42.244873 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9ff60-55dd-4a15-849f-d610bab78cfb None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:58:42.251909 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a9ebf-e86b-4f9a-ba58-7f32856d086d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:58:42.252543 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a9ebf-e86b-4f9a-ba58-7f32856d086d service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:42.252843 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a9ebf-e86b-4f9a-ba58-7f32856d086d service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:42.253120 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a9ebf-e86b-4f9a-ba58-7f32856d086d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:42.262067 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a9ebf-e86b-4f9a-ba58-7f32856d086d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:58:42.263637 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a9ebf-e86b-4f9a-ba58-7f32856d086d service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:58:42.273078 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 673/1366] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:58:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:58:44.966676 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9cfa3-d2df-4d71-b4fd-5e8c88ba6952 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:44.967170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9cfa3-d2df-4d71-b4fd-5e8c88ba6952 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:44.967287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9cfa3-d2df-4d71-b4fd-5e8c88ba6952 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:44.969140 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 694/1367] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:44.974431 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e32a85-71b8-4187-9199-eed23ca3cb00 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:44.974851 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e32a85-71b8-4187-9199-eed23ca3cb00 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:44.974984 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e32a85-71b8-4187-9199-eed23ca3cb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:44.993842 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e9e32a85-71b8-4187-9199-eed23ca3cb00 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:44.995042 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e9e32a85-71b8-4187-9199-eed23ca3cb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:45.004414 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 674/1368] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:45.056038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3c35-20ed-409b-ade3-e71adee18f26 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:45.056326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3c35-20ed-409b-ade3-e71adee18f26 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:45.056608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3c35-20ed-409b-ade3-e71adee18f26 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:45.059180 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 695/1369] 10.222.0.27 () {54 vars in 959 bytes} [Tue Sep 27 04:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:45.066219 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cff463-1dbd-4806-a9d0-5c837e29202c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:45.066563 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cff463-1dbd-4806-a9d0-5c837e29202c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:45.066939 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cff463-1dbd-4806-a9d0-5c837e29202c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:45.088143 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a3cff463-1dbd-4806-a9d0-5c837e29202c None None] MFA Rules not processed for user `faac84ed9d37420c811bbf6ac7df0b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:45.089711 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a3cff463-1dbd-4806-a9d0-5c837e29202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:45.107793 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 675/1370] 10.222.0.27 () {58 vars in 1056 bytes} [Tue Sep 27 04:58:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:45.108952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe3c35-20ed-409b-ade3-e71adee18f26 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:58:45.127077 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe3c35-20ed-409b-ade3-e71adee18f26 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:58:45.132670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75168bfc-a595-4421-80aa-a952410a7412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:58:45.133466 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75168bfc-a595-4421-80aa-a952410a7412 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:45.133753 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75168bfc-a595-4421-80aa-a952410a7412 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:45.134029 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75168bfc-a595-4421-80aa-a952410a7412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:45.144848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75168bfc-a595-4421-80aa-a952410a7412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:58:45.146672 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75168bfc-a595-4421-80aa-a952410a7412 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:58:45.157930 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 696/1371] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:58:47.548912 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff3e76-cc4f-42ad-afa9-b2ad46c8ea1f None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:47.549490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff3e76-cc4f-42ad-afa9-b2ad46c8ea1f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:47.549490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff3e76-cc4f-42ad-afa9-b2ad46c8ea1f None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:47.551224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 676/1372] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:47.556522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39792d3-4618-4b33-b002-7df856a20444 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:47.556988 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39792d3-4618-4b33-b002-7df856a20444 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:47.557103 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39792d3-4618-4b33-b002-7df856a20444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:47.562198 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5c6f9-da46-4bc8-9f7b-93ebb65cc2aa None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:47.562489 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5c6f9-da46-4bc8-9f7b-93ebb65cc2aa None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:47.562769 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5c6f9-da46-4bc8-9f7b-93ebb65cc2aa None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:47.564498 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 677/1373] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:58:47.569515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f5952-41d0-4695-ab2d-e6903fc68845 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:47.569805 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f5952-41d0-4695-ab2d-e6903fc68845 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:47.570081 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f5952-41d0-4695-ab2d-e6903fc68845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:47.577486 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b39792d3-4618-4b33-b002-7df856a20444 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:47.578689 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b39792d3-4618-4b33-b002-7df856a20444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:47.587767 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c55f5952-41d0-4695-ab2d-e6903fc68845 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:47.588521 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 697/1374] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:47.588980 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c55f5952-41d0-4695-ab2d-e6903fc68845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:47.597497 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 678/1375] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:58:47.643326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39792d3-4618-4b33-b002-7df856a20444 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:58:47.656577 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39792d3-4618-4b33-b002-7df856a20444 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:58:47.662347 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a46a8c-532c-4aed-9004-94cdf0894d0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:58:47.663108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a46a8c-532c-4aed-9004-94cdf0894d0d service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:47.663484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a46a8c-532c-4aed-9004-94cdf0894d0d service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:47.663857 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a46a8c-532c-4aed-9004-94cdf0894d0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:47.673210 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a46a8c-532c-4aed-9004-94cdf0894d0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:58:47.674927 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a46a8c-532c-4aed-9004-94cdf0894d0d service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:58:47.684823 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 698/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:58:47.848445 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c5cbc-80da-4d12-bc35-c3887ffba8fd None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:47.848913 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c5cbc-80da-4d12-bc35-c3887ffba8fd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:47.849297 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c5cbc-80da-4d12-bc35-c3887ffba8fd None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:47.851729 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 679/1377] 10.222.0.27 () {54 vars in 962 bytes} [Tue Sep 27 04:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:47.857361 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b8c6e-4de5-4505-94ff-98e5578d395d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:47.857648 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b8c6e-4de5-4505-94ff-98e5578d395d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:47.858108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b8c6e-4de5-4505-94ff-98e5578d395d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:47.913617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d19b8c6e-4de5-4505-94ff-98e5578d395d None None] MFA Rules not processed for user `9ba2cc8ae41b435d830e58327893f527`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:47.914842 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d19b8c6e-4de5-4505-94ff-98e5578d395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:47.994110 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 699/1378] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Sep 27 04:58:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:48.001960 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c5cbc-80da-4d12-bc35-c3887ffba8fd None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:58:48.013985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c5cbc-80da-4d12-bc35-c3887ffba8fd None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:58:48.017647 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240b0fa-c901-4d66-a5de-f4b816386d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:58:48.018277 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240b0fa-c901-4d66-a5de-f4b816386d1e service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:48.018554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240b0fa-c901-4d66-a5de-f4b816386d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:48.018824 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240b0fa-c901-4d66-a5de-f4b816386d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:48.029450 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240b0fa-c901-4d66-a5de-f4b816386d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:58:48.031104 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240b0fa-c901-4d66-a5de-f4b816386d1e service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:58:48.041265 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 680/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:58:50.093152 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688c20a-ff82-4c7e-b680-b09b0a06c1c5 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:50.093656 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688c20a-ff82-4c7e-b680-b09b0a06c1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:50.093758 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688c20a-ff82-4c7e-b680-b09b0a06c1c5 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:50.096007 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 700/1380] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:58:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:50.101445 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8833ef-7e45-4470-bbfd-3958a9ea6532 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:50.101880 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8833ef-7e45-4470-bbfd-3958a9ea6532 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:50.102010 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8833ef-7e45-4470-bbfd-3958a9ea6532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:50.121131 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-af8833ef-7e45-4470-bbfd-3958a9ea6532 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:50.122431 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-af8833ef-7e45-4470-bbfd-3958a9ea6532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:50.130676 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 681/1381] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:50.175733 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688c20a-ff82-4c7e-b680-b09b0a06c1c5 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:58:50.190839 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688c20a-ff82-4c7e-b680-b09b0a06c1c5 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:58:50.196341 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2da585-83d0-400a-87ee-7153c8420d86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:58:50.197009 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2da585-83d0-400a-87ee-7153c8420d86 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:50.197338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2da585-83d0-400a-87ee-7153c8420d86 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:50.197611 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2da585-83d0-400a-87ee-7153c8420d86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:50.206427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2da585-83d0-400a-87ee-7153c8420d86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:58:50.208012 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2da585-83d0-400a-87ee-7153c8420d86 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:58:50.217549 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 701/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:58:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:58:52.588401 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada08269-163c-4df6-b056-4bfd22e174ee None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:52.589044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada08269-163c-4df6-b056-4bfd22e174ee None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:52.589044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada08269-163c-4df6-b056-4bfd22e174ee None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:52.591136 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 682/1383] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:52.596139 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc23307-c8a9-4013-be12-b34b995d9b4a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:52.596532 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc23307-c8a9-4013-be12-b34b995d9b4a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:52.596691 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc23307-c8a9-4013-be12-b34b995d9b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:52.614888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-6fc23307-c8a9-4013-be12-b34b995d9b4a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:52.616063 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6fc23307-c8a9-4013-be12-b34b995d9b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:52.624340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 702/1384] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:52.668420 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada08269-163c-4df6-b056-4bfd22e174ee None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:58:52.683530 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada08269-163c-4df6-b056-4bfd22e174ee None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:58:52.689049 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc5979-ba4e-4b9e-8859-7c018c9c4b30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:58:52.689679 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc5979-ba4e-4b9e-8859-7c018c9c4b30 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:52.689960 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc5979-ba4e-4b9e-8859-7c018c9c4b30 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:52.690234 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc5979-ba4e-4b9e-8859-7c018c9c4b30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:52.699354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc5979-ba4e-4b9e-8859-7c018c9c4b30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:58:52.700960 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc5979-ba4e-4b9e-8859-7c018c9c4b30 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:58:52.710869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 683/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:58:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:58:55.133427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ef264-2fcf-4e9e-9f9e-f58cd7d404bd None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:55.133989 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ef264-2fcf-4e9e-9f9e-f58cd7d404bd None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:55.133989 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ef264-2fcf-4e9e-9f9e-f58cd7d404bd None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:55.135898 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 703/1386] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:55.141554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28baa7d-5443-4fe5-8da7-83c5f22f40ad None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:55.142018 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28baa7d-5443-4fe5-8da7-83c5f22f40ad None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:55.142095 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28baa7d-5443-4fe5-8da7-83c5f22f40ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:55.161272 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d28baa7d-5443-4fe5-8da7-83c5f22f40ad None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:55.162477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d28baa7d-5443-4fe5-8da7-83c5f22f40ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:55.171440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 684/1387] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:55.215605 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ef264-2fcf-4e9e-9f9e-f58cd7d404bd None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:58:55.230705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ef264-2fcf-4e9e-9f9e-f58cd7d404bd None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:58:55.236427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a37a1-c53b-4442-a09b-5bd2fd2defa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:58:55.237259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a37a1-c53b-4442-a09b-5bd2fd2defa2 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:55.237635 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a37a1-c53b-4442-a09b-5bd2fd2defa2 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:55.238003 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a37a1-c53b-4442-a09b-5bd2fd2defa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:55.248021 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a37a1-c53b-4442-a09b-5bd2fd2defa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:58:55.249856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a37a1-c53b-4442-a09b-5bd2fd2defa2 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:58:55.261297 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 704/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:58:57.777270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15056e-11b3-4db9-95c3-0ab84004a509 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:57.777842 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15056e-11b3-4db9-95c3-0ab84004a509 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:57.777940 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15056e-11b3-4db9-95c3-0ab84004a509 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:57.779739 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 685/1389] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:58:57.785717 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f8738-8b22-41d6-b16f-9bb2b9a58d20 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:57.786224 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f8738-8b22-41d6-b16f-9bb2b9a58d20 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:57.786333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f8738-8b22-41d6-b16f-9bb2b9a58d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:57.807176 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-290f8738-8b22-41d6-b16f-9bb2b9a58d20 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:58:57.809423 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-290f8738-8b22-41d6-b16f-9bb2b9a58d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:58:57.818314 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 705/1390] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:58:57.868473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15056e-11b3-4db9-95c3-0ab84004a509 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:58:57.883086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15056e-11b3-4db9-95c3-0ab84004a509 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:58:57.888650 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc1676-f9ef-48b9-a080-d2191942106a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:58:57.889322 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc1676-f9ef-48b9-a080-d2191942106a service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:58:57.889603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc1676-f9ef-48b9-a080-d2191942106a service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:58:57.889878 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc1676-f9ef-48b9-a080-d2191942106a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:58:57.898163 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc1676-f9ef-48b9-a080-d2191942106a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:58:57.899754 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc1676-f9ef-48b9-a080-d2191942106a service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:58:57.909870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 686/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:00.542071 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85f362-63fe-4fa8-a327-8ef5da971491 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:00.542725 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85f362-63fe-4fa8-a327-8ef5da971491 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:00.542725 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85f362-63fe-4fa8-a327-8ef5da971491 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:00.544452 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 706/1392] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:00.550277 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d56e3-b024-418b-86b9-897a3c75d441 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:00.550712 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d56e3-b024-418b-86b9-897a3c75d441 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:00.550835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d56e3-b024-418b-86b9-897a3c75d441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:00.569369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-199d56e3-b024-418b-86b9-897a3c75d441 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:00.570605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-199d56e3-b024-418b-86b9-897a3c75d441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:00.579478 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 687/1393] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:00.624403 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85f362-63fe-4fa8-a327-8ef5da971491 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:00.639737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85f362-63fe-4fa8-a327-8ef5da971491 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:00.645150 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1dd88-7d8a-4971-874a-02ca5c5e37ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:00.645778 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1dd88-7d8a-4971-874a-02ca5c5e37ed service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:00.646056 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1dd88-7d8a-4971-874a-02ca5c5e37ed service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:00.646327 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1dd88-7d8a-4971-874a-02ca5c5e37ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:00.655764 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1dd88-7d8a-4971-874a-02ca5c5e37ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:00.657426 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1dd88-7d8a-4971-874a-02ca5c5e37ed service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:00.667268 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 707/1394] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:03.087694 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef6952-b5ca-4cf4-9f88-fa5f92e719af None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:03.088213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef6952-b5ca-4cf4-9f88-fa5f92e719af None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:03.088213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef6952-b5ca-4cf4-9f88-fa5f92e719af None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:03.090822 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 688/1395] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:59:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:03.097742 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af82b9-2de3-4a31-a74d-f850c32fb43f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:03.098176 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af82b9-2de3-4a31-a74d-f850c32fb43f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:03.098485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af82b9-2de3-4a31-a74d-f850c32fb43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:03.119183 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-99af82b9-2de3-4a31-a74d-f850c32fb43f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:03.120959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-99af82b9-2de3-4a31-a74d-f850c32fb43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:03.129163 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 708/1396] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:03.183583 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef6952-b5ca-4cf4-9f88-fa5f92e719af None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:03.197604 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef6952-b5ca-4cf4-9f88-fa5f92e719af None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:03.203334 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3ccde-b345-47fe-bd37-f99bc6e3778e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:03.203971 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3ccde-b345-47fe-bd37-f99bc6e3778e service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:03.204251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3ccde-b345-47fe-bd37-f99bc6e3778e service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:03.204520 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3ccde-b345-47fe-bd37-f99bc6e3778e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:03.213060 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3ccde-b345-47fe-bd37-f99bc6e3778e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:03.215608 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3ccde-b345-47fe-bd37-f99bc6e3778e service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:03.225098 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 689/1397] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:05.611457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a61993-09b0-4f6a-9bee-8d2af38487af None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:05.612074 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a61993-09b0-4f6a-9bee-8d2af38487af None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:05.612074 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a61993-09b0-4f6a-9bee-8d2af38487af None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:05.613836 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 709/1398] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:05.619256 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4125e-b34f-4cef-8144-dc268dee7e55 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:05.620218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4125e-b34f-4cef-8144-dc268dee7e55 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:05.620593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4125e-b34f-4cef-8144-dc268dee7e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:05.638902 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-39b4125e-b34f-4cef-8144-dc268dee7e55 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:05.640071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-39b4125e-b34f-4cef-8144-dc268dee7e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:05.647727 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 690/1399] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:05.693269 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a61993-09b0-4f6a-9bee-8d2af38487af None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:05.707981 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a61993-09b0-4f6a-9bee-8d2af38487af None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:05.714372 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa58a83-2e2b-4293-8cb8-a82d31a22f21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:05.715024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa58a83-2e2b-4293-8cb8-a82d31a22f21 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:05.715309 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa58a83-2e2b-4293-8cb8-a82d31a22f21 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:05.715589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa58a83-2e2b-4293-8cb8-a82d31a22f21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:05.724903 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa58a83-2e2b-4293-8cb8-a82d31a22f21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:05.726527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa58a83-2e2b-4293-8cb8-a82d31a22f21 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:05.737599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 710/1400] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:06.992954 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d9a05-946c-4844-8aa4-6788fb2cc66e None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:06.993479 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d9a05-946c-4844-8aa4-6788fb2cc66e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:06.993670 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d9a05-946c-4844-8aa4-6788fb2cc66e None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:06.996231 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 691/1401] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:07.002306 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4628d-1f69-4055-8117-a6f786a8cf6d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:07.002743 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4628d-1f69-4055-8117-a6f786a8cf6d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:07.002873 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4628d-1f69-4055-8117-a6f786a8cf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:07.021203 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-16a4628d-1f69-4055-8117-a6f786a8cf6d None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:07.022393 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-16a4628d-1f69-4055-8117-a6f786a8cf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:07.030755 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 711/1402] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:07.087856 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295714e-1fc9-457d-9aab-0ec3d833c83b None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:07.088166 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295714e-1fc9-457d-9aab-0ec3d833c83b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:07.088623 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295714e-1fc9-457d-9aab-0ec3d833c83b None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:07.090480 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 692/1403] 10.222.0.27 () {54 vars in 961 bytes} [Tue Sep 27 04:59:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:07.095477 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34e854-9acc-48ac-875d-c9f64512c6a8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:07.095767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34e854-9acc-48ac-875d-c9f64512c6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:07.096050 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34e854-9acc-48ac-875d-c9f64512c6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:07.143791 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-cd34e854-9acc-48ac-875d-c9f64512c6a8 None None] MFA Rules not processed for user `93e04bf8c51c4d89bbb45e96223e7409`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:07.145023 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-cd34e854-9acc-48ac-875d-c9f64512c6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:07.202767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 712/1404] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Sep 27 04:59:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:07.210541 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295714e-1fc9-457d-9aab-0ec3d833c83b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:07.221729 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295714e-1fc9-457d-9aab-0ec3d833c83b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:07.225183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46a4ac-175b-41ec-80ce-e062d9ab7a4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e04bf8c51c4d89bbb45e96223e7409', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:07.225805 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a4ac-175b-41ec-80ce-e062d9ab7a4a service glance] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:07.226081 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a4ac-175b-41ec-80ce-e062d9ab7a4a service glance] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:07.226350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a4ac-175b-41ec-80ce-e062d9ab7a4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:07.235666 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46a4ac-175b-41ec-80ce-e062d9ab7a4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:07.237143 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46a4ac-175b-41ec-80ce-e062d9ab7a4a service glance] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:07.247107 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 693/1405] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:07.663927 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d2337-dbff-4491-849b-9cb1b2676946 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:07.664219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d2337-dbff-4491-849b-9cb1b2676946 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:07.664503 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d2337-dbff-4491-849b-9cb1b2676946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:07.714115 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-601d2337-dbff-4491-849b-9cb1b2676946 None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:07.715380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-601d2337-dbff-4491-849b-9cb1b2676946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:07.782670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 713/1406] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 27 04:59:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:07.826409 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626725ef-a5d4-452c-b855-f7be19174d49 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:07.826700 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626725ef-a5d4-452c-b855-f7be19174d49 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:07.826980 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626725ef-a5d4-452c-b855-f7be19174d49 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:07.828761 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 694/1407] 10.222.0.27 () {54 vars in 942 bytes} [Tue Sep 27 04:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:07.835208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a117f-5fa8-4250-9535-d29d40d62317 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:07.835500 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a117f-5fa8-4250-9535-d29d40d62317 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:07.835785 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a117f-5fa8-4250-9535-d29d40d62317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:07.883780 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a69a117f-5fa8-4250-9535-d29d40d62317 None None] MFA Rules not processed for user `bfea15b51919441b921c10d02d11f693`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:07.885670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a69a117f-5fa8-4250-9535-d29d40d62317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:07.953742 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 714/1408] 10.222.0.27 () {58 vars in 1039 bytes} [Tue Sep 27 04:59:07 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:59:07.962959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626725ef-a5d4-452c-b855-f7be19174d49 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:07.976682 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626725ef-a5d4-452c-b855-f7be19174d49 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:07.983269 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75e218-322c-47c0-88fd-d895fe3e466b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:07.983914 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75e218-322c-47c0-88fd-d895fe3e466b service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:07.984192 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75e218-322c-47c0-88fd-d895fe3e466b service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:07.984464 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75e218-322c-47c0-88fd-d895fe3e466b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:07.993079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75e218-322c-47c0-88fd-d895fe3e466b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:07.995350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75e218-322c-47c0-88fd-d895fe3e466b service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:08.004319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 695/1409] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 04:59:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 04:59:08.130566 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f8123-5f81-4c1f-ab96-29fafb26da7e None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:08.131474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f8123-5f81-4c1f-ab96-29fafb26da7e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:08.131957 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f8123-5f81-4c1f-ab96-29fafb26da7e None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:08.134219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 715/1410] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 04:59:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:08.142368 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d48a5-a029-4dac-a41d-977d63980f3a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:08.143035 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d48a5-a029-4dac-a41d-977d63980f3a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:08.143634 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d48a5-a029-4dac-a41d-977d63980f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:08.168138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b05d48a5-a029-4dac-a41d-977d63980f3a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:08.169492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b05d48a5-a029-4dac-a41d-977d63980f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:08.187277 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 696/1411] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 04:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:08.222868 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f8123-5f81-4c1f-ab96-29fafb26da7e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:08.237638 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f8123-5f81-4c1f-ab96-29fafb26da7e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:08.243527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1dd37-76d1-426e-b067-45468ca5103c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:08.244305 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1dd37-76d1-426e-b067-45468ca5103c service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:08.244658 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1dd37-76d1-426e-b067-45468ca5103c service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:08.245034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1dd37-76d1-426e-b067-45468ca5103c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:08.256251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1dd37-76d1-426e-b067-45468ca5103c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:08.257960 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1dd37-76d1-426e-b067-45468ca5103c service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:08.269829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 716/1412] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:31.128321 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01f2ca-fbdb-47ef-aff5-ba1a03941188 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:31.128969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01f2ca-fbdb-47ef-aff5-ba1a03941188 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:31.128969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01f2ca-fbdb-47ef-aff5-ba1a03941188 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:31.130719 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 697/1413] 10.222.0.27 () {54 vars in 918 bytes} [Tue Sep 27 04:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:31.136772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be41e9-54dd-4310-9f3c-6223c723791c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:31.137244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be41e9-54dd-4310-9f3c-6223c723791c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:31.137347 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be41e9-54dd-4310-9f3c-6223c723791c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:31.155435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-23be41e9-54dd-4310-9f3c-6223c723791c None None] MFA Rules not processed for user `8489647547d544a681131dad99e058bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:31.156618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-23be41e9-54dd-4310-9f3c-6223c723791c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:31.165801 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 717/1414] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Sep 27 04:59:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:31.179762 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e5dbe-17dc-466a-9c51-7c4c2e535012 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:31.180053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e5dbe-17dc-466a-9c51-7c4c2e535012 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:31.180336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e5dbe-17dc-466a-9c51-7c4c2e535012 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:31.182906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 698/1415] 10.222.0.27 () {54 vars in 918 bytes} [Tue Sep 27 04:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:31.187693 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed57a3-02ac-4d78-8d44-d15a7a9213f0 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:31.187976 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed57a3-02ac-4d78-8d44-d15a7a9213f0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:31.188251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed57a3-02ac-4d78-8d44-d15a7a9213f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:31.206101 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e3ed57a3-02ac-4d78-8d44-d15a7a9213f0 None None] MFA Rules not processed for user `faac84ed9d37420c811bbf6ac7df0b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:31.207282 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e3ed57a3-02ac-4d78-8d44-d15a7a9213f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:31.216441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 718/1416] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Sep 27 04:59:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:34.006823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667ba41-c3db-462e-a785-9b4815b2ee77 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:34.007302 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667ba41-c3db-462e-a785-9b4815b2ee77 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:34.007427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667ba41-c3db-462e-a785-9b4815b2ee77 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:34.009735 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 27 04:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:34.014925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44aa4e-a84c-4009-be62-525faf076840 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:34.015349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44aa4e-a84c-4009-be62-525faf076840 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:34.015458 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44aa4e-a84c-4009-be62-525faf076840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:34.033069 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ab44aa4e-a84c-4009-be62-525faf076840 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:34.034241 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ab44aa4e-a84c-4009-be62-525faf076840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:34.042017 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Sep 27 04:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:59:34.083885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667ba41-c3db-462e-a785-9b4815b2ee77 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:34.097876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667ba41-c3db-462e-a785-9b4815b2ee77 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:34.103277 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc8b1b-8532-48df-ac34-d81ad6947885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:34.103899 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc8b1b-8532-48df-ac34-d81ad6947885 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:34.104180 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc8b1b-8532-48df-ac34-d81ad6947885 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:34.104454 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc8b1b-8532-48df-ac34-d81ad6947885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:34.112338 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc8b1b-8532-48df-ac34-d81ad6947885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:34.113957 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc8b1b-8532-48df-ac34-d81ad6947885 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:34.123729 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 700/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:35.533671 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6b99b-3d7f-4241-a21b-3f7085a95723 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:35.534235 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6b99b-3d7f-4241-a21b-3f7085a95723 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:35.534235 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6b99b-3d7f-4241-a21b-3f7085a95723 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:35.536069 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:35.541710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79a291-ae13-41f9-b6f1-91f17df04c5e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:35.542158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79a291-ae13-41f9-b6f1-91f17df04c5e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:35.542293 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79a291-ae13-41f9-b6f1-91f17df04c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:35.560074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0e79a291-ae13-41f9-b6f1-91f17df04c5e None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:35.561268 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0e79a291-ae13-41f9-b6f1-91f17df04c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:35.569245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:35.728463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6b99b-3d7f-4241-a21b-3f7085a95723 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:35.742689 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6b99b-3d7f-4241-a21b-3f7085a95723 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:35.748742 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86b140-77a2-425d-aed8-41dc7c032d57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:35.749440 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86b140-77a2-425d-aed8-41dc7c032d57 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:35.749717 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86b140-77a2-425d-aed8-41dc7c032d57 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:35.750398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86b140-77a2-425d-aed8-41dc7c032d57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:35.759175 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86b140-77a2-425d-aed8-41dc7c032d57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:35.761195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86b140-77a2-425d-aed8-41dc7c032d57 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:35.770259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 721/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:37.128214 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53868b-166c-492c-9732-ffa09a01e9fe None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:37.128759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53868b-166c-492c-9732-ffa09a01e9fe None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:37.128759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53868b-166c-492c-9732-ffa09a01e9fe None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:37.130564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:37.135820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b8e41-e7d2-4306-9453-d2a288d7bb66 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:37.136270 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b8e41-e7d2-4306-9453-d2a288d7bb66 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:37.136365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b8e41-e7d2-4306-9453-d2a288d7bb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:37.154988 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-598b8e41-e7d2-4306-9453-d2a288d7bb66 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:37.156178 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-598b8e41-e7d2-4306-9453-d2a288d7bb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:37.163932 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:59:37.315866 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53868b-166c-492c-9732-ffa09a01e9fe None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:37.330604 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53868b-166c-492c-9732-ffa09a01e9fe None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:37.335892 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a10eb-876d-416f-be17-3da1d3c4a06b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:37.336516 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a10eb-876d-416f-be17-3da1d3c4a06b service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:37.337470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a10eb-876d-416f-be17-3da1d3c4a06b service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:37.337819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a10eb-876d-416f-be17-3da1d3c4a06b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:37.346061 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a10eb-876d-416f-be17-3da1d3c4a06b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:37.347639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a10eb-876d-416f-be17-3da1d3c4a06b service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:37.357081 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 703/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:38.699499 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e48814-e28f-435e-aa97-dd5a4312cc37 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:38.700100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e48814-e28f-435e-aa97-dd5a4312cc37 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:38.700100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e48814-e28f-435e-aa97-dd5a4312cc37 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:38.701946 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:59:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:38.706822 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267d300-2d47-40fc-b831-51da9a61afa0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:38.707250 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267d300-2d47-40fc-b831-51da9a61afa0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:38.707363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267d300-2d47-40fc-b831-51da9a61afa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:38.726279 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e267d300-2d47-40fc-b831-51da9a61afa0 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:38.727565 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e267d300-2d47-40fc-b831-51da9a61afa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:38.735241 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:38.888271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e48814-e28f-435e-aa97-dd5a4312cc37 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:38.903194 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e48814-e28f-435e-aa97-dd5a4312cc37 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:38.908440 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed65b8-c714-4132-bd6f-9c023e66febd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:38.909089 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed65b8-c714-4132-bd6f-9c023e66febd service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:38.909367 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed65b8-c714-4132-bd6f-9c023e66febd service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:38.909638 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed65b8-c714-4132-bd6f-9c023e66febd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:38.917774 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed65b8-c714-4132-bd6f-9c023e66febd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:38.919344 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed65b8-c714-4132-bd6f-9c023e66febd service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:38.928302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 724/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:40.267607 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc347d-9a79-4df6-a771-239f4f8148dc None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:40.268150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc347d-9a79-4df6-a771-239f4f8148dc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:40.268150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc347d-9a79-4df6-a771-239f4f8148dc None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:40.269850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:40.275967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba3084-677a-41b9-bcd1-9a96e29d5326 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:40.276378 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba3084-677a-41b9-bcd1-9a96e29d5326 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:40.276524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba3084-677a-41b9-bcd1-9a96e29d5326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:40.294535 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-beba3084-677a-41b9-bcd1-9a96e29d5326 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:40.295718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-beba3084-677a-41b9-bcd1-9a96e29d5326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:40.303416 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 04:59:40.457226 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc347d-9a79-4df6-a771-239f4f8148dc None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:40.471726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc347d-9a79-4df6-a771-239f4f8148dc None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:40.477111 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78fa65-689c-426d-aac0-6c4cf56d4419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:40.477708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78fa65-689c-426d-aac0-6c4cf56d4419 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:40.477989 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78fa65-689c-426d-aac0-6c4cf56d4419 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:40.478258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78fa65-689c-426d-aac0-6c4cf56d4419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:40.486664 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78fa65-689c-426d-aac0-6c4cf56d4419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:40.488280 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78fa65-689c-426d-aac0-6c4cf56d4419 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:40.497814 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 706/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:41.868227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5490ff-3493-45bb-90bc-9e725a9bc9d7 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:41.868818 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5490ff-3493-45bb-90bc-9e725a9bc9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:41.868818 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5490ff-3493-45bb-90bc-9e725a9bc9d7 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:41.870596 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:41.875970 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46325eb0-f3ff-464b-9fa4-23dc878dc5ea None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:41.876396 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46325eb0-f3ff-464b-9fa4-23dc878dc5ea None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:41.876523 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46325eb0-f3ff-464b-9fa4-23dc878dc5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:41.894499 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-46325eb0-f3ff-464b-9fa4-23dc878dc5ea None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:41.895668 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-46325eb0-f3ff-464b-9fa4-23dc878dc5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:41.903980 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:42.059625 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5490ff-3493-45bb-90bc-9e725a9bc9d7 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:42.075192 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5490ff-3493-45bb-90bc-9e725a9bc9d7 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:42.080873 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f08284-a262-40c2-a213-0fa39d29166a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:42.081514 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f08284-a262-40c2-a213-0fa39d29166a service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:42.081792 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f08284-a262-40c2-a213-0fa39d29166a service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:42.082072 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f08284-a262-40c2-a213-0fa39d29166a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:42.090502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f08284-a262-40c2-a213-0fa39d29166a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:42.092199 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f08284-a262-40c2-a213-0fa39d29166a service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:42.101642 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 727/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:43.389871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137c913-1fc0-44df-b97f-27f38f7b6c0c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:43.390432 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137c913-1fc0-44df-b97f-27f38f7b6c0c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:43.390432 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137c913-1fc0-44df-b97f-27f38f7b6c0c None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:43.392187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:43.397377 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42c2b-622e-4178-8008-a19f8fe12377 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:43.397802 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42c2b-622e-4178-8008-a19f8fe12377 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:43.397935 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42c2b-622e-4178-8008-a19f8fe12377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:43.416177 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-69c42c2b-622e-4178-8008-a19f8fe12377 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:43.417398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-69c42c2b-622e-4178-8008-a19f8fe12377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:43.425120 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:43.577992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137c913-1fc0-44df-b97f-27f38f7b6c0c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:43.592110 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137c913-1fc0-44df-b97f-27f38f7b6c0c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:43.597368 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc1da33-796f-46d4-abfd-0a95f46bd0a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:43.597988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1da33-796f-46d4-abfd-0a95f46bd0a6 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:43.598263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1da33-796f-46d4-abfd-0a95f46bd0a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:43.598535 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc1da33-796f-46d4-abfd-0a95f46bd0a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:43.606729 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1da33-796f-46d4-abfd-0a95f46bd0a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:43.608289 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc1da33-796f-46d4-abfd-0a95f46bd0a6 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:43.617270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 709/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:44.908579 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496f24a-6f6b-44f3-9d09-e0ff0058c137 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:44.909148 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496f24a-6f6b-44f3-9d09-e0ff0058c137 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:44.909148 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496f24a-6f6b-44f3-9d09-e0ff0058c137 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:44.910950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:44.916324 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb710bc-683b-4699-bf42-c8d6962af56c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:44.916717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb710bc-683b-4699-bf42-c8d6962af56c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:44.916925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb710bc-683b-4699-bf42-c8d6962af56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:44.934567 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-deb710bc-683b-4699-bf42-c8d6962af56c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:44.935736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-deb710bc-683b-4699-bf42-c8d6962af56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:44.943356 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:45.097384 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496f24a-6f6b-44f3-9d09-e0ff0058c137 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:45.111609 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496f24a-6f6b-44f3-9d09-e0ff0058c137 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:45.116977 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941258c3-5f24-4248-9b81-b50a3aad8d29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:45.118212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941258c3-5f24-4248-9b81-b50a3aad8d29 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:45.118508 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941258c3-5f24-4248-9b81-b50a3aad8d29 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:45.118789 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941258c3-5f24-4248-9b81-b50a3aad8d29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:45.127016 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941258c3-5f24-4248-9b81-b50a3aad8d29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:45.128600 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941258c3-5f24-4248-9b81-b50a3aad8d29 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:45.138610 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 730/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:46.420066 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c678b2a-cc78-4a6a-9947-cfb766967dfa None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:46.420631 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c678b2a-cc78-4a6a-9947-cfb766967dfa None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:46.420631 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c678b2a-cc78-4a6a-9947-cfb766967dfa None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:46.422450 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 04:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:46.427574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95716164-f61e-4237-93df-65df9511d915 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:46.428005 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95716164-f61e-4237-93df-65df9511d915 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:46.428220 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95716164-f61e-4237-93df-65df9511d915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:46.449101 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-95716164-f61e-4237-93df-65df9511d915 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:46.450289 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-95716164-f61e-4237-93df-65df9511d915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:46.457876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 04:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:46.614112 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c678b2a-cc78-4a6a-9947-cfb766967dfa None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:46.628285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c678b2a-cc78-4a6a-9947-cfb766967dfa None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:46.633605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac10034-5ee5-4938-b8be-bc2a1692e201 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:46.634223 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac10034-5ee5-4938-b8be-bc2a1692e201 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:46.634500 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac10034-5ee5-4938-b8be-bc2a1692e201 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:46.634773 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac10034-5ee5-4938-b8be-bc2a1692e201 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:46.642600 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac10034-5ee5-4938-b8be-bc2a1692e201 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:46.644170 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac10034-5ee5-4938-b8be-bc2a1692e201 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:46.653910 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 712/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:48.884083 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0bfcd-9ece-4477-bea2-3c2c6fcabf1a None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:48.884579 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0bfcd-9ece-4477-bea2-3c2c6fcabf1a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:48.884692 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0bfcd-9ece-4477-bea2-3c2c6fcabf1a None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:48.886475 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 27 04:59:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:48.891753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f3bea-63d2-44f6-8cff-c45716dc57ed None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:48.892153 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f3bea-63d2-44f6-8cff-c45716dc57ed None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:48.892314 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f3bea-63d2-44f6-8cff-c45716dc57ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:48.909897 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d70f3bea-63d2-44f6-8cff-c45716dc57ed None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:48.911085 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d70f3bea-63d2-44f6-8cff-c45716dc57ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:48.918859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Sep 27 04:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:48.957800 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0bfcd-9ece-4477-bea2-3c2c6fcabf1a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:48.968557 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0bfcd-9ece-4477-bea2-3c2c6fcabf1a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:48.972044 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca07cd-66cb-4c58-b592-0f4d087a888f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:48.972681 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca07cd-66cb-4c58-b592-0f4d087a888f service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:48.972989 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca07cd-66cb-4c58-b592-0f4d087a888f service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:48.973264 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca07cd-66cb-4c58-b592-0f4d087a888f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:48.982546 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca07cd-66cb-4c58-b592-0f4d087a888f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:48.983977 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca07cd-66cb-4c58-b592-0f4d087a888f service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:48.993705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 733/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:51.456997 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f0b83-7a5b-4965-a3ac-f9e3c397ec63 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:51.457652 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f0b83-7a5b-4965-a3ac-f9e3c397ec63 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:51.457652 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f0b83-7a5b-4965-a3ac-f9e3c397ec63 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:51.459298 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 27 04:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:51.465043 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbdf59-3007-484f-abd8-2cceea009c88 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:51.465478 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbdf59-3007-484f-abd8-2cceea009c88 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:51.465578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bbdf59-3007-484f-abd8-2cceea009c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:51.483838 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a4bbdf59-3007-484f-abd8-2cceea009c88 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:51.485045 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a4bbdf59-3007-484f-abd8-2cceea009c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:51.492688 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Sep 27 04:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:51.531151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f0b83-7a5b-4965-a3ac-f9e3c397ec63 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:51.542512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f0b83-7a5b-4965-a3ac-f9e3c397ec63 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:51.546009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f517d-ae17-4166-be49-90205ee0188b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:51.546639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f517d-ae17-4166-be49-90205ee0188b service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:51.546919 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f517d-ae17-4166-be49-90205ee0188b service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:51.547224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f517d-ae17-4166-be49-90205ee0188b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:51.555939 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f517d-ae17-4166-be49-90205ee0188b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:51.557416 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f517d-ae17-4166-be49-90205ee0188b service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:51.566493 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 715/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:54.206443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe64eab-5ae4-45d7-b18f-9efe6ddff653 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:54.206972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe64eab-5ae4-45d7-b18f-9efe6ddff653 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:54.206972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe64eab-5ae4-45d7-b18f-9efe6ddff653 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:54.208752 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 27 04:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:54.214765 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9a2ab-2deb-4097-9cb6-639423d402e8 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:54.215190 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9a2ab-2deb-4097-9cb6-639423d402e8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:54.215366 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9a2ab-2deb-4097-9cb6-639423d402e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:54.233432 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-06f9a2ab-2deb-4097-9cb6-639423d402e8 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:54.234531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-06f9a2ab-2deb-4097-9cb6-639423d402e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:54.242440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Sep 27 04:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:54.282901 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe64eab-5ae4-45d7-b18f-9efe6ddff653 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:54.293857 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe64eab-5ae4-45d7-b18f-9efe6ddff653 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:54.297357 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72624014-5c39-4950-b9f3-0240c9a96a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:54.297978 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72624014-5c39-4950-b9f3-0240c9a96a64 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:54.298252 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72624014-5c39-4950-b9f3-0240c9a96a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:54.298519 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72624014-5c39-4950-b9f3-0240c9a96a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:54.307191 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72624014-5c39-4950-b9f3-0240c9a96a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:54.308605 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72624014-5c39-4950-b9f3-0240c9a96a64 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:54.317672 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 736/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 04:59:56.763386 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd388fa-0d02-40a5-948c-0e49d3a8a268 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:56.763948 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd388fa-0d02-40a5-948c-0e49d3a8a268 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:56.763948 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd388fa-0d02-40a5-948c-0e49d3a8a268 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:56.765740 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 27 04:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 04:59:56.770861 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19449786-9d72-4d90-ae64-98f550a8f856 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:56.771287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19449786-9d72-4d90-ae64-98f550a8f856 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:56.771438 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19449786-9d72-4d90-ae64-98f550a8f856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:56.790036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-19449786-9d72-4d90-ae64-98f550a8f856 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:56.791202 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-19449786-9d72-4d90-ae64-98f550a8f856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:56.798885 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Sep 27 04:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:56.837660 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd388fa-0d02-40a5-948c-0e49d3a8a268 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:56.847916 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd388fa-0d02-40a5-948c-0e49d3a8a268 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:56.851465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc4df5-2f8d-46e1-bbfa-7c2c1918f1d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:56.852427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc4df5-2f8d-46e1-bbfa-7c2c1918f1d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:56.852427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc4df5-2f8d-46e1-bbfa-7c2c1918f1d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:56.852622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc4df5-2f8d-46e1-bbfa-7c2c1918f1d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:56.861351 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc4df5-2f8d-46e1-bbfa-7c2c1918f1d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:56.862786 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc4df5-2f8d-46e1-bbfa-7c2c1918f1d9 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:56.872138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 718/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 04:59:59.291723 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a2d11-7a81-496a-814d-02089290d111 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:59.292264 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a2d11-7a81-496a-814d-02089290d111 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:59.292264 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a2d11-7a81-496a-814d-02089290d111 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:59.294079 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 27 04:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 04:59:59.299467 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756df26-f5c5-4580-808b-5a3669a4ce78 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:59.299848 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756df26-f5c5-4580-808b-5a3669a4ce78 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:59.300029 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756df26-f5c5-4580-808b-5a3669a4ce78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:59.317459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2756df26-f5c5-4580-808b-5a3669a4ce78 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 04:59:59.318636 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2756df26-f5c5-4580-808b-5a3669a4ce78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 04:59:59.326831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Sep 27 04:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 04:59:59.365358 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a2d11-7a81-496a-814d-02089290d111 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 04:59:59.376369 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a2d11-7a81-496a-814d-02089290d111 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 04:59:59.379881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd7a11-e756-4518-b32d-74a23464e970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 04:59:59.380506 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd7a11-e756-4518-b32d-74a23464e970 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 04:59:59.380784 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd7a11-e756-4518-b32d-74a23464e970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 04:59:59.381086 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd7a11-e756-4518-b32d-74a23464e970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 04:59:59.390364 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd7a11-e756-4518-b32d-74a23464e970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 04:59:59.391822 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd7a11-e756-4518-b32d-74a23464e970 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 04:59:59.401685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 739/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 04:59:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:00:01.796227 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25785c09-0f2a-43b5-934f-51391cdc7ae4 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:01.796841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25785c09-0f2a-43b5-934f-51391cdc7ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:01.796841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25785c09-0f2a-43b5-934f-51391cdc7ae4 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:01.798589 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 27 05:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:00:01.803666 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb815d-b155-4b46-bb0b-765e91abfa45 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:01.804070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb815d-b155-4b46-bb0b-765e91abfa45 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:01.804217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb815d-b155-4b46-bb0b-765e91abfa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:01.822565 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-20fb815d-b155-4b46-bb0b-765e91abfa45 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:00:01.823727 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-20fb815d-b155-4b46-bb0b-765e91abfa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:00:01.831349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Sep 27 05:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:00:01.870758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25785c09-0f2a-43b5-934f-51391cdc7ae4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:00:01.872426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-25785c09-0f2a-43b5-934f-51391cdc7ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:00:01.885892 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25785c09-0f2a-43b5-934f-51391cdc7ae4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:00:01.889409 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea55968-2194-4c72-a103-9061a7e7514e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:00:01.890041 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea55968-2194-4c72-a103-9061a7e7514e service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:01.890342 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea55968-2194-4c72-a103-9061a7e7514e service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:01.890602 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea55968-2194-4c72-a103-9061a7e7514e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:01.899882 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea55968-2194-4c72-a103-9061a7e7514e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:00:01.901349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea55968-2194-4c72-a103-9061a7e7514e service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:00:01.911506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 721/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:00:04.349526 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d60e40-d4bc-4e14-af45-56959767a69a None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:04.350034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d60e40-d4bc-4e14-af45-56959767a69a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:04.350034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d60e40-d4bc-4e14-af45-56959767a69a None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:04.351867 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 27 05:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:00:04.357044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eb011-6104-4337-9410-b580807016dd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:04.357451 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eb011-6104-4337-9410-b580807016dd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:04.357600 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eb011-6104-4337-9410-b580807016dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:04.375912 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ad1eb011-6104-4337-9410-b580807016dd None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:00:04.377126 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ad1eb011-6104-4337-9410-b580807016dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:00:04.385376 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Sep 27 05:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:00:04.422388 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d60e40-d4bc-4e14-af45-56959767a69a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:00:04.433519 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d60e40-d4bc-4e14-af45-56959767a69a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:00:04.437046 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ecf64-4f91-4a85-bcd2-d38ffe2d37a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:00:04.437679 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ecf64-4f91-4a85-bcd2-d38ffe2d37a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:04.437958 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ecf64-4f91-4a85-bcd2-d38ffe2d37a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:04.438228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ecf64-4f91-4a85-bcd2-d38ffe2d37a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:04.447625 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ecf64-4f91-4a85-bcd2-d38ffe2d37a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:00:04.449075 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ecf64-4f91-4a85-bcd2-d38ffe2d37a6 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:00:04.458096 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 742/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:00:06.849538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b196066-87e7-4b09-ba9e-04ebba3705d4 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:06.850109 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b196066-87e7-4b09-ba9e-04ebba3705d4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:06.850109 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b196066-87e7-4b09-ba9e-04ebba3705d4 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:06.851969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 27 05:00:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:00:06.857912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164ef2e-d398-4455-8eee-cb18fe97b841 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:06.858375 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164ef2e-d398-4455-8eee-cb18fe97b841 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:06.858479 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164ef2e-d398-4455-8eee-cb18fe97b841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:06.877209 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a164ef2e-d398-4455-8eee-cb18fe97b841 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:00:06.878378 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a164ef2e-d398-4455-8eee-cb18fe97b841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:00:06.886837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Sep 27 05:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:00:06.925060 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b196066-87e7-4b09-ba9e-04ebba3705d4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:00:06.936758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b196066-87e7-4b09-ba9e-04ebba3705d4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:00:06.940221 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8548e13-d239-47eb-992d-54d90a487b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:00:06.940874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8548e13-d239-47eb-992d-54d90a487b1f service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:06.941151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8548e13-d239-47eb-992d-54d90a487b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:06.941426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8548e13-d239-47eb-992d-54d90a487b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:06.950843 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8548e13-d239-47eb-992d-54d90a487b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:00:06.952271 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8548e13-d239-47eb-992d-54d90a487b1f service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:00:06.962022 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 724/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:00:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:00:09.313053 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52e4f2-8596-411f-901a-07d442970897 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:09.313630 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52e4f2-8596-411f-901a-07d442970897 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:09.313630 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52e4f2-8596-411f-901a-07d442970897 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:09.315472 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 27 05:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:00:09.321900 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812fef2-b299-4f24-9e54-58df07f6bd46 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:09.322301 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812fef2-b299-4f24-9e54-58df07f6bd46 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:09.322484 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812fef2-b299-4f24-9e54-58df07f6bd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:09.341186 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b812fef2-b299-4f24-9e54-58df07f6bd46 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:00:09.342378 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b812fef2-b299-4f24-9e54-58df07f6bd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:00:09.350149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Sep 27 05:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:00:09.387096 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52e4f2-8596-411f-901a-07d442970897 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:00:09.397615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52e4f2-8596-411f-901a-07d442970897 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:00:09.401895 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cec92-bf65-403c-9ce0-84fac1e212d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:00:09.402520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cec92-bf65-403c-9ce0-84fac1e212d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:09.402798 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cec92-bf65-403c-9ce0-84fac1e212d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:09.403070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cec92-bf65-403c-9ce0-84fac1e212d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:09.411895 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cec92-bf65-403c-9ce0-84fac1e212d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:00:09.413507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cec92-bf65-403c-9ce0-84fac1e212d0 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:00:09.422968 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 745/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:00:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:00:11.798173 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3774d0-9713-495e-8d6b-2c7ded92c4b0 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:11.798739 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3774d0-9713-495e-8d6b-2c7ded92c4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:11.798739 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3774d0-9713-495e-8d6b-2c7ded92c4b0 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:11.800516 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 726/1471] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 27 05:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:00:11.806326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00baa0-02c1-4ea9-8fec-4556a0040f76 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:11.806793 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00baa0-02c1-4ea9-8fec-4556a0040f76 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:11.806927 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00baa0-02c1-4ea9-8fec-4556a0040f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:11.825240 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3b00baa0-02c1-4ea9-8fec-4556a0040f76 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:00:11.826451 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3b00baa0-02c1-4ea9-8fec-4556a0040f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:00:11.834338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 746/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Sep 27 05:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:00:11.872063 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3774d0-9713-495e-8d6b-2c7ded92c4b0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:00:11.883511 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3774d0-9713-495e-8d6b-2c7ded92c4b0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:00:11.886937 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d37f36-7c33-44ee-a9d1-fedbca279895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:00:11.887561 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d37f36-7c33-44ee-a9d1-fedbca279895 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:11.887837 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d37f36-7c33-44ee-a9d1-fedbca279895 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:11.888109 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d37f36-7c33-44ee-a9d1-fedbca279895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:11.896810 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d37f36-7c33-44ee-a9d1-fedbca279895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:00:11.898375 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d37f36-7c33-44ee-a9d1-fedbca279895 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:00:11.907346 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 727/1473] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:00:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:00:29.996323 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2a72b-d792-4c19-a452-c672f25a3dc4 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:29.996876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2a72b-d792-4c19-a452-c672f25a3dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:29.996987 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2a72b-d792-4c19-a452-c672f25a3dc4 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:29.998799 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 747/1474] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 05:00:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:00:30.004327 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e519a40-280c-4702-80b9-71b350bf8bbc None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:30.004742 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e519a40-280c-4702-80b9-71b350bf8bbc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:30.004916 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e519a40-280c-4702-80b9-71b350bf8bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:30.023608 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9e519a40-280c-4702-80b9-71b350bf8bbc None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:00:30.024777 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9e519a40-280c-4702-80b9-71b350bf8bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:00:30.032463 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 728/1475] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 05:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:00:30.080759 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d074d0-db5b-4e1b-b2fa-71e3904d0d5a None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:30.081097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d074d0-db5b-4e1b-b2fa-71e3904d0d5a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:30.081383 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d074d0-db5b-4e1b-b2fa-71e3904d0d5a None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:30.083173 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 748/1476] 10.222.0.27 () {54 vars in 961 bytes} [Tue Sep 27 05:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:00:30.088390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa45dac-cf74-4622-b4d1-588dad5e93b2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:30.088683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa45dac-cf74-4622-b4d1-588dad5e93b2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:30.088992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa45dac-cf74-4622-b4d1-588dad5e93b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:30.107002 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6fa45dac-cf74-4622-b4d1-588dad5e93b2 None None] MFA Rules not processed for user `93e04bf8c51c4d89bbb45e96223e7409`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:00:30.108193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6fa45dac-cf74-4622-b4d1-588dad5e93b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:00:30.114638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 729/1477] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Sep 27 05:00:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:00:30.121927 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d074d0-db5b-4e1b-b2fa-71e3904d0d5a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:00:30.134391 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d074d0-db5b-4e1b-b2fa-71e3904d0d5a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:00:30.137849 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8d387-1d41-4348-873a-7c755671090a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e04bf8c51c4d89bbb45e96223e7409', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:00:30.138476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8d387-1d41-4348-873a-7c755671090a service glance] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:30.138758 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8d387-1d41-4348-873a-7c755671090a service glance] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:30.139033 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8d387-1d41-4348-873a-7c755671090a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:30.148430 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8d387-1d41-4348-873a-7c755671090a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:00:30.149893 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8d387-1d41-4348-873a-7c755671090a service glance] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:00:30.159063 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 749/1478] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:00:32.593638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8cc40-a43e-4d32-8f73-851695bf6070 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:32.594504 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8cc40-a43e-4d32-8f73-851695bf6070 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:32.594695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8cc40-a43e-4d32-8f73-851695bf6070 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:32.596586 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 730/1479] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 05:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:00:32.602273 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825075f8-83a5-4235-92f8-e23ee029e07f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:32.602697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825075f8-83a5-4235-92f8-e23ee029e07f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:32.602832 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825075f8-83a5-4235-92f8-e23ee029e07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:32.620166 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-825075f8-83a5-4235-92f8-e23ee029e07f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:00:32.621360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-825075f8-83a5-4235-92f8-e23ee029e07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:00:32.629232 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 750/1480] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 05:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:00:32.653145 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8cc40-a43e-4d32-8f73-851695bf6070 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:00:32.665191 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8cc40-a43e-4d32-8f73-851695bf6070 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:00:32.669576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593a7ce-93bc-4558-a7f0-408bc3c9d9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:00:32.670211 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593a7ce-93bc-4558-a7f0-408bc3c9d9eb admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:32.670491 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593a7ce-93bc-4558-a7f0-408bc3c9d9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:32.670765 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593a7ce-93bc-4558-a7f0-408bc3c9d9eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:32.671492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593a7ce-93bc-4558-a7f0-408bc3c9d9eb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:00:32.673222 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-5593a7ce-93bc-4558-a7f0-408bc3c9d9eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 05:00:32.673222 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: warnings.warn(msg) Sep 27 05:00:32.673222 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: Sep 27 05:00:32.674365 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593a7ce-93bc-4558-a7f0-408bc3c9d9eb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:00:32.692753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 731/1481] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Sep 27 05:00:32 2022] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:00:35.079066 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8a21e-d2af-4cd2-aaad-70fcc22e7fdf None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:35.079635 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8a21e-d2af-4cd2-aaad-70fcc22e7fdf None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:35.079635 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8a21e-d2af-4cd2-aaad-70fcc22e7fdf None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:35.081415 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 751/1482] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 05:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:00:35.086884 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e824f-f8cc-4e2d-a0f6-852134fe604c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:35.087319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e824f-f8cc-4e2d-a0f6-852134fe604c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:35.087439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e824f-f8cc-4e2d-a0f6-852134fe604c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:35.105071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2b0e824f-f8cc-4e2d-a0f6-852134fe604c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:00:35.106249 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2b0e824f-f8cc-4e2d-a0f6-852134fe604c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:00:35.113806 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 732/1483] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 05:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:00:35.156840 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8a21e-d2af-4cd2-aaad-70fcc22e7fdf None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:00:35.170705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8a21e-d2af-4cd2-aaad-70fcc22e7fdf None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:00:35.175936 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1d62c-d99d-444b-9a5c-85cc485b1322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:00:35.176555 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d62c-d99d-444b-9a5c-85cc485b1322 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:35.176856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d62c-d99d-444b-9a5c-85cc485b1322 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:35.177130 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1d62c-d99d-444b-9a5c-85cc485b1322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:35.185586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1d62c-d99d-444b-9a5c-85cc485b1322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:00:35.187226 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1d62c-d99d-444b-9a5c-85cc485b1322 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:00:35.197422 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 752/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:00:37.700393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0110ea-cabd-4cc9-9250-a48b244a5e74 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:37.700942 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0110ea-cabd-4cc9-9250-a48b244a5e74 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:37.701039 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0110ea-cabd-4cc9-9250-a48b244a5e74 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:37.702768 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 733/1485] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 05:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:00:37.708055 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed9cda-35be-4958-8084-ece5bc0b81f6 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:37.708451 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed9cda-35be-4958-8084-ece5bc0b81f6 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:37.708614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed9cda-35be-4958-8084-ece5bc0b81f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:37.726796 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f4ed9cda-35be-4958-8084-ece5bc0b81f6 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:00:37.727977 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f4ed9cda-35be-4958-8084-ece5bc0b81f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:00:37.735730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 753/1486] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 05:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:00:37.772616 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0110ea-cabd-4cc9-9250-a48b244a5e74 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:00:37.783193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0110ea-cabd-4cc9-9250-a48b244a5e74 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:00:37.786687 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ebf02-a833-406f-9494-aaf30ea85ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:00:37.787326 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ebf02-a833-406f-9494-aaf30ea85ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:37.787603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ebf02-a833-406f-9494-aaf30ea85ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:37.787878 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ebf02-a833-406f-9494-aaf30ea85ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:37.796523 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ebf02-a833-406f-9494-aaf30ea85ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:00:37.797981 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ebf02-a833-406f-9494-aaf30ea85ce9 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:00:37.807159 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 734/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:00:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:00:40.173247 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a5013-718e-4dec-8ab6-5fc0dcdd4ca8 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:40.173816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a5013-718e-4dec-8ab6-5fc0dcdd4ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:40.173816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a5013-718e-4dec-8ab6-5fc0dcdd4ca8 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:40.175599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 754/1488] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 05:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:00:40.181080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de019e-bb9c-46d5-b463-a8af725aad3a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:40.181476 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de019e-bb9c-46d5-b463-a8af725aad3a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:40.181641 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de019e-bb9c-46d5-b463-a8af725aad3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:40.200672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e9de019e-bb9c-46d5-b463-a8af725aad3a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:00:40.201885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e9de019e-bb9c-46d5-b463-a8af725aad3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:00:40.210287 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 735/1489] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 05:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:00:40.248681 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a5013-718e-4dec-8ab6-5fc0dcdd4ca8 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:00:40.260676 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a5013-718e-4dec-8ab6-5fc0dcdd4ca8 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:00:40.264230 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d92ae3-c957-4410-b2b7-fda4f6994f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:00:40.264892 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d92ae3-c957-4410-b2b7-fda4f6994f10 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:40.265182 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d92ae3-c957-4410-b2b7-fda4f6994f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:40.265481 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d92ae3-c957-4410-b2b7-fda4f6994f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:40.274653 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d92ae3-c957-4410-b2b7-fda4f6994f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:00:40.276132 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d92ae3-c957-4410-b2b7-fda4f6994f10 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:00:40.286036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 755/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:00:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:00:42.979081 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c325bd-a7e6-4308-b522-0cd1c1a23575 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:42.979474 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c325bd-a7e6-4308-b522-0cd1c1a23575 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:42.979644 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c325bd-a7e6-4308-b522-0cd1c1a23575 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:42.981453 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 736/1491] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 05:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:00:42.986826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d84f5-2486-48b5-a656-2e860a9bfcbf None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:42.987209 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d84f5-2486-48b5-a656-2e860a9bfcbf None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:42.987380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d84f5-2486-48b5-a656-2e860a9bfcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:43.005654 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-dd9d84f5-2486-48b5-a656-2e860a9bfcbf None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:00:43.006854 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-dd9d84f5-2486-48b5-a656-2e860a9bfcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:00:43.014538 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 756/1492] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 05:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:00:43.055590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c325bd-a7e6-4308-b522-0cd1c1a23575 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:00:43.065952 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c325bd-a7e6-4308-b522-0cd1c1a23575 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:00:43.069523 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7a9ef-4463-4ac2-8af9-611fb4768f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:00:43.070148 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a9ef-4463-4ac2-8af9-611fb4768f48 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:43.070424 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a9ef-4463-4ac2-8af9-611fb4768f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:43.070700 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a9ef-4463-4ac2-8af9-611fb4768f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:43.079545 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7a9ef-4463-4ac2-8af9-611fb4768f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:00:43.081379 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7a9ef-4463-4ac2-8af9-611fb4768f48 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:00:43.090866 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 737/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:00:45.599585 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4d964-4a3b-4971-81f0-1493d60426d5 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:45.600320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4d964-4a3b-4971-81f0-1493d60426d5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:45.600320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4d964-4a3b-4971-81f0-1493d60426d5 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:45.601973 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 757/1494] 10.222.0.27 () {54 vars in 926 bytes} [Tue Sep 27 05:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:00:45.607087 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cbb71-fa4c-4de9-a0c3-e33b5fdb745c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:45.607524 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cbb71-fa4c-4de9-a0c3-e33b5fdb745c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:45.607632 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8cbb71-fa4c-4de9-a0c3-e33b5fdb745c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:45.625796 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6c8cbb71-fa4c-4de9-a0c3-e33b5fdb745c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:00:45.627018 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6c8cbb71-fa4c-4de9-a0c3-e33b5fdb745c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:00:45.635459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 738/1495] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Sep 27 05:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:00:45.673989 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4d964-4a3b-4971-81f0-1493d60426d5 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:00:45.684938 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4d964-4a3b-4971-81f0-1493d60426d5 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:00:45.688419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0756b-bf58-4472-8c34-ec5978716d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:00:45.689079 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0756b-bf58-4472-8c34-ec5978716d7f service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:00:45.689364 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0756b-bf58-4472-8c34-ec5978716d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:00:45.689640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0756b-bf58-4472-8c34-ec5978716d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:00:45.698803 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0756b-bf58-4472-8c34-ec5978716d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:00:45.700234 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0756b-bf58-4472-8c34-ec5978716d7f service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:00:45.709682 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 758/1496] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:02:09.580917 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ef159-d782-4272-89e6-71e4f72c1a88 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:09.581494 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ef159-d782-4272-89e6-71e4f72c1a88 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:09.581494 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ef159-d782-4272-89e6-71e4f72c1a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:09.600368 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0a6ef159-d782-4272-89e6-71e4f72c1a88 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:02:09.601520 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0a6ef159-d782-4272-89e6-71e4f72c1a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:02:09.609267 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 739/1497] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:02:09.617597 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2712e-af13-4d66-9433-9691d9d6e6cf None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:09.618063 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2712e-af13-4d66-9433-9691d9d6e6cf None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:09.618165 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2712e-af13-4d66-9433-9691d9d6e6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:09.635951 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2ea2712e-af13-4d66-9433-9691d9d6e6cf None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:02:09.637177 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2ea2712e-af13-4d66-9433-9691d9d6e6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:02:09.645457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 759/1498] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:02:09.649908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ef159-d782-4272-89e6-71e4f72c1a88 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:02:09.659429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ef159-d782-4272-89e6-71e4f72c1a88 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:02:09.664441 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bbec2-07cd-46d9-8bb4-fc4c45461927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:02:09.665117 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bbec2-07cd-46d9-8bb4-fc4c45461927 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:09.665400 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bbec2-07cd-46d9-8bb4-fc4c45461927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:09.665677 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bbec2-07cd-46d9-8bb4-fc4c45461927 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:09.666397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bbec2-07cd-46d9-8bb4-fc4c45461927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:02:09.666704 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bbec2-07cd-46d9-8bb4-fc4c45461927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:02:09.667700 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-4a8bbec2-07cd-46d9-8bb4-fc4c45461927 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 05:02:09.667700 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: warnings.warn(msg) Sep 27 05:02:09.667700 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: Sep 27 05:02:09.668585 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bbec2-07cd-46d9-8bb4-fc4c45461927 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:02:09.679692 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 740/1499] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:02:09.687643 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2712e-af13-4d66-9433-9691d9d6e6cf None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:02:09.696620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2712e-af13-4d66-9433-9691d9d6e6cf None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:02:09.701198 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043280a-204f-4fb5-9b91-78a18298d813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:02:09.701831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043280a-204f-4fb5-9b91-78a18298d813 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:09.702108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043280a-204f-4fb5-9b91-78a18298d813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:09.702380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043280a-204f-4fb5-9b91-78a18298d813 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:09.703056 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043280a-204f-4fb5-9b91-78a18298d813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:02:09.704061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING py.warnings [None req-f043280a-204f-4fb5-9b91-78a18298d813 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 05:02:09.704061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: warnings.warn(msg) Sep 27 05:02:09.704061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: Sep 27 05:02:09.705284 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043280a-204f-4fb5-9b91-78a18298d813 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:02:09.741295 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 760/1500] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:02:09 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:02:09.745459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bbec2-07cd-46d9-8bb4-fc4c45461927 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:02:09.755680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bbec2-07cd-46d9-8bb4-fc4c45461927 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:02:09.809983 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6abc70-6729-4aeb-b705-9496ed444070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:02:09.810645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6abc70-6729-4aeb-b705-9496ed444070 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:09.810925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6abc70-6729-4aeb-b705-9496ed444070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:09.811199 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6abc70-6729-4aeb-b705-9496ed444070 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:09.811892 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6abc70-6729-4aeb-b705-9496ed444070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:02:09.812924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-ed6abc70-6729-4aeb-b705-9496ed444070 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 05:02:09.812924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: warnings.warn(msg) Sep 27 05:02:09.812924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: Sep 27 05:02:09.814141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6abc70-6729-4aeb-b705-9496ed444070 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:02:09.833888 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 741/1501] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:02:09 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:02:09.837962 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043280a-204f-4fb5-9b91-78a18298d813 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:02:09.847992 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043280a-204f-4fb5-9b91-78a18298d813 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:02:09.852515 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379c773-0ae7-4b39-b621-7fdd0b652986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:02:09.853150 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379c773-0ae7-4b39-b621-7fdd0b652986 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:09.853429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379c773-0ae7-4b39-b621-7fdd0b652986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:09.853703 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379c773-0ae7-4b39-b621-7fdd0b652986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:09.854427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379c773-0ae7-4b39-b621-7fdd0b652986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:02:09.855445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING py.warnings [None req-e379c773-0ae7-4b39-b621-7fdd0b652986 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 05:02:09.855445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: warnings.warn(msg) Sep 27 05:02:09.855445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: Sep 27 05:02:09.856315 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379c773-0ae7-4b39-b621-7fdd0b652986 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:02:09.868617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 761/1502] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:02:09.872391 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6abc70-6729-4aeb-b705-9496ed444070 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:02:09.883089 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6abc70-6729-4aeb-b705-9496ed444070 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:02:09.887554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ee367-1f53-4b0a-9a0b-35eb44541d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:02:09.888209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ee367-1f53-4b0a-9a0b-35eb44541d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:09.888537 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ee367-1f53-4b0a-9a0b-35eb44541d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:09.888771 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ee367-1f53-4b0a-9a0b-35eb44541d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:09.889547 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ee367-1f53-4b0a-9a0b-35eb44541d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:02:09.890548 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-026ee367-1f53-4b0a-9a0b-35eb44541d91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 05:02:09.890548 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: warnings.warn(msg) Sep 27 05:02:09.890548 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: Sep 27 05:02:09.891567 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ee367-1f53-4b0a-9a0b-35eb44541d91 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:02:09.905593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 742/1503] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:02:09.909677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379c773-0ae7-4b39-b621-7fdd0b652986 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:02:09.919892 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379c773-0ae7-4b39-b621-7fdd0b652986 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:02:09.924293 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16440be-c386-4160-b796-25a34d888b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:02:09.925187 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16440be-c386-4160-b796-25a34d888b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:09.925468 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16440be-c386-4160-b796-25a34d888b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:09.925830 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16440be-c386-4160-b796-25a34d888b68 admin admin] PATH_INFO: `/v3/projects/b9b52ae6347b4ef48752fec0410b28d1/users/8cbc433652f2426a850ae989ac000403/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:09.939856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16440be-c386-4160-b796-25a34d888b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b52ae6347b4ef48752fec0410b28d1, user_id=8cbc433652f2426a850ae989ac000403, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:02:09.940908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING py.warnings [None req-f16440be-c386-4160-b796-25a34d888b68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 05:02:09.940908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: warnings.warn(msg) Sep 27 05:02:09.940908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: Sep 27 05:02:09.943476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16440be-c386-4160-b796-25a34d888b68 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:02:09.955857 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 762/1504] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:02:09 2022] PUT /identity/v3/projects/b9b52ae6347b4ef48752fec0410b28d1/users/8cbc433652f2426a850ae989ac000403/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:02:09.968632 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09b48e-d4c4-499e-b515-989106018676 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:09.969030 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09b48e-d4c4-499e-b515-989106018676 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:09.969310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09b48e-d4c4-499e-b515-989106018676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:09.995573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ae09b48e-d4c4-499e-b515-989106018676 None None] MFA Rules not processed for user `8cbc433652f2426a850ae989ac000403`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:02:09.996758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ae09b48e-d4c4-499e-b515-989106018676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:02:10.057865 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 743/1505] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:02:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:02:10.071406 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cc1ad-af24-44e0-a31b-53e6551c8fc9 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:10.071696 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cc1ad-af24-44e0-a31b-53e6551c8fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:10.071974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cc1ad-af24-44e0-a31b-53e6551c8fc9 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:10.073772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 763/1506] 10.222.0.27 () {54 vars in 962 bytes} [Tue Sep 27 05:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:02:10.078400 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e9564-df6c-4bba-b0e8-d7e415d35410 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:10.078689 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e9564-df6c-4bba-b0e8-d7e415d35410 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:10.078980 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e9564-df6c-4bba-b0e8-d7e415d35410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:10.097180 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-092e9564-df6c-4bba-b0e8-d7e415d35410 None None] MFA Rules not processed for user `9ba2cc8ae41b435d830e58327893f527`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:02:10.098496 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-092e9564-df6c-4bba-b0e8-d7e415d35410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:02:10.146380 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 744/1507] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Sep 27 05:02:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:02:10.154059 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cc1ad-af24-44e0-a31b-53e6551c8fc9 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:02:10.164503 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cc1ad-af24-44e0-a31b-53e6551c8fc9 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:02:10.167955 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9553b2-896e-458a-843a-8b38979c9907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:02:10.168578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9553b2-896e-458a-843a-8b38979c9907 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:10.168894 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9553b2-896e-458a-843a-8b38979c9907 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:10.169175 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9553b2-896e-458a-843a-8b38979c9907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:10.177714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9553b2-896e-458a-843a-8b38979c9907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:02:10.179145 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9553b2-896e-458a-843a-8b38979c9907 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:02:10.187647 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 764/1508] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:02:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:02:10.232179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862e21-42e2-4eb6-8693-e4005f6adf17 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:10.232543 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862e21-42e2-4eb6-8693-e4005f6adf17 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:10.232937 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862e21-42e2-4eb6-8693-e4005f6adf17 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:10.234634 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 745/1509] 10.222.0.27 () {52 vars in 830 bytes} [Tue Sep 27 05:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:02:10.238816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9553b2-896e-458a-843a-8b38979c9907 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:02:10.298677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9553b2-896e-458a-843a-8b38979c9907 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:02:10.303950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694778b-b529-4231-a35a-1989cb0afa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:02:10.304835 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694778b-b529-4231-a35a-1989cb0afa92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:10.305123 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694778b-b529-4231-a35a-1989cb0afa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:10.305401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694778b-b529-4231-a35a-1989cb0afa92 admin admin] PATH_INFO: `/v3/users/8cbc433652f2426a850ae989ac000403` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:10.306582 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694778b-b529-4231-a35a-1989cb0afa92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cbc433652f2426a850ae989ac000403)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:02:10.307595 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING py.warnings [None req-3694778b-b529-4231-a35a-1989cb0afa92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 05:02:10.307595 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: warnings.warn(msg) Sep 27 05:02:10.307595 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: Sep 27 05:02:10.308833 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694778b-b529-4231-a35a-1989cb0afa92 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:02:10.372712 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3694778b-b529-4231-a35a-1989cb0afa92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cbc433652f2426a850ae989ac000403'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:02:10.373462 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3694778b-b529-4231-a35a-1989cb0afa92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cbc433652f2426a850ae989ac000403'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:02:10.374087 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3694778b-b529-4231-a35a-1989cb0afa92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cbc433652f2426a850ae989ac000403'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:02:10.383302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3694778b-b529-4231-a35a-1989cb0afa92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cbc433652f2426a850ae989ac000403'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:02:10.400983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-3694778b-b529-4231-a35a-1989cb0afa92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cbc433652f2426a850ae989ac000403'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:02:10.417913 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 765/1510] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:02:10 2022] DELETE /identity/v3/users/8cbc433652f2426a850ae989ac000403 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:02:10.422298 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b5594-8947-48c4-9a1c-2666d46fe113 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:10.422587 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b5594-8947-48c4-9a1c-2666d46fe113 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:10.422870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b5594-8947-48c4-9a1c-2666d46fe113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:10.440336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9a5b5594-8947-48c4-9a1c-2666d46fe113 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:02:10.442109 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9a5b5594-8947-48c4-9a1c-2666d46fe113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:02:10.497921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 746/1511] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:02:10.510235 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694778b-b529-4231-a35a-1989cb0afa92 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:02:10.511668 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3694778b-b529-4231-a35a-1989cb0afa92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:02:10.567900 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694778b-b529-4231-a35a-1989cb0afa92 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:02:10.571488 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93acef-4b81-4a94-831c-049442260689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:02:10.572129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93acef-4b81-4a94-831c-049442260689 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:10.572413 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93acef-4b81-4a94-831c-049442260689 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:10.572691 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93acef-4b81-4a94-831c-049442260689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:10.581437 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93acef-4b81-4a94-831c-049442260689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:02:10.582949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e93acef-4b81-4a94-831c-049442260689 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:02:10.592138 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 766/1512] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:02:10.913005 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b5594-8947-48c4-9a1c-2666d46fe113 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:02:10.914442 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9a5b5594-8947-48c4-9a1c-2666d46fe113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:02:10.926325 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b5594-8947-48c4-9a1c-2666d46fe113 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:02:10.931084 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98898d8b-8438-46d2-a530-4916ae96ec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:02:10.931870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98898d8b-8438-46d2-a530-4916ae96ec04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:02:10.932150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98898d8b-8438-46d2-a530-4916ae96ec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:02:10.933436 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98898d8b-8438-46d2-a530-4916ae96ec04 admin admin] PATH_INFO: `/v3/projects/b9b52ae6347b4ef48752fec0410b28d1` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:02:10.934980 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98898d8b-8438-46d2-a530-4916ae96ec04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b52ae6347b4ef48752fec0410b28d1)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:02:10.936036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-98898d8b-8438-46d2-a530-4916ae96ec04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 05:02:10.936036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: warnings.warn(msg) Sep 27 05:02:10.936036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: Sep 27 05:02:10.937204 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98898d8b-8438-46d2-a530-4916ae96ec04 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:02:10.999696 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-98898d8b-8438-46d2-a530-4916ae96ec04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b52ae6347b4ef48752fec0410b28d1', 'request_id': 'req-98898d8b-8438-46d2-a530-4916ae96ec04'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:02:11.009463 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-98898d8b-8438-46d2-a530-4916ae96ec04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b52ae6347b4ef48752fec0410b28d1', 'request_id': 'req-98898d8b-8438-46d2-a530-4916ae96ec04'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:02:11.027708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-98898d8b-8438-46d2-a530-4916ae96ec04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b52ae6347b4ef48752fec0410b28d1', 'request_id': 'req-98898d8b-8438-46d2-a530-4916ae96ec04'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:02:11.039075 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-98898d8b-8438-46d2-a530-4916ae96ec04 admin admin] The token cache is being invalidate because project b9b52ae6347b4ef48752fec0410b28d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:02:11.039358 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-98898d8b-8438-46d2-a530-4916ae96ec04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:02:11.040125 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-98898d8b-8438-46d2-a530-4916ae96ec04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:02:11.041711 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 747/1513] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:02:10 2022] DELETE /identity/v3/projects/b9b52ae6347b4ef48752fec0410b28d1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:03:40.628697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe1140-7c9f-44e1-a2e0-efc5c9f65bef None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:40.629324 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe1140-7c9f-44e1-a2e0-efc5c9f65bef None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:40.629324 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe1140-7c9f-44e1-a2e0-efc5c9f65bef None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:40.631556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 05:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:03:40.636450 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05a906-8bd2-495b-a72b-306cfa7942ff None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:40.636899 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05a906-8bd2-495b-a72b-306cfa7942ff None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:40.637049 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05a906-8bd2-495b-a72b-306cfa7942ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:40.655081 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ce05a906-8bd2-495b-a72b-306cfa7942ff None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:03:40.656253 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ce05a906-8bd2-495b-a72b-306cfa7942ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:03:40.714201 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 05:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:03:40.872905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe1140-7c9f-44e1-a2e0-efc5c9f65bef None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:03:40.874580 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-39fe1140-7c9f-44e1-a2e0-efc5c9f65bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:03:40.947140 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe1140-7c9f-44e1-a2e0-efc5c9f65bef None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:03:40.952616 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc85ec9-8223-43ed-81f0-9f938d58ae94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:03:40.953396 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc85ec9-8223-43ed-81f0-9f938d58ae94 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:40.953686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc85ec9-8223-43ed-81f0-9f938d58ae94 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:40.953964 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc85ec9-8223-43ed-81f0-9f938d58ae94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:40.962438 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc85ec9-8223-43ed-81f0-9f938d58ae94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:03:40.964044 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc85ec9-8223-43ed-81f0-9f938d58ae94 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:03:40.975600 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 768/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:03:41.998750 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d205e63-783b-437d-beed-c9f4318aa0cc None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:41.999265 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d205e63-783b-437d-beed-c9f4318aa0cc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:41.999524 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d205e63-783b-437d-beed-c9f4318aa0cc None None] PATH_INFO: `/v3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:42.001194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 749/1517] 10.222.0.49 () {54 vars in 925 bytes} [Tue Sep 27 05:03:41 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:03:42.007675 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588b7a2-b0ab-4165-9900-1bb7368d55b8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:42.008153 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588b7a2-b0ab-4165-9900-1bb7368d55b8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:42.008241 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588b7a2-b0ab-4165-9900-1bb7368d55b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:42.027257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f588b7a2-b0ab-4165-9900-1bb7368d55b8 None None] MFA Rules not processed for user `8489647547d544a681131dad99e058bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:03:42.028448 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f588b7a2-b0ab-4165-9900-1bb7368d55b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:03:42.097577 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 769/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Sep 27 05:03:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:03:42.331196 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660c354-9987-40c6-a4de-e6adc7359947 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:42.331480 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660c354-9987-40c6-a4de-e6adc7359947 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:42.331751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660c354-9987-40c6-a4de-e6adc7359947 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:42.334444 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 750/1519] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 05:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:03:42.339376 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedfb82-fdcd-4406-871b-b3ae9375fd02 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:42.339668 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedfb82-fdcd-4406-871b-b3ae9375fd02 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:42.339949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedfb82-fdcd-4406-871b-b3ae9375fd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:42.357789 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3cedfb82-fdcd-4406-871b-b3ae9375fd02 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:03:42.358989 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3cedfb82-fdcd-4406-871b-b3ae9375fd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:03:42.367355 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 770/1520] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 05:03:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:03:42.523102 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660c354-9987-40c6-a4de-e6adc7359947 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:03:42.537479 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660c354-9987-40c6-a4de-e6adc7359947 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:03:42.542748 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d4261-9080-4a34-a765-a6572b2b8305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:03:42.543370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d4261-9080-4a34-a765-a6572b2b8305 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:42.543645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d4261-9080-4a34-a765-a6572b2b8305 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:42.543916 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d4261-9080-4a34-a765-a6572b2b8305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:42.551696 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d4261-9080-4a34-a765-a6572b2b8305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:03:42.554015 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d4261-9080-4a34-a765-a6572b2b8305 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:03:42.566505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 751/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:03:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:03:46.106084 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a08d9-4ea0-418e-9e1f-661081abffd9 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:46.106618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a08d9-4ea0-418e-9e1f-661081abffd9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:46.106618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a08d9-4ea0-418e-9e1f-661081abffd9 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:46.108452 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 771/1522] 10.222.0.27 () {54 vars in 960 bytes} [Tue Sep 27 05:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:03:46.113531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7941fc5-e4c8-4758-9c4e-59f0c792f65c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:46.114006 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7941fc5-e4c8-4758-9c4e-59f0c792f65c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:46.114170 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7941fc5-e4c8-4758-9c4e-59f0c792f65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:46.132293 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d7941fc5-e4c8-4758-9c4e-59f0c792f65c None None] MFA Rules not processed for user `8489647547d544a681131dad99e058bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:03:46.133535 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d7941fc5-e4c8-4758-9c4e-59f0c792f65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:03:46.141817 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 752/1523] 10.222.0.27 () {58 vars in 1057 bytes} [Tue Sep 27 05:03:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:03:46.149791 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a08d9-4ea0-418e-9e1f-661081abffd9 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:03:46.163165 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a08d9-4ea0-418e-9e1f-661081abffd9 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:03:46.167979 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b009f-8d50-4777-a852-9018f4d4d3db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8489647547d544a681131dad99e058bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:03:46.168593 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b009f-8d50-4777-a852-9018f4d4d3db service placement] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:46.168903 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b009f-8d50-4777-a852-9018f4d4d3db service placement] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:46.169175 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b009f-8d50-4777-a852-9018f4d4d3db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:46.177177 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b009f-8d50-4777-a852-9018f4d4d3db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:03:46.178746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b009f-8d50-4777-a852-9018f4d4d3db service placement] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:03:46.187960 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 772/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:03:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:03:54.304684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a94bc-2dfe-4e1b-b046-64b6a67399b0 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:54.305242 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a94bc-2dfe-4e1b-b046-64b6a67399b0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:54.305242 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a94bc-2dfe-4e1b-b046-64b6a67399b0 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:54.306985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 05:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:03:54.312007 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1917b-59e2-4f52-adf2-8a6854bed80e None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:54.312448 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1917b-59e2-4f52-adf2-8a6854bed80e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:54.312573 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1917b-59e2-4f52-adf2-8a6854bed80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:54.330397 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-78b1917b-59e2-4f52-adf2-8a6854bed80e None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:03:54.331598 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-78b1917b-59e2-4f52-adf2-8a6854bed80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:03:54.339974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 05:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:03:54.493335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a94bc-2dfe-4e1b-b046-64b6a67399b0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:03:54.507770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a94bc-2dfe-4e1b-b046-64b6a67399b0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:03:54.513152 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fcae2-6e14-4504-a5bf-e2ce73adeaa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:03:54.513783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fcae2-6e14-4504-a5bf-e2ce73adeaa0 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:54.514065 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fcae2-6e14-4504-a5bf-e2ce73adeaa0 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:54.514348 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fcae2-6e14-4504-a5bf-e2ce73adeaa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:54.522781 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fcae2-6e14-4504-a5bf-e2ce73adeaa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:03:54.524374 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fcae2-6e14-4504-a5bf-e2ce73adeaa0 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:03:54.533453 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 754/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:03:55.843128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea68a-4c55-4ed3-bd37-9097fe63c613 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:55.843720 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea68a-4c55-4ed3-bd37-9097fe63c613 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:55.843720 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ea68a-4c55-4ed3-bd37-9097fe63c613 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:55.845575 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 27 05:03:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:03:55.850532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d3ce6-b237-4dee-bb94-52f6a791734c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:55.850967 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d3ce6-b237-4dee-bb94-52f6a791734c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:55.851083 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d3ce6-b237-4dee-bb94-52f6a791734c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:55.869300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-652d3ce6-b237-4dee-bb94-52f6a791734c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:03:55.870480 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-652d3ce6-b237-4dee-bb94-52f6a791734c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:03:55.878410 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 27 05:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:03:56.032007 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ea68a-4c55-4ed3-bd37-9097fe63c613 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:03:56.046562 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ea68a-4c55-4ed3-bd37-9097fe63c613 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:03:56.052663 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98aae3-5c48-489d-8e0f-c5c1bf1bbf90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:03:56.053348 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98aae3-5c48-489d-8e0f-c5c1bf1bbf90 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:56.053626 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98aae3-5c48-489d-8e0f-c5c1bf1bbf90 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:56.053901 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98aae3-5c48-489d-8e0f-c5c1bf1bbf90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:56.061991 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98aae3-5c48-489d-8e0f-c5c1bf1bbf90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:03:56.063582 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98aae3-5c48-489d-8e0f-c5c1bf1bbf90 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:03:56.073558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 775/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:03:59.993796 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a8a0-958e-435e-9495-6a8457ac75a3 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:03:59.994307 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a8a0-958e-435e-9495-6a8457ac75a3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:03:59.994411 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a8a0-958e-435e-9495-6a8457ac75a3 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:03:59.996142 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 27 05:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:04:00.001691 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816d1ac-6aef-49ea-a188-e94a50813d92 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:04:00.002122 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816d1ac-6aef-49ea-a188-e94a50813d92 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:04:00.002254 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816d1ac-6aef-49ea-a188-e94a50813d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:04:00.019922 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0816d1ac-6aef-49ea-a188-e94a50813d92 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:04:00.021133 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0816d1ac-6aef-49ea-a188-e94a50813d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:04:00.028879 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Sep 27 05:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:04:00.066363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6a8a0-958e-435e-9495-6a8457ac75a3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:04:00.068003 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c9a6a8a0-958e-435e-9495-6a8457ac75a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:04:00.123321 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6a8a0-958e-435e-9495-6a8457ac75a3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:04:00.127086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495494a-9c1c-4321-a0a3-c8a2c4a6728b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:04:00.127720 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495494a-9c1c-4321-a0a3-c8a2c4a6728b service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:04:00.127998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495494a-9c1c-4321-a0a3-c8a2c4a6728b service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:04:00.128271 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495494a-9c1c-4321-a0a3-c8a2c4a6728b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:04:00.136979 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495494a-9c1c-4321-a0a3-c8a2c4a6728b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:04:00.138403 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495494a-9c1c-4321-a0a3-c8a2c4a6728b service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:04:00.147669 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 757/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:04:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:04:02.464434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86646686-ca0b-49b0-a912-f5e93f935c50 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:04:02.465018 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86646686-ca0b-49b0-a912-f5e93f935c50 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:04:02.465018 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86646686-ca0b-49b0-a912-f5e93f935c50 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:04:02.466823 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 27 05:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:04:02.472143 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b10d0-9a8a-481a-862c-16fcf7da6b3f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:04:02.472573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b10d0-9a8a-481a-862c-16fcf7da6b3f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:04:02.472706 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b10d0-9a8a-481a-862c-16fcf7da6b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:04:02.491676 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-040b10d0-9a8a-481a-862c-16fcf7da6b3f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:04:02.492886 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-040b10d0-9a8a-481a-862c-16fcf7da6b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:04:02.500557 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Sep 27 05:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:04:02.536942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86646686-ca0b-49b0-a912-f5e93f935c50 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:04:02.539450 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-86646686-ca0b-49b0-a912-f5e93f935c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:04:02.552004 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86646686-ca0b-49b0-a912-f5e93f935c50 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:04:02.555778 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8ca3e-c388-48e5-ac4a-51921c3851b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:04:02.556402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8ca3e-c388-48e5-ac4a-51921c3851b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:04:02.556686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8ca3e-c388-48e5-ac4a-51921c3851b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:04:02.556999 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8ca3e-c388-48e5-ac4a-51921c3851b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:04:02.565636 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8ca3e-c388-48e5-ac4a-51921c3851b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:04:02.567055 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8ca3e-c388-48e5-ac4a-51921c3851b8 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:04:02.576457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 778/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:04:06.399919 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f89746-d28b-4770-aada-64b33dd35fed None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:04:06.400495 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f89746-d28b-4770-aada-64b33dd35fed None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:04:06.400495 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f89746-d28b-4770-aada-64b33dd35fed None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:04:06.402329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 27 05:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:04:06.407537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15679438-72e1-4382-9a3b-0fc824bc416a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:04:06.407939 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15679438-72e1-4382-9a3b-0fc824bc416a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:04:06.408085 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15679438-72e1-4382-9a3b-0fc824bc416a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:04:06.428276 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-15679438-72e1-4382-9a3b-0fc824bc416a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:04:06.430406 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-15679438-72e1-4382-9a3b-0fc824bc416a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:04:06.438451 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Sep 27 05:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:04:06.695419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f89746-d28b-4770-aada-64b33dd35fed None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:04:06.697134 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-31f89746-d28b-4770-aada-64b33dd35fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:04:06.751599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f89746-d28b-4770-aada-64b33dd35fed None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:04:06.755101 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d6801-81d9-44d2-b864-b03b0902230e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:04:06.755747 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d6801-81d9-44d2-b864-b03b0902230e service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:04:06.756016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d6801-81d9-44d2-b864-b03b0902230e service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:04:06.756308 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d6801-81d9-44d2-b864-b03b0902230e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:04:06.765662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d6801-81d9-44d2-b864-b03b0902230e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:04:06.767086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d6801-81d9-44d2-b864-b03b0902230e service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:04:06.776841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 760/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:04:09.147208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a53bc-44a7-45bb-a968-a23540b512af None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:04:09.147764 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a53bc-44a7-45bb-a968-a23540b512af None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:04:09.147764 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a53bc-44a7-45bb-a968-a23540b512af None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:04:09.149582 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 780/1540] 127.0.0.1 () {54 vars in 916 bytes} [Tue Sep 27 05:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:04:09.154839 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc98fb9-702b-45bc-a200-8df15969f749 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:04:09.155288 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc98fb9-702b-45bc-a200-8df15969f749 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:04:09.155393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc98fb9-702b-45bc-a200-8df15969f749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:04:09.173071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8bc98fb9-702b-45bc-a200-8df15969f749 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:04:09.174243 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8bc98fb9-702b-45bc-a200-8df15969f749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:04:09.182798 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 761/1541] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Sep 27 05:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:04:09.438191 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a53bc-44a7-45bb-a968-a23540b512af None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:04:09.439963 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ee3a53bc-44a7-45bb-a968-a23540b512af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:04:09.453010 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a53bc-44a7-45bb-a968-a23540b512af None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:04:09.456767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da478da3-9ed8-46ca-8e28-a7e478c7ecd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:04:09.457431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478da3-9ed8-46ca-8e28-a7e478c7ecd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:04:09.457709 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478da3-9ed8-46ca-8e28-a7e478c7ecd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:04:09.457979 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478da3-9ed8-46ca-8e28-a7e478c7ecd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:04:09.466852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da478da3-9ed8-46ca-8e28-a7e478c7ecd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:04:09.468278 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da478da3-9ed8-46ca-8e28-a7e478c7ecd6 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:04:09.477991 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 781/1542] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:05:47.744478 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08224f-69e0-4012-ad4e-636eee7ba8dd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:47.745136 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08224f-69e0-4012-ad4e-636eee7ba8dd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:47.745136 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08224f-69e0-4012-ad4e-636eee7ba8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:47.768114 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6f08224f-69e0-4012-ad4e-636eee7ba8dd None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:47.773482 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6f08224f-69e0-4012-ad4e-636eee7ba8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:47.788186 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 762/1543] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:47.796857 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3554e-d7bf-462a-a670-6e3977d3da43 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:47.797437 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3554e-d7bf-462a-a670-6e3977d3da43 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:47.797437 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3554e-d7bf-462a-a670-6e3977d3da43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:47.830251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-74d3554e-d7bf-462a-a670-6e3977d3da43 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:47.831589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-74d3554e-d7bf-462a-a670-6e3977d3da43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:47.840645 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 782/1544] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:47.845039 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08224f-69e0-4012-ad4e-636eee7ba8dd None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:47.855860 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08224f-69e0-4012-ad4e-636eee7ba8dd None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:47.868549 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cb5ef-7a71-4476-886e-84121c8f3f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:47.869266 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cb5ef-7a71-4476-886e-84121c8f3f80 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:47.869548 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cb5ef-7a71-4476-886e-84121c8f3f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:47.869824 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cb5ef-7a71-4476-886e-84121c8f3f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:47.870558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cb5ef-7a71-4476-886e-84121c8f3f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:05:47.870863 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cb5ef-7a71-4476-886e-84121c8f3f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:47.872778 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cb5ef-7a71-4476-886e-84121c8f3f80 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:47.891603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 763/1545] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:05:47.901070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3554e-d7bf-462a-a670-6e3977d3da43 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:47.915640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3554e-d7bf-462a-a670-6e3977d3da43 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:47.922011 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a69a1-78f6-47c0-bbb8-e50cf3693767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:47.922701 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a69a1-78f6-47c0-bbb8-e50cf3693767 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:47.922983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a69a1-78f6-47c0-bbb8-e50cf3693767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:47.923263 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a69a1-78f6-47c0-bbb8-e50cf3693767 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:47.923974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a69a1-78f6-47c0-bbb8-e50cf3693767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:47.926010 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a69a1-78f6-47c0-bbb8-e50cf3693767 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:47.965133 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 783/1546] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:05:47 2022] POST /identity/v3/projects => generated 405 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:47.969456 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cb5ef-7a71-4476-886e-84121c8f3f80 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.000462 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cb5ef-7a71-4476-886e-84121c8f3f80 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.000654 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8029316-e6d4-48ae-8866-7c1f5ea98748 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.000654 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8029316-e6d4-48ae-8866-7c1f5ea98748 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.000986 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8029316-e6d4-48ae-8866-7c1f5ea98748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.033904 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b8029316-e6d4-48ae-8866-7c1f5ea98748 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:48.035350 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b8029316-e6d4-48ae-8866-7c1f5ea98748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:48.100052 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691564e-07d2-437a-8d7d-ccfe94744b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.101446 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691564e-07d2-437a-8d7d-ccfe94744b9e admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.101731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691564e-07d2-437a-8d7d-ccfe94744b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.101988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691564e-07d2-437a-8d7d-ccfe94744b9e admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.102694 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691564e-07d2-437a-8d7d-ccfe94744b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.104624 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691564e-07d2-437a-8d7d-ccfe94744b9e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.127880 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 784/1547] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:48.135802 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 764/1548] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:05:47 2022] POST /identity/v3/users => generated 303 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:48.141775 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8029316-e6d4-48ae-8866-7c1f5ea98748 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.142686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69390bef-2983-4e2e-9aae-d2b72bf150fd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.142977 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69390bef-2983-4e2e-9aae-d2b72bf150fd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.143257 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69390bef-2983-4e2e-9aae-d2b72bf150fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.154617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8029316-e6d4-48ae-8866-7c1f5ea98748 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.166831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-69390bef-2983-4e2e-9aae-d2b72bf150fd None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:48.168225 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-69390bef-2983-4e2e-9aae-d2b72bf150fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:48.177660 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78114e68-dd58-49c1-b00d-fd71c5565827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.178912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78114e68-dd58-49c1-b00d-fd71c5565827 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.179193 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78114e68-dd58-49c1-b00d-fd71c5565827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.179475 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78114e68-dd58-49c1-b00d-fd71c5565827 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.180211 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78114e68-dd58-49c1-b00d-fd71c5565827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.181862 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78114e68-dd58-49c1-b00d-fd71c5565827 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.184133 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 765/1549] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:48.187861 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166895c-1d0e-47e4-9b83-7bc3f4596576 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.188147 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166895c-1d0e-47e4-9b83-7bc3f4596576 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.188427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166895c-1d0e-47e4-9b83-7bc3f4596576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.198416 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 785/1550] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:48.199736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500290b0-d671-44d2-89b7-eaf880f138b3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.200026 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500290b0-d671-44d2-89b7-eaf880f138b3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.200307 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500290b0-d671-44d2-89b7-eaf880f138b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.210313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e166895c-1d0e-47e4-9b83-7bc3f4596576 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:48.211517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e166895c-1d0e-47e4-9b83-7bc3f4596576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:48.232665 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 766/1551] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:48.233372 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166895c-1d0e-47e4-9b83-7bc3f4596576 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.238232 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-500290b0-d671-44d2-89b7-eaf880f138b3 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:48.239483 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-500290b0-d671-44d2-89b7-eaf880f138b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:48.243940 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166895c-1d0e-47e4-9b83-7bc3f4596576 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.257748 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5540cbc-40ee-4fe8-990f-91a6ccd79e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.258338 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5540cbc-40ee-4fe8-990f-91a6ccd79e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.258616 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5540cbc-40ee-4fe8-990f-91a6ccd79e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.258889 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5540cbc-40ee-4fe8-990f-91a6ccd79e49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.259629 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5540cbc-40ee-4fe8-990f-91a6ccd79e49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:05:48.259932 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5540cbc-40ee-4fe8-990f-91a6ccd79e49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.261627 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5540cbc-40ee-4fe8-990f-91a6ccd79e49 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.281539 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 786/1552] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:48.282591 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500290b0-d671-44d2-89b7-eaf880f138b3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.282719 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 767/1553] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:05:48.284443 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e837b-2b42-4e1b-a22a-0b4806d4123a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.285621 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e837b-2b42-4e1b-a22a-0b4806d4123a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.286145 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e837b-2b42-4e1b-a22a-0b4806d4123a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.299831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500290b0-d671-44d2-89b7-eaf880f138b3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.317959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7f1e837b-2b42-4e1b-a22a-0b4806d4123a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:48.320514 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7f1e837b-2b42-4e1b-a22a-0b4806d4123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:48.325563 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa15075-f12f-48f3-8818-ebed5ee502d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.326264 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa15075-f12f-48f3-8818-ebed5ee502d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.326544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa15075-f12f-48f3-8818-ebed5ee502d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.326820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa15075-f12f-48f3-8818-ebed5ee502d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.327558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa15075-f12f-48f3-8818-ebed5ee502d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.329320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa15075-f12f-48f3-8818-ebed5ee502d2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.330497 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 768/1554] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:48.332187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e05ed-3f55-4131-87b9-c794fc142723 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.332475 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e05ed-3f55-4131-87b9-c794fc142723 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.332751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e05ed-3f55-4131-87b9-c794fc142723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.347082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 787/1555] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:48.348351 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aad64-17de-4817-8839-d891f498c62e None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.348646 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aad64-17de-4817-8839-d891f498c62e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.350875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aad64-17de-4817-8839-d891f498c62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.361554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1a9e05ed-3f55-4131-87b9-c794fc142723 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:48.363122 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1a9e05ed-3f55-4131-87b9-c794fc142723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:48.372990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4e1aad64-17de-4817-8839-d891f498c62e None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:48.374217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4e1aad64-17de-4817-8839-d891f498c62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:48.374456 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 769/1556] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:48.383193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e05ed-3f55-4131-87b9-c794fc142723 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.383574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 788/1557] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:48.384362 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1aad64-17de-4817-8839-d891f498c62e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.395903 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e05ed-3f55-4131-87b9-c794fc142723 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.400221 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1aad64-17de-4817-8839-d891f498c62e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.401959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb6ee8-5d42-4595-88a3-621cf545c256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.403004 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6ee8-5d42-4595-88a3-621cf545c256 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.403379 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6ee8-5d42-4595-88a3-621cf545c256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.403772 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6ee8-5d42-4595-88a3-621cf545c256 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.404685 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb6ee8-5d42-4595-88a3-621cf545c256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.405762 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2c985-715d-4c43-ad50-b63a8ed426d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.405899 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-cacb6ee8-5d42-4595-88a3-621cf545c256 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 05:05:48.405899 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: warnings.warn(msg) Sep 27 05:05:48.405899 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: Sep 27 05:05:48.406955 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c985-715d-4c43-ad50-b63a8ed426d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.407399 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb6ee8-5d42-4595-88a3-621cf545c256 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.407524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c985-715d-4c43-ad50-b63a8ed426d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.407923 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c985-715d-4c43-ad50-b63a8ed426d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.408898 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2c985-715d-4c43-ad50-b63a8ed426d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:05:48.409661 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2c985-715d-4c43-ad50-b63a8ed426d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.410823 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING py.warnings [None req-0ba2c985-715d-4c43-ad50-b63a8ed426d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 27 05:05:48.410823 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: warnings.warn(msg) Sep 27 05:05:48.410823 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: Sep 27 05:05:48.412218 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2c985-715d-4c43-ad50-b63a8ed426d2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.431495 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 789/1558] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:05:48.433189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dc31a-d78a-4fd0-b0f9-3a97ec783cd9 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.433644 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dc31a-d78a-4fd0-b0f9-3a97ec783cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.434125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dc31a-d78a-4fd0-b0f9-3a97ec783cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.447721 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 770/1559] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/projects => generated 391 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:48.448753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb6ee8-5d42-4595-88a3-621cf545c256 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.455533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b15dc31a-d78a-4fd0-b0f9-3a97ec783cd9 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:48.457047 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b15dc31a-d78a-4fd0-b0f9-3a97ec783cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:48.513863 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb6ee8-5d42-4595-88a3-621cf545c256 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.518348 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a51674-7245-4333-9f4c-76937e6c83d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.519230 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51674-7245-4333-9f4c-76937e6c83d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.519507 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51674-7245-4333-9f4c-76937e6c83d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.519777 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a51674-7245-4333-9f4c-76937e6c83d2 admin admin] PATH_INFO: `/v3/projects/f2f1fc523ce54f76a6c418d32af91a2d/users/03ea0927cd3f49759cdc2d8643af9548/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.520323 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 790/1560] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:48.521245 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15dc31a-d78a-4fd0-b0f9-3a97ec783cd9 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.531364 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15dc31a-d78a-4fd0-b0f9-3a97ec783cd9 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.536181 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439f331-eac7-4ea4-ac63-134201d7c807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.536858 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439f331-eac7-4ea4-ac63-134201d7c807 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.537141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439f331-eac7-4ea4-ac63-134201d7c807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.537419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439f331-eac7-4ea4-ac63-134201d7c807 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.538485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439f331-eac7-4ea4-ac63-134201d7c807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:05:48.538790 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439f331-eac7-4ea4-ac63-134201d7c807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.539192 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a51674-7245-4333-9f4c-76937e6c83d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f1fc523ce54f76a6c418d32af91a2d, user_id=03ea0927cd3f49759cdc2d8643af9548, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.540227 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-68a51674-7245-4333-9f4c-76937e6c83d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 05:05:48.540227 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: warnings.warn(msg) Sep 27 05:05:48.540227 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: Sep 27 05:05:48.540478 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439f331-eac7-4ea4-ac63-134201d7c807 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.542235 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a51674-7245-4333-9f4c-76937e6c83d2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.553003 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 791/1561] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:05:48.554568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ce9aa-cae8-49cf-b562-b7fc0a2a7eb8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.555004 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ce9aa-cae8-49cf-b562-b7fc0a2a7eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.555431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ce9aa-cae8-49cf-b562-b7fc0a2a7eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.555552 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 771/1562] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:48 2022] PUT /identity/v3/projects/f2f1fc523ce54f76a6c418d32af91a2d/users/03ea0927cd3f49759cdc2d8643af9548/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:48.556243 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a51674-7245-4333-9f4c-76937e6c83d2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.574273 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-5e8ce9aa-cae8-49cf-b562-b7fc0a2a7eb8 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:48.575467 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5e8ce9aa-cae8-49cf-b562-b7fc0a2a7eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:48.618515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a51674-7245-4333-9f4c-76937e6c83d2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.623130 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c30264-14e9-45b2-921b-cdb97bccf27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.623779 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c30264-14e9-45b2-921b-cdb97bccf27b admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.624056 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c30264-14e9-45b2-921b-cdb97bccf27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.624363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c30264-14e9-45b2-921b-cdb97bccf27b admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.625054 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c30264-14e9-45b2-921b-cdb97bccf27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.626950 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c30264-14e9-45b2-921b-cdb97bccf27b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.634893 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 792/1563] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:48.635703 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ce9aa-cae8-49cf-b562-b7fc0a2a7eb8 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.648033 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ce9aa-cae8-49cf-b562-b7fc0a2a7eb8 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.652576 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fb056-d8a5-4b8d-93f8-b745cd3a2e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.653172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 772/1564] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:48.653293 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fb056-d8a5-4b8d-93f8-b745cd3a2e4d admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.653529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fb056-d8a5-4b8d-93f8-b745cd3a2e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.653801 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fb056-d8a5-4b8d-93f8-b745cd3a2e4d admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.654486 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fb056-d8a5-4b8d-93f8-b745cd3a2e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.655499 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING py.warnings [None req-f71fb056-d8a5-4b8d-93f8-b745cd3a2e4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 05:05:48.655499 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: warnings.warn(msg) Sep 27 05:05:48.655499 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: Sep 27 05:05:48.656730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fb056-d8a5-4b8d-93f8-b745cd3a2e4d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.657732 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183b531-7982-4545-9f56-f9f2350fdac2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.658021 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183b531-7982-4545-9f56-f9f2350fdac2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.658299 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183b531-7982-4545-9f56-f9f2350fdac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.676158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5183b531-7982-4545-9f56-f9f2350fdac2 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:48.676422 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 793/1565] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/users => generated 296 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:48.677688 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df114f44-e0f5-42e4-a583-2520bfcadeb6 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.677976 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df114f44-e0f5-42e4-a583-2520bfcadeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.678800 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df114f44-e0f5-42e4-a583-2520bfcadeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.681552 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5183b531-7982-4545-9f56-f9f2350fdac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:48.696742 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-df114f44-e0f5-42e4-a583-2520bfcadeb6 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:48.697952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-df114f44-e0f5-42e4-a583-2520bfcadeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:48.740563 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 773/1566] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:48.745600 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228a367-b295-46ed-b3ff-488339791c1a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.746237 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228a367-b295-46ed-b3ff-488339791c1a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.746398 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228a367-b295-46ed-b3ff-488339791c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.755521 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 794/1567] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:48.756381 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df114f44-e0f5-42e4-a583-2520bfcadeb6 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.764829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8228a367-b295-46ed-b3ff-488339791c1a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:48.765886 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df114f44-e0f5-42e4-a583-2520bfcadeb6 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.766007 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8228a367-b295-46ed-b3ff-488339791c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:48.773855 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d915b31-2c76-46ab-b2cb-cf9cff2e1b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.774501 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d915b31-2c76-46ab-b2cb-cf9cff2e1b35 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.774782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d915b31-2c76-46ab-b2cb-cf9cff2e1b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.775060 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d915b31-2c76-46ab-b2cb-cf9cff2e1b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.775497 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 774/1568] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:48.775741 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d915b31-2c76-46ab-b2cb-cf9cff2e1b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.777711 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d915b31-2c76-46ab-b2cb-cf9cff2e1b35 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.778073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957bc65-bc39-4809-94fb-73e6e5c335d2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.778361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957bc65-bc39-4809-94fb-73e6e5c335d2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.778641 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957bc65-bc39-4809-94fb-73e6e5c335d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.802968 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 795/1569] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:48.804338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d915b31-2c76-46ab-b2cb-cf9cff2e1b35 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.806986 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d957bc65-bc39-4809-94fb-73e6e5c335d2 None None] MFA Rules not processed for user `03ea0927cd3f49759cdc2d8643af9548`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:48.808224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d957bc65-bc39-4809-94fb-73e6e5c335d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:48.863143 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d915b31-2c76-46ab-b2cb-cf9cff2e1b35 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.868335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c6ae3-041d-4d82-a914-d6a666a440f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.869019 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c6ae3-041d-4d82-a914-d6a666a440f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.869304 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c6ae3-041d-4d82-a914-d6a666a440f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.869583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c6ae3-041d-4d82-a914-d6a666a440f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.869871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 775/1570] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:48.870305 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c6ae3-041d-4d82-a914-d6a666a440f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:05:48.870613 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c6ae3-041d-4d82-a914-d6a666a440f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.870809 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957bc65-bc39-4809-94fb-73e6e5c335d2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.872247 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c6ae3-041d-4d82-a914-d6a666a440f5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.883163 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957bc65-bc39-4809-94fb-73e6e5c335d2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.891401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 796/1571] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:05:48.891401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c6ae3-041d-4d82-a914-d6a666a440f5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.891672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910cbf-63bd-453c-982f-fe1e5a01e3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.891672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910cbf-63bd-453c-982f-fe1e5a01e3ed admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.891672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910cbf-63bd-453c-982f-fe1e5a01e3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.891672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910cbf-63bd-453c-982f-fe1e5a01e3ed admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.892024 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d910cbf-63bd-453c-982f-fe1e5a01e3ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.892321 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d910cbf-63bd-453c-982f-fe1e5a01e3ed admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.895271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c6ae3-041d-4d82-a914-d6a666a440f5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.899902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246691a-6e53-4973-99a3-e1bf539f874f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.900550 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246691a-6e53-4973-99a3-e1bf539f874f admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.900856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246691a-6e53-4973-99a3-e1bf539f874f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.901131 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246691a-6e53-4973-99a3-e1bf539f874f admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.901965 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246691a-6e53-4973-99a3-e1bf539f874f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.903487 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246691a-6e53-4973-99a3-e1bf539f874f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.914613 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 776/1572] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/users => generated 282 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:48.914613 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7960e4-14b5-40b7-8b0f-ee6704dc3a8e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.914613 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7960e4-14b5-40b7-8b0f-ee6704dc3a8e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.914613 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7960e4-14b5-40b7-8b0f-ee6704dc3a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.915089 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 797/1573] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:48.916263 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aea99a-0ad7-4d48-8d51-7cb1fd08b5f0 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.916553 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aea99a-0ad7-4d48-8d51-7cb1fd08b5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.916844 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aea99a-0ad7-4d48-8d51-7cb1fd08b5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.932772 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ac7960e4-14b5-40b7-8b0f-ee6704dc3a8e None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:48.933978 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-00aea99a-0ad7-4d48-8d51-7cb1fd08b5f0 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:48.934112 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ac7960e4-14b5-40b7-8b0f-ee6704dc3a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:48.935128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-00aea99a-0ad7-4d48-8d51-7cb1fd08b5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:48.941835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 777/1574] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:48.942596 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7960e4-14b5-40b7-8b0f-ee6704dc3a8e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.942971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 798/1575] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:48.945832 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aea99a-0ad7-4d48-8d51-7cb1fd08b5f0 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.952284 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7960e4-14b5-40b7-8b0f-ee6704dc3a8e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.955425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aea99a-0ad7-4d48-8d51-7cb1fd08b5f0 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.956985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deba8c1-14d2-4130-b56b-821cdbda9e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.957630 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deba8c1-14d2-4130-b56b-821cdbda9e9d admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.957904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deba8c1-14d2-4130-b56b-821cdbda9e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.958176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deba8c1-14d2-4130-b56b-821cdbda9e9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.958888 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deba8c1-14d2-4130-b56b-821cdbda9e9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:05:48.959187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deba8c1-14d2-4130-b56b-821cdbda9e9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.961136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18909ee-48bb-45d4-b140-de479eda7fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.961344 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deba8c1-14d2-4130-b56b-821cdbda9e9d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.961919 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18909ee-48bb-45d4-b140-de479eda7fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.962300 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18909ee-48bb-45d4-b140-de479eda7fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.962577 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18909ee-48bb-45d4-b140-de479eda7fc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.967097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18909ee-48bb-45d4-b140-de479eda7fc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.967097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18909ee-48bb-45d4-b140-de479eda7fc9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.973142 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 778/1576] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:05:48.973852 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deba8c1-14d2-4130-b56b-821cdbda9e9d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:48.983463 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deba8c1-14d2-4130-b56b-821cdbda9e9d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:48.988254 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f6044-2e16-4f4c-b829-8e0cdf7d77bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:48.988930 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f6044-2e16-4f4c-b829-8e0cdf7d77bd admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:48.989212 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f6044-2e16-4f4c-b829-8e0cdf7d77bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:48.989492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f6044-2e16-4f4c-b829-8e0cdf7d77bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:48.990165 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f6044-2e16-4f4c-b829-8e0cdf7d77bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:48.992608 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f6044-2e16-4f4c-b829-8e0cdf7d77bd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:48.996427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 799/1577] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:48.996427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18909ee-48bb-45d4-b140-de479eda7fc9 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.003928 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18909ee-48bb-45d4-b140-de479eda7fc9 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.008765 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb9436-9c79-426a-a0df-b5ae60b03502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.009511 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb9436-9c79-426a-a0df-b5ae60b03502 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.009721 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb9436-9c79-426a-a0df-b5ae60b03502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.009997 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb9436-9c79-426a-a0df-b5ae60b03502 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.010683 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb9436-9c79-426a-a0df-b5ae60b03502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.012584 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb9436-9c79-426a-a0df-b5ae60b03502 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.018599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 779/1578] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/projects => generated 403 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:49.019417 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f6044-2e16-4f4c-b829-8e0cdf7d77bd admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.042563 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 800/1579] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:05:48 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:49.042563 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb9436-9c79-426a-a0df-b5ae60b03502 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.080254 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f6044-2e16-4f4c-b829-8e0cdf7d77bd admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.104486 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb9436-9c79-426a-a0df-b5ae60b03502 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.114524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac6faf-7335-438a-a2a2-3b09e75f98e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.116461 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac6faf-7335-438a-a2a2-3b09e75f98e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.116849 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac6faf-7335-438a-a2a2-3b09e75f98e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.117143 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac6faf-7335-438a-a2a2-3b09e75f98e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.117920 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac6faf-7335-438a-a2a2-3b09e75f98e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.119670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac6faf-7335-438a-a2a2-3b09e75f98e1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.130115 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 801/1580] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:49.131008 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac6faf-7335-438a-a2a2-3b09e75f98e1 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.137477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60068df-f12a-4ed6-9e87-cae3e0b192f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.138209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60068df-f12a-4ed6-9e87-cae3e0b192f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.138496 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60068df-f12a-4ed6-9e87-cae3e0b192f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.138981 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60068df-f12a-4ed6-9e87-cae3e0b192f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.139743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60068df-f12a-4ed6-9e87-cae3e0b192f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.141335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac6faf-7335-438a-a2a2-3b09e75f98e1 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.141472 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60068df-f12a-4ed6-9e87-cae3e0b192f6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.146330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2945b-a5cc-40de-ac55-8b6367948edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.146972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2945b-a5cc-40de-ac55-8b6367948edf admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.147250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2945b-a5cc-40de-ac55-8b6367948edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.147522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2945b-a5cc-40de-ac55-8b6367948edf admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.148268 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2945b-a5cc-40de-ac55-8b6367948edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:05:49.148574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2945b-a5cc-40de-ac55-8b6367948edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.150217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2945b-a5cc-40de-ac55-8b6367948edf admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.154613 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 780/1581] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:49.154613 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60068df-f12a-4ed6-9e87-cae3e0b192f6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.162000 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 802/1582] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:05:49.163424 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2945b-a5cc-40de-ac55-8b6367948edf admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.163691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60068df-f12a-4ed6-9e87-cae3e0b192f6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.168636 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728128be-5639-4087-be14-0ff55ef58359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.169365 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728128be-5639-4087-be14-0ff55ef58359 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.169652 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728128be-5639-4087-be14-0ff55ef58359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.170052 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728128be-5639-4087-be14-0ff55ef58359 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.170782 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728128be-5639-4087-be14-0ff55ef58359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:05:49.171090 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728128be-5639-4087-be14-0ff55ef58359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.172724 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728128be-5639-4087-be14-0ff55ef58359 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.174272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2945b-a5cc-40de-ac55-8b6367948edf admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.179591 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc2212-d779-4290-a9b7-0c42f8fd059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.180234 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc2212-d779-4290-a9b7-0c42f8fd059e admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.180517 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc2212-d779-4290-a9b7-0c42f8fd059e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.180805 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc2212-d779-4290-a9b7-0c42f8fd059e admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.181525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc2212-d779-4290-a9b7-0c42f8fd059e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.183413 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc2212-d779-4290-a9b7-0c42f8fd059e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.191834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 781/1583] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:05:49.191834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728128be-5639-4087-be14-0ff55ef58359 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.200891 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728128be-5639-4087-be14-0ff55ef58359 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.205414 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205a41e-1c03-4111-ab4d-5400446458b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.206002 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205a41e-1c03-4111-ab4d-5400446458b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.206285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205a41e-1c03-4111-ab4d-5400446458b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.206561 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205a41e-1c03-4111-ab4d-5400446458b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.207354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205a41e-1c03-4111-ab4d-5400446458b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.209079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205a41e-1c03-4111-ab4d-5400446458b9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.220114 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 782/1584] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:49.220838 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205a41e-1c03-4111-ab4d-5400446458b9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.221011 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 803/1585] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:05:49 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:49.222066 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc2212-d779-4290-a9b7-0c42f8fd059e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.231108 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205a41e-1c03-4111-ab4d-5400446458b9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.283185 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc2212-d779-4290-a9b7-0c42f8fd059e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.285713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f540ba1-01a2-4528-a4bd-e7e25868e7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.286668 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f540ba1-01a2-4528-a4bd-e7e25868e7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.286956 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f540ba1-01a2-4528-a4bd-e7e25868e7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.287235 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f540ba1-01a2-4528-a4bd-e7e25868e7c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.288378 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177610cf-9e43-4ab8-a896-965b4b37d484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.288517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f540ba1-01a2-4528-a4bd-e7e25868e7c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.289105 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177610cf-9e43-4ab8-a896-965b4b37d484 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.289376 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177610cf-9e43-4ab8-a896-965b4b37d484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.289653 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177610cf-9e43-4ab8-a896-965b4b37d484 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.290331 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177610cf-9e43-4ab8-a896-965b4b37d484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.290449 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f540ba1-01a2-4528-a4bd-e7e25868e7c5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.292239 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177610cf-9e43-4ab8-a896-965b4b37d484 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.309916 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 783/1586] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:05:49 2022] POST /identity/v3/users => generated 308 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:49.310792 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f540ba1-01a2-4528-a4bd-e7e25868e7c5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.315229 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 804/1587] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:05:49 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:49.315229 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177610cf-9e43-4ab8-a896-965b4b37d484 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.322731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f540ba1-01a2-4528-a4bd-e7e25868e7c5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.325370 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177610cf-9e43-4ab8-a896-965b4b37d484 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.327380 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbec335-0a4f-4c4a-ab03-b879eea059bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.328252 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbec335-0a4f-4c4a-ab03-b879eea059bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.328535 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbec335-0a4f-4c4a-ab03-b879eea059bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.328833 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbec335-0a4f-4c4a-ab03-b879eea059bf admin admin] PATH_INFO: `/v3/projects/97fc6113b9d248e0b081f9812381b453/users/43aeedbf8ef94c969eba750306890f57/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.329946 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e01fe-814a-4e4b-bb86-31b000f70337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.330588 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e01fe-814a-4e4b-bb86-31b000f70337 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.330873 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e01fe-814a-4e4b-bb86-31b000f70337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.331151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e01fe-814a-4e4b-bb86-31b000f70337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.332154 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e01fe-814a-4e4b-bb86-31b000f70337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.333786 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e01fe-814a-4e4b-bb86-31b000f70337 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.344354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbec335-0a4f-4c4a-ab03-b879eea059bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=97fc6113b9d248e0b081f9812381b453, user_id=43aeedbf8ef94c969eba750306890f57, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.344529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 805/1588] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:49.345168 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e01fe-814a-4e4b-bb86-31b000f70337 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.347266 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbec335-0a4f-4c4a-ab03-b879eea059bf admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.355419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e01fe-814a-4e4b-bb86-31b000f70337 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.361250 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 784/1589] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:49 2022] PUT /identity/v3/projects/97fc6113b9d248e0b081f9812381b453/users/43aeedbf8ef94c969eba750306890f57/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:49.362096 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbec335-0a4f-4c4a-ab03-b879eea059bf admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.411463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463af889-566f-4849-a8c9-2d09d08ff73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.412122 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463af889-566f-4849-a8c9-2d09d08ff73d admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.412402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463af889-566f-4849-a8c9-2d09d08ff73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.413334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463af889-566f-4849-a8c9-2d09d08ff73d admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.414054 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463af889-566f-4849-a8c9-2d09d08ff73d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.415993 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463af889-566f-4849-a8c9-2d09d08ff73d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.423340 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbec335-0a4f-4c4a-ab03-b879eea059bf admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.428047 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9a240-3aa3-473a-91f1-49a8204e4350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.428736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a240-3aa3-473a-91f1-49a8204e4350 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.429055 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a240-3aa3-473a-91f1-49a8204e4350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.429335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9a240-3aa3-473a-91f1-49a8204e4350 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.430026 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9a240-3aa3-473a-91f1-49a8204e4350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.431986 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9a240-3aa3-473a-91f1-49a8204e4350 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.443867 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 806/1590] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:05:49 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:49.443867 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463af889-566f-4849-a8c9-2d09d08ff73d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.458401 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 785/1591] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:05:49 2022] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:49.459256 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9a240-3aa3-473a-91f1-49a8204e4350 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.504012 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463af889-566f-4849-a8c9-2d09d08ff73d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.518589 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9a240-3aa3-473a-91f1-49a8204e4350 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.523915 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f360587-fc22-4fa9-8bee-07b98c305b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.524570 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f360587-fc22-4fa9-8bee-07b98c305b2a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.524884 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f360587-fc22-4fa9-8bee-07b98c305b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.525158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f360587-fc22-4fa9-8bee-07b98c305b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.525874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f360587-fc22-4fa9-8bee-07b98c305b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.527470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f360587-fc22-4fa9-8bee-07b98c305b2a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.536924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 786/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:49.538388 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f360587-fc22-4fa9-8bee-07b98c305b2a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.549553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f360587-fc22-4fa9-8bee-07b98c305b2a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.554344 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077ba72-d05b-45b0-95fa-dc4ad7a1d520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.554974 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077ba72-d05b-45b0-95fa-dc4ad7a1d520 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.555251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077ba72-d05b-45b0-95fa-dc4ad7a1d520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.555523 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077ba72-d05b-45b0-95fa-dc4ad7a1d520 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.556229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077ba72-d05b-45b0-95fa-dc4ad7a1d520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.557829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077ba72-d05b-45b0-95fa-dc4ad7a1d520 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.558891 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c134d23-8b50-48ab-930b-2e05c055d72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.559588 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c134d23-8b50-48ab-930b-2e05c055d72b admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.559870 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c134d23-8b50-48ab-930b-2e05c055d72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.560145 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c134d23-8b50-48ab-930b-2e05c055d72b admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.560854 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c134d23-8b50-48ab-930b-2e05c055d72b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.562765 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c134d23-8b50-48ab-930b-2e05c055d72b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.570828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 787/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:49.570828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077ba72-d05b-45b0-95fa-dc4ad7a1d520 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.577994 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077ba72-d05b-45b0-95fa-dc4ad7a1d520 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.582947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 807/1594] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:05:49 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:49.583083 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779efce-1039-44fb-8949-5894e8673b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.583643 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c134d23-8b50-48ab-930b-2e05c055d72b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.583758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779efce-1039-44fb-8949-5894e8673b56 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.584059 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779efce-1039-44fb-8949-5894e8673b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.584337 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779efce-1039-44fb-8949-5894e8673b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.585620 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779efce-1039-44fb-8949-5894e8673b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.587426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779efce-1039-44fb-8949-5894e8673b56 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.595813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c134d23-8b50-48ab-930b-2e05c055d72b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.598410 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 788/1595] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:49.600671 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff954f6-5b51-4224-a68d-62439a4197d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.601568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff954f6-5b51-4224-a68d-62439a4197d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.601848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff954f6-5b51-4224-a68d-62439a4197d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.602125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff954f6-5b51-4224-a68d-62439a4197d6 admin admin] PATH_INFO: `/v3/projects/dcf9003906f544daa9b23ef545bdb173/users/0cfdd706a8be4f45b7cc2236b0fb741d/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.602597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e93e2f-60fd-4d29-b6a2-4c14f5fc3494 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.602916 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e93e2f-60fd-4d29-b6a2-4c14f5fc3494 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.603157 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e93e2f-60fd-4d29-b6a2-4c14f5fc3494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.617557 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff954f6-5b51-4224-a68d-62439a4197d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf9003906f544daa9b23ef545bdb173, user_id=0cfdd706a8be4f45b7cc2236b0fb741d, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.619538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a4e93e2f-60fd-4d29-b6a2-4c14f5fc3494 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:49.620387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff954f6-5b51-4224-a68d-62439a4197d6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.620744 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a4e93e2f-60fd-4d29-b6a2-4c14f5fc3494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:49.629239 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 789/1596] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:49.629982 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e93e2f-60fd-4d29-b6a2-4c14f5fc3494 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.644160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 808/1597] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:49 2022] PUT /identity/v3/projects/dcf9003906f544daa9b23ef545bdb173/users/0cfdd706a8be4f45b7cc2236b0fb741d/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:49.644160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff954f6-5b51-4224-a68d-62439a4197d6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.644447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e93e2f-60fd-4d29-b6a2-4c14f5fc3494 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.698524 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c7b9c-9341-4aca-b126-8affff6489ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.699193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c7b9c-9341-4aca-b126-8affff6489ff admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.699504 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c7b9c-9341-4aca-b126-8affff6489ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.699776 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c7b9c-9341-4aca-b126-8affff6489ff admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.700459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c7b9c-9341-4aca-b126-8affff6489ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.702425 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c7b9c-9341-4aca-b126-8affff6489ff admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.705289 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff954f6-5b51-4224-a68d-62439a4197d6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.710579 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c226d-1c9f-4590-aa49-aa1f9a7e26fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.711337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c226d-1c9f-4590-aa49-aa1f9a7e26fd admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.711614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c226d-1c9f-4590-aa49-aa1f9a7e26fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.711886 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c226d-1c9f-4590-aa49-aa1f9a7e26fd admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.712708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c226d-1c9f-4590-aa49-aa1f9a7e26fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.714633 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c226d-1c9f-4590-aa49-aa1f9a7e26fd admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.722043 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 790/1598] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:05:49 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:49.722644 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c7b9c-9341-4aca-b126-8affff6489ff admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.733065 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c7b9c-9341-4aca-b126-8affff6489ff admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.735537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 809/1599] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:05:49 2022] POST /identity/v3/users => generated 302 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:49.736308 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c226d-1c9f-4590-aa49-aa1f9a7e26fd admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.737834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed96f2-1d2e-4373-bc8d-ba0bdbc4c5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.738710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed96f2-1d2e-4373-bc8d-ba0bdbc4c5f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.738988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed96f2-1d2e-4373-bc8d-ba0bdbc4c5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.739264 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed96f2-1d2e-4373-bc8d-ba0bdbc4c5f8 admin admin] PATH_INFO: `/v3/projects/a6620801c7c94e5bb9b54033f23382a3/users/8e7fde9ae9c7483ca56d517e3d5a0f45/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.745787 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c226d-1c9f-4590-aa49-aa1f9a7e26fd admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.750272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef9a1f-4b53-4925-a794-37e196d7bced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.751128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef9a1f-4b53-4925-a794-37e196d7bced admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.751401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef9a1f-4b53-4925-a794-37e196d7bced admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.751673 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef9a1f-4b53-4925-a794-37e196d7bced admin admin] PATH_INFO: `/v3/projects/8b8cc2009b2445c99a680de8b6e2861c/users/00020ed4dff84fc699037b38fe7c8979/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.753972 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed96f2-1d2e-4373-bc8d-ba0bdbc4c5f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6620801c7c94e5bb9b54033f23382a3, user_id=8e7fde9ae9c7483ca56d517e3d5a0f45, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.757279 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed96f2-1d2e-4373-bc8d-ba0bdbc4c5f8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.768951 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef9a1f-4b53-4925-a794-37e196d7bced admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8cc2009b2445c99a680de8b6e2861c, user_id=00020ed4dff84fc699037b38fe7c8979, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.770666 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 791/1600] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:49 2022] PUT /identity/v3/projects/a6620801c7c94e5bb9b54033f23382a3/users/8e7fde9ae9c7483ca56d517e3d5a0f45/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:49.771646 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed96f2-1d2e-4373-bc8d-ba0bdbc4c5f8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.771767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef9a1f-4b53-4925-a794-37e196d7bced admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.787170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 810/1601] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:49 2022] PUT /identity/v3/projects/8b8cc2009b2445c99a680de8b6e2861c/users/00020ed4dff84fc699037b38fe7c8979/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:49.790937 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef9a1f-4b53-4925-a794-37e196d7bced admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.832999 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed96f2-1d2e-4373-bc8d-ba0bdbc4c5f8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.849702 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef9a1f-4b53-4925-a794-37e196d7bced admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.854621 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865a93e-abf6-4ffa-9e65-7afe5ae02a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.855278 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865a93e-abf6-4ffa-9e65-7afe5ae02a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.855558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865a93e-abf6-4ffa-9e65-7afe5ae02a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.855832 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865a93e-abf6-4ffa-9e65-7afe5ae02a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.856548 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865a93e-abf6-4ffa-9e65-7afe5ae02a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.858165 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865a93e-abf6-4ffa-9e65-7afe5ae02a52 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.867734 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 811/1602] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:49.867734 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865a93e-abf6-4ffa-9e65-7afe5ae02a52 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.887445 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa663a5-32c3-424b-b5d1-723c5f13a16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.888111 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa663a5-32c3-424b-b5d1-723c5f13a16b admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.888392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa663a5-32c3-424b-b5d1-723c5f13a16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.888669 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa663a5-32c3-424b-b5d1-723c5f13a16b admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.889422 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa663a5-32c3-424b-b5d1-723c5f13a16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.891016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa663a5-32c3-424b-b5d1-723c5f13a16b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.901097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 792/1603] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:49.903210 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49f4a-c65f-43ed-a9bf-4e8c841693df None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.903498 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49f4a-c65f-43ed-a9bf-4e8c841693df None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.903786 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49f4a-c65f-43ed-a9bf-4e8c841693df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.921683 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865a93e-abf6-4ffa-9e65-7afe5ae02a52 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.925520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce916a-d347-483c-ba25-8fdf248cb5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.926167 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce916a-d347-483c-ba25-8fdf248cb5fc service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.926442 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce916a-d347-483c-ba25-8fdf248cb5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.926712 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce916a-d347-483c-ba25-8fdf248cb5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.928988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c5b49f4a-c65f-43ed-a9bf-4e8c841693df None None] MFA Rules not processed for user `0cfdd706a8be4f45b7cc2236b0fb741d`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:49.930183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c5b49f4a-c65f-43ed-a9bf-4e8c841693df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:49.936024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce916a-d347-483c-ba25-8fdf248cb5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.937478 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce916a-d347-483c-ba25-8fdf248cb5fc service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.947662 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 812/1604] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:05:49.948441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce916a-d347-483c-ba25-8fdf248cb5fc service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.958485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce916a-d347-483c-ba25-8fdf248cb5fc service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.964569 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580a971-125e-41c9-98c9-7eeeea07abfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:49.965293 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580a971-125e-41c9-98c9-7eeeea07abfd admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:49.965579 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580a971-125e-41c9-98c9-7eeeea07abfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:49.965849 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580a971-125e-41c9-98c9-7eeeea07abfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:49.966570 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580a971-125e-41c9-98c9-7eeeea07abfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:49.968178 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580a971-125e-41c9-98c9-7eeeea07abfd admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:49.981828 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 813/1605] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:49.982803 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580a971-125e-41c9-98c9-7eeeea07abfd admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:49.997024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580a971-125e-41c9-98c9-7eeeea07abfd admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:49.999019 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 793/1606] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:50.000420 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d6d71-b54e-4245-923f-9ba0ffc54125 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.000709 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d6d71-b54e-4245-923f-9ba0ffc54125 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.001019 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d6d71-b54e-4245-923f-9ba0ffc54125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.008327 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b8d0a-eb93-4ca3-a5a8-a66558c8d560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:50.009302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b8d0a-eb93-4ca3-a5a8-a66558c8d560 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.009764 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b8d0a-eb93-4ca3-a5a8-a66558c8d560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.010044 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b8d0a-eb93-4ca3-a5a8-a66558c8d560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.010771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b8d0a-eb93-4ca3-a5a8-a66558c8d560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:50.012367 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b8d0a-eb93-4ca3-a5a8-a66558c8d560 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:50.023355 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 814/1607] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:50.024046 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b8d0a-eb93-4ca3-a5a8-a66558c8d560 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:50.030555 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7a9d6d71-b54e-4245-923f-9ba0ffc54125 None None] MFA Rules not processed for user `8e7fde9ae9c7483ca56d517e3d5a0f45`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:50.031600 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7a9d6d71-b54e-4245-923f-9ba0ffc54125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:50.034769 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b8d0a-eb93-4ca3-a5a8-a66558c8d560 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:50.040242 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fc52a-ba55-402d-bb5f-dbf9a2e14f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:50.040829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fc52a-ba55-402d-bb5f-dbf9a2e14f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.041117 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fc52a-ba55-402d-bb5f-dbf9a2e14f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.041391 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fc52a-ba55-402d-bb5f-dbf9a2e14f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.042110 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fc52a-ba55-402d-bb5f-dbf9a2e14f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:50.043703 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fc52a-ba55-402d-bb5f-dbf9a2e14f02 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:50.055110 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 815/1608] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:50.055729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fc52a-ba55-402d-bb5f-dbf9a2e14f02 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:50.065568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fc52a-ba55-402d-bb5f-dbf9a2e14f02 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:50.070698 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51772db-a42c-487f-9849-00a32e993464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:50.071580 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51772db-a42c-487f-9849-00a32e993464 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.071858 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51772db-a42c-487f-9849-00a32e993464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.072128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51772db-a42c-487f-9849-00a32e993464 admin admin] PATH_INFO: `/v3/projects/c93a5ee96bd24aebb1827039d46b2237/users/d6b028801e5c441cba20427865a85c1e/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.087621 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51772db-a42c-487f-9849-00a32e993464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93a5ee96bd24aebb1827039d46b2237, user_id=d6b028801e5c441cba20427865a85c1e, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:50.090408 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51772db-a42c-487f-9849-00a32e993464 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:50.099767 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 794/1609] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:50.105176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d6d71-b54e-4245-923f-9ba0ffc54125 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:50.108972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 816/1610] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:50 2022] PUT /identity/v3/projects/c93a5ee96bd24aebb1827039d46b2237/users/d6b028801e5c441cba20427865a85c1e/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:50.108972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51772db-a42c-487f-9849-00a32e993464 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:50.118413 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d6d71-b54e-4245-923f-9ba0ffc54125 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:50.184027 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87ba12-77c3-4a54-95b8-507ccc35a41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:50.185152 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87ba12-77c3-4a54-95b8-507ccc35a41b admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.185675 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87ba12-77c3-4a54-95b8-507ccc35a41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.186169 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87ba12-77c3-4a54-95b8-507ccc35a41b admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.187143 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87ba12-77c3-4a54-95b8-507ccc35a41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:50.189175 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87ba12-77c3-4a54-95b8-507ccc35a41b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:50.199159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51772db-a42c-487f-9849-00a32e993464 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:50.201028 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 795/1611] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:50.201996 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87ba12-77c3-4a54-95b8-507ccc35a41b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:50.206501 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb3d78-bdad-41c5-8c8d-05ed7f6ec265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:50.207169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb3d78-bdad-41c5-8c8d-05ed7f6ec265 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.207447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb3d78-bdad-41c5-8c8d-05ed7f6ec265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.207722 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb3d78-bdad-41c5-8c8d-05ed7f6ec265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.208449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb3d78-bdad-41c5-8c8d-05ed7f6ec265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:50.210118 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb3d78-bdad-41c5-8c8d-05ed7f6ec265 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:50.213114 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87ba12-77c3-4a54-95b8-507ccc35a41b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:50.219513 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be54bf-a918-427a-90f8-4fd4ac620e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:50.220170 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be54bf-a918-427a-90f8-4fd4ac620e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.220443 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be54bf-a918-427a-90f8-4fd4ac620e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.220972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 817/1612] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:50.221098 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be54bf-a918-427a-90f8-4fd4ac620e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.221432 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be54bf-a918-427a-90f8-4fd4ac620e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:50.223429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be54bf-a918-427a-90f8-4fd4ac620e70 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:50.224810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb3d78-bdad-41c5-8c8d-05ed7f6ec265 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:50.240062 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb3d78-bdad-41c5-8c8d-05ed7f6ec265 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:50.250147 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e5898-6093-4ff1-b5c8-21e59a37a45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:50.251290 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e5898-6093-4ff1-b5c8-21e59a37a45e admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.251796 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e5898-6093-4ff1-b5c8-21e59a37a45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.252559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e5898-6093-4ff1-b5c8-21e59a37a45e admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.253890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e5898-6093-4ff1-b5c8-21e59a37a45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:50.257504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e5898-6093-4ff1-b5c8-21e59a37a45e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:50.258786 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 796/1613] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:05:50 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:50.262797 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be54bf-a918-427a-90f8-4fd4ac620e70 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:50.281863 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 818/1614] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:50.282081 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9041d-adc8-4169-8216-4c57de7f145f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.282652 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9041d-adc8-4169-8216-4c57de7f145f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.283027 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9041d-adc8-4169-8216-4c57de7f145f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.313447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-16e9041d-adc8-4169-8216-4c57de7f145f None None] MFA Rules not processed for user `d6b028801e5c441cba20427865a85c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:50.315014 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-16e9041d-adc8-4169-8216-4c57de7f145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:50.336653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be54bf-a918-427a-90f8-4fd4ac620e70 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:50.342651 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ad711-c146-40ff-a76a-4af5818f5309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:50.343931 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ad711-c146-40ff-a76a-4af5818f5309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.344224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ad711-c146-40ff-a76a-4af5818f5309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.344490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ad711-c146-40ff-a76a-4af5818f5309 admin admin] PATH_INFO: `/v3/projects/8b8cc2009b2445c99a680de8b6e2861c/users/00020ed4dff84fc699037b38fe7c8979/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.346868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ad711-c146-40ff-a76a-4af5818f5309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8cc2009b2445c99a680de8b6e2861c, user_id=00020ed4dff84fc699037b38fe7c8979, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:50.351557 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ad711-c146-40ff-a76a-4af5818f5309 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:50.362909 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 797/1615] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:50 2022] PUT /identity/v3/projects/8b8cc2009b2445c99a680de8b6e2861c/users/00020ed4dff84fc699037b38fe7c8979/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:50.364068 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1184968-ba73-454f-bfaf-ae3ec1fc0366 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.364401 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1184968-ba73-454f-bfaf-ae3ec1fc0366 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.364629 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1184968-ba73-454f-bfaf-ae3ec1fc0366 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.367832 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 798/1616] 10.222.0.27 () {54 vars in 959 bytes} [Tue Sep 27 05:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:05:50.368544 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1184968-ba73-454f-bfaf-ae3ec1fc0366 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:50.413919 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 819/1617] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:50.415349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9041d-adc8-4169-8216-4c57de7f145f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:50.443221 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9041d-adc8-4169-8216-4c57de7f145f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:50.449629 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08411a39-6161-4414-84d8-cbe05e8cae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:50.450596 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08411a39-6161-4414-84d8-cbe05e8cae2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.450877 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08411a39-6161-4414-84d8-cbe05e8cae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.451156 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08411a39-6161-4414-84d8-cbe05e8cae2c admin admin] PATH_INFO: `/v3/projects/87b71717e9a341c285b3c63925612c77/users/86f1f7433c86479a88c84b9176bcbb3f/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.452319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1184968-ba73-454f-bfaf-ae3ec1fc0366 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:50.467258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32250fa-6fee-4590-bf2b-75e56e5cbb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:50.468164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32250fa-6fee-4590-bf2b-75e56e5cbb3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.468446 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32250fa-6fee-4590-bf2b-75e56e5cbb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.468722 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32250fa-6fee-4590-bf2b-75e56e5cbb3c admin admin] PATH_INFO: `/v3/projects/14088bcc2ded4aebb6e8c1f890d6fdec/users/6a6685057ae24345b4067cffb06b7f63/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.468933 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08411a39-6161-4414-84d8-cbe05e8cae2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b71717e9a341c285b3c63925612c77, user_id=86f1f7433c86479a88c84b9176bcbb3f, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:50.471646 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08411a39-6161-4414-84d8-cbe05e8cae2c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:50.486097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32250fa-6fee-4590-bf2b-75e56e5cbb3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=14088bcc2ded4aebb6e8c1f890d6fdec, user_id=6a6685057ae24345b4067cffb06b7f63, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:50.488912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 820/1618] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:50 2022] PUT /identity/v3/projects/87b71717e9a341c285b3c63925612c77/users/86f1f7433c86479a88c84b9176bcbb3f/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:50.488912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08411a39-6161-4414-84d8-cbe05e8cae2c admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:50.489148 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32250fa-6fee-4590-bf2b-75e56e5cbb3c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:50.504347 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 799/1619] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:50 2022] PUT /identity/v3/projects/14088bcc2ded4aebb6e8c1f890d6fdec/users/6a6685057ae24345b4067cffb06b7f63/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:50.505340 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32250fa-6fee-4590-bf2b-75e56e5cbb3c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:50.568632 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08411a39-6161-4414-84d8-cbe05e8cae2c admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:50.583062 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32250fa-6fee-4590-bf2b-75e56e5cbb3c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:50.588531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ad761-181e-4ea7-85fc-d7b409003062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:50.589113 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ad761-181e-4ea7-85fc-d7b409003062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.589397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ad761-181e-4ea7-85fc-d7b409003062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.589674 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ad761-181e-4ea7-85fc-d7b409003062 admin admin] PATH_INFO: `/v3/projects/975400281ea34db0aa36b1d5dc45522f/users/5cfd3811527a48aba4bd6228a9eda91d/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.607720 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ad761-181e-4ea7-85fc-d7b409003062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=975400281ea34db0aa36b1d5dc45522f, user_id=5cfd3811527a48aba4bd6228a9eda91d, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:50.610608 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ad761-181e-4ea7-85fc-d7b409003062 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:50.625261 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 800/1620] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:50 2022] PUT /identity/v3/projects/975400281ea34db0aa36b1d5dc45522f/users/5cfd3811527a48aba4bd6228a9eda91d/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:50.626862 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d0816-5aef-47f0-b13e-8abbaf129c58 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.627827 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d0816-5aef-47f0-b13e-8abbaf129c58 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.628332 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d0816-5aef-47f0-b13e-8abbaf129c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.633834 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57dfeaf-bf59-48dc-8bc1-63a034109dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:50.634638 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dfeaf-bf59-48dc-8bc1-63a034109dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.635100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dfeaf-bf59-48dc-8bc1-63a034109dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.635379 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dfeaf-bf59-48dc-8bc1-63a034109dc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.636986 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57dfeaf-bf59-48dc-8bc1-63a034109dc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:50.638991 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57dfeaf-bf59-48dc-8bc1-63a034109dc5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:50.656380 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-725d0816-5aef-47f0-b13e-8abbaf129c58 None None] MFA Rules not processed for user `00020ed4dff84fc699037b38fe7c8979`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:50.657910 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-725d0816-5aef-47f0-b13e-8abbaf129c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:50.662139 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 821/1621] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:05:50 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:50.664010 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d79692-37e6-4593-8c09-b2e2d50fe81e None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.664297 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d79692-37e6-4593-8c09-b2e2d50fe81e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.664576 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d79692-37e6-4593-8c09-b2e2d50fe81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.683772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a4d79692-37e6-4593-8c09-b2e2d50fe81e None None] MFA Rules not processed for user `faac84ed9d37420c811bbf6ac7df0b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:50.685617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a4d79692-37e6-4593-8c09-b2e2d50fe81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:50.732326 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 801/1622] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:50.733713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee2514-af5a-4d7d-afed-94bc23cd0440 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.734004 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee2514-af5a-4d7d-afed-94bc23cd0440 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.734285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee2514-af5a-4d7d-afed-94bc23cd0440 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.736449 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 802/1623] 10.222.0.27 () {54 vars in 959 bytes} [Tue Sep 27 05:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:05:50.748279 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6f54e-79ee-4060-a66b-f445043ef3bd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.748575 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6f54e-79ee-4060-a66b-f445043ef3bd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.748878 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6f54e-79ee-4060-a66b-f445043ef3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.771925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 822/1624] 10.222.0.27 () {58 vars in 1056 bytes} [Tue Sep 27 05:05:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:50.772094 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-bea6f54e-79ee-4060-a66b-f445043ef3bd None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:50.773291 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bea6f54e-79ee-4060-a66b-f445043ef3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:50.780435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d68a0-5248-4464-b460-c82690be635c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.780726 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d68a0-5248-4464-b460-c82690be635c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.781026 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d68a0-5248-4464-b460-c82690be635c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.801304 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d53d68a0-5248-4464-b460-c82690be635c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:50.802599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d53d68a0-5248-4464-b460-c82690be635c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:50.844846 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 803/1625] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:50.846381 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8dd23-0976-496b-a0d7-0ffb43519ac7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.846974 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8dd23-0976-496b-a0d7-0ffb43519ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.847351 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8dd23-0976-496b-a0d7-0ffb43519ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.873725 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 823/1626] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:50.874414 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b3d8dd23-0976-496b-a0d7-0ffb43519ac7 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:50.874648 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d68a0-5248-4464-b460-c82690be635c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:50.876006 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b3d8dd23-0976-496b-a0d7-0ffb43519ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:50.884640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d68a0-5248-4464-b460-c82690be635c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:50.886333 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 804/1627] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:50.887622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c5222-6bf9-48df-ad8e-d69377e99e01 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.887913 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c5222-6bf9-48df-ad8e-d69377e99e01 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.888196 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c5222-6bf9-48df-ad8e-d69377e99e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.894211 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94ed07-cf74-4400-8b80-16c8871d4ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:50.895049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94ed07-cf74-4400-8b80-16c8871d4ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.895228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94ed07-cf74-4400-8b80-16c8871d4ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.895454 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94ed07-cf74-4400-8b80-16c8871d4ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.896183 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94ed07-cf74-4400-8b80-16c8871d4ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:50.898851 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94ed07-cf74-4400-8b80-16c8871d4ddf admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:50.913600 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 824/1628] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:50.913947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-dc3c5222-6bf9-48df-ad8e-d69377e99e01 None None] MFA Rules not processed for user `faac84ed9d37420c811bbf6ac7df0b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:50.914505 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94ed07-cf74-4400-8b80-16c8871d4ddf admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:50.915100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-dc3c5222-6bf9-48df-ad8e-d69377e99e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:50.926336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 805/1629] 10.222.0.27 () {58 vars in 1056 bytes} [Tue Sep 27 05:05:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:50.927172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c5222-6bf9-48df-ad8e-d69377e99e01 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:50.939243 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c5222-6bf9-48df-ad8e-d69377e99e01 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:50.946936 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cb4d7-8dbd-459f-8a6e-9268b0816ed8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:50.947624 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cb4d7-8dbd-459f-8a6e-9268b0816ed8 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.947884 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cb4d7-8dbd-459f-8a6e-9268b0816ed8 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.948285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cb4d7-8dbd-459f-8a6e-9268b0816ed8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:50.985820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94ed07-cf74-4400-8b80-16c8871d4ddf admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:50.991256 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7232260-6410-4f4f-8557-0500bbbdf092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:50.992193 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7232260-6410-4f4f-8557-0500bbbdf092 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:50.992872 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7232260-6410-4f4f-8557-0500bbbdf092 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:50.992872 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7232260-6410-4f4f-8557-0500bbbdf092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:51.002985 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7232260-6410-4f4f-8557-0500bbbdf092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:51.004457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7232260-6410-4f4f-8557-0500bbbdf092 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:51.016072 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 825/1630] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:05:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:05:51.016949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7232260-6410-4f4f-8557-0500bbbdf092 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:51.024229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590cb4d7-8dbd-459f-8a6e-9268b0816ed8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:51.025817 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590cb4d7-8dbd-459f-8a6e-9268b0816ed8 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:51.047097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 806/1631] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:05:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:05:51.048058 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cb4d7-8dbd-459f-8a6e-9268b0816ed8 service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:51.099560 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7232260-6410-4f4f-8557-0500bbbdf092 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:51.108782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de5f43-82a6-4a25-856c-fa8c224a2555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:51.109467 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de5f43-82a6-4a25-856c-fa8c224a2555 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:51.109750 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de5f43-82a6-4a25-856c-fa8c224a2555 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:51.110026 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de5f43-82a6-4a25-856c-fa8c224a2555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:51.129928 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de5f43-82a6-4a25-856c-fa8c224a2555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:51.132132 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de5f43-82a6-4a25-856c-fa8c224a2555 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:51.165036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 826/1632] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:05:51.166008 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de5f43-82a6-4a25-856c-fa8c224a2555 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:51.175632 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cb4d7-8dbd-459f-8a6e-9268b0816ed8 service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:51.188872 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497ac48-1cec-4918-b8e1-62494c763316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:51.189544 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497ac48-1cec-4918-b8e1-62494c763316 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:51.189830 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497ac48-1cec-4918-b8e1-62494c763316 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:51.190107 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497ac48-1cec-4918-b8e1-62494c763316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:51.192419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de5f43-82a6-4a25-856c-fa8c224a2555 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:51.208752 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f6063-e3af-40db-ab9f-a3243851d02f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:51.209479 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f6063-e3af-40db-ab9f-a3243851d02f service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:51.209770 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f6063-e3af-40db-ab9f-a3243851d02f service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:51.210049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f6063-e3af-40db-ab9f-a3243851d02f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:51.225497 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497ac48-1cec-4918-b8e1-62494c763316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:51.230924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497ac48-1cec-4918-b8e1-62494c763316 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:51.245700 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f6063-e3af-40db-ab9f-a3243851d02f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:51.247176 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f6063-e3af-40db-ab9f-a3243851d02f service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:51.263206 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 807/1633] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:05:51.263906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497ac48-1cec-4918-b8e1-62494c763316 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:51.281634 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 827/1634] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:05:51.282771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f6063-e3af-40db-ab9f-a3243851d02f service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:51.288171 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497ac48-1cec-4918-b8e1-62494c763316 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:51.306009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d267a31-8034-497d-9b17-44adb557bc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:51.314936 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d267a31-8034-497d-9b17-44adb557bc33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:51.315183 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f6063-e3af-40db-ab9f-a3243851d02f service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:51.315299 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d267a31-8034-497d-9b17-44adb557bc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:51.315299 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d267a31-8034-497d-9b17-44adb557bc33 admin admin] PATH_INFO: `/v3/projects/1699356743c846c48e12bb0c6422b9b1/users/97270d059ae74c4b81aaca4f4378557a/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:51.327226 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769beeaa-f258-425c-a45b-aa5d7ee39470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:51.327886 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769beeaa-f258-425c-a45b-aa5d7ee39470 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:51.328159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769beeaa-f258-425c-a45b-aa5d7ee39470 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:51.328435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769beeaa-f258-425c-a45b-aa5d7ee39470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:51.336052 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d267a31-8034-497d-9b17-44adb557bc33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1699356743c846c48e12bb0c6422b9b1, user_id=97270d059ae74c4b81aaca4f4378557a, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:51.342608 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d267a31-8034-497d-9b17-44adb557bc33 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:51.374522 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 808/1635] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:51 2022] PUT /identity/v3/projects/1699356743c846c48e12bb0c6422b9b1/users/97270d059ae74c4b81aaca4f4378557a/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:51.379081 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d267a31-8034-497d-9b17-44adb557bc33 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:51.439555 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769beeaa-f258-425c-a45b-aa5d7ee39470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:51.442855 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769beeaa-f258-425c-a45b-aa5d7ee39470 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:51.471657 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 828/1636] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:05:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:05:51.474534 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769beeaa-f258-425c-a45b-aa5d7ee39470 service nova] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:51.502523 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769beeaa-f258-425c-a45b-aa5d7ee39470 service nova] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:51.525354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d267a31-8034-497d-9b17-44adb557bc33 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:51.541511 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee3c6f-755c-45cb-a590-609a815c12dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:51.542591 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee3c6f-755c-45cb-a590-609a815c12dd admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:51.542591 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee3c6f-755c-45cb-a590-609a815c12dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:51.542833 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee3c6f-755c-45cb-a590-609a815c12dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:51.543446 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee3c6f-755c-45cb-a590-609a815c12dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:51.545512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee3c6f-755c-45cb-a590-609a815c12dd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:51.579089 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 809/1637] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:51.579640 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622f063-a3f6-4b8c-8352-b8d8c9700beb None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:51.579927 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622f063-a3f6-4b8c-8352-b8d8c9700beb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:51.580203 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622f063-a3f6-4b8c-8352-b8d8c9700beb None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:51.582397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 810/1638] 10.222.0.27 () {54 vars in 912 bytes} [Tue Sep 27 05:05:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:05:51.583096 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622f063-a3f6-4b8c-8352-b8d8c9700beb None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:51.606145 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317e4ad-0950-4f30-8509-339c3a709b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:51.607301 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317e4ad-0950-4f30-8509-339c3a709b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:51.607632 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317e4ad-0950-4f30-8509-339c3a709b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:51.607911 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317e4ad-0950-4f30-8509-339c3a709b9b admin admin] PATH_INFO: `/v3/users/03ea0927cd3f49759cdc2d8643af9548` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:51.609231 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317e4ad-0950-4f30-8509-339c3a709b9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=03ea0927cd3f49759cdc2d8643af9548)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:51.611329 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317e4ad-0950-4f30-8509-339c3a709b9b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:51.613122 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622f063-a3f6-4b8c-8352-b8d8c9700beb None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:51.625491 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afacb9-6a8d-40cf-ab61-0ef9816d11a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:51.626614 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afacb9-6a8d-40cf-ab61-0ef9816d11a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:51.627532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afacb9-6a8d-40cf-ab61-0ef9816d11a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:51.627989 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afacb9-6a8d-40cf-ab61-0ef9816d11a7 admin admin] PATH_INFO: `/v3/projects/1699356743c846c48e12bb0c6422b9b1/users/97270d059ae74c4b81aaca4f4378557a/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:51.630707 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afacb9-6a8d-40cf-ab61-0ef9816d11a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1699356743c846c48e12bb0c6422b9b1, user_id=97270d059ae74c4b81aaca4f4378557a, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:51.634546 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afacb9-6a8d-40cf-ab61-0ef9816d11a7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:51.674151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 811/1639] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:51 2022] PUT /identity/v3/projects/1699356743c846c48e12bb0c6422b9b1/users/97270d059ae74c4b81aaca4f4378557a/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:51.676258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5945fb-3644-4a3a-8769-35d84f6ed626 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:51.676258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5945fb-3644-4a3a-8769-35d84f6ed626 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:51.676258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5945fb-3644-4a3a-8769-35d84f6ed626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:51.688330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d317e4ad-0950-4f30-8509-339c3a709b9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03ea0927cd3f49759cdc2d8643af9548'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:51.691797 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d317e4ad-0950-4f30-8509-339c3a709b9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03ea0927cd3f49759cdc2d8643af9548'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:51.693374 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d317e4ad-0950-4f30-8509-339c3a709b9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03ea0927cd3f49759cdc2d8643af9548'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:51.713299 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d317e4ad-0950-4f30-8509-339c3a709b9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03ea0927cd3f49759cdc2d8643af9548'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:51.720992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ac5945fb-3644-4a3a-8769-35d84f6ed626 None None] MFA Rules not processed for user `faac84ed9d37420c811bbf6ac7df0b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:51.722333 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ac5945fb-3644-4a3a-8769-35d84f6ed626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:51.733415 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d317e4ad-0950-4f30-8509-339c3a709b9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03ea0927cd3f49759cdc2d8643af9548'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:51.763701 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 829/1640] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:05:51 2022] DELETE /identity/v3/users/03ea0927cd3f49759cdc2d8643af9548 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:51.765215 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f49131-3b00-4757-b9df-0f27444819c8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:51.765502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f49131-3b00-4757-b9df-0f27444819c8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:51.765778 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f49131-3b00-4757-b9df-0f27444819c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:51.839878 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-85f49131-3b00-4757-b9df-0f27444819c8 None None] MFA Rules not processed for user `97270d059ae74c4b81aaca4f4378557a`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:51.842743 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-85f49131-3b00-4757-b9df-0f27444819c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:51.846739 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 812/1641] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 27 05:05:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:51.848478 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b94d-1a24-46c3-b1cc-a36602550ee1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:51.848770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b94d-1a24-46c3-b1cc-a36602550ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:51.849077 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b94d-1a24-46c3-b1cc-a36602550ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:51.897599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2654b94d-1a24-46c3-b1cc-a36602550ee1 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:51.899017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2654b94d-1a24-46c3-b1cc-a36602550ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:52.010389 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 830/1642] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:52.017365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af0e34-a567-4e56-8e46-81e5e06ad816 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:52.017755 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af0e34-a567-4e56-8e46-81e5e06ad816 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:52.018139 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af0e34-a567-4e56-8e46-81e5e06ad816 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:52.020584 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 831/1643] 10.222.0.27 () {54 vars in 912 bytes} [Tue Sep 27 05:05:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:05:52.021512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af0e34-a567-4e56-8e46-81e5e06ad816 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:52.024303 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-17af0e34-a567-4e56-8e46-81e5e06ad816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:52.030453 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 813/1644] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:52.031446 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654b94d-1a24-46c3-b1cc-a36602550ee1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:52.039958 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2654b94d-1a24-46c3-b1cc-a36602550ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:52.118191 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af0e34-a567-4e56-8e46-81e5e06ad816 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:52.123606 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baaf5e-0d29-45ca-a06c-b0737f7c8fe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:52.124456 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baaf5e-0d29-45ca-a06c-b0737f7c8fe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:52.124945 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baaf5e-0d29-45ca-a06c-b0737f7c8fe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:52.125550 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baaf5e-0d29-45ca-a06c-b0737f7c8fe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:52.126016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654b94d-1a24-46c3-b1cc-a36602550ee1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:52.134473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024490a7-fd64-4f33-a45f-970512f42144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:52.136646 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024490a7-fd64-4f33-a45f-970512f42144 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:52.137127 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024490a7-fd64-4f33-a45f-970512f42144 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:52.137554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024490a7-fd64-4f33-a45f-970512f42144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:52.162500 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024490a7-fd64-4f33-a45f-970512f42144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:52.165032 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024490a7-fd64-4f33-a45f-970512f42144 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:52.191966 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 814/1645] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:05:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:05:52.193612 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500903e-0a32-4b16-aff3-d7e173f1ee35 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:52.198737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500903e-0a32-4b16-aff3-d7e173f1ee35 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:52.199040 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500903e-0a32-4b16-aff3-d7e173f1ee35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:52.248970 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4500903e-0a32-4b16-aff3-d7e173f1ee35 None None] MFA Rules not processed for user `faac84ed9d37420c811bbf6ac7df0b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:52.255251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4500903e-0a32-4b16-aff3-d7e173f1ee35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:52.357362 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49baaf5e-0d29-45ca-a06c-b0737f7c8fe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:52.360478 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49baaf5e-0d29-45ca-a06c-b0737f7c8fe2 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:52.389242 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 832/1646] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:05:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:05:52.407783 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baaf5e-0d29-45ca-a06c-b0737f7c8fe2 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:52.414246 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-49baaf5e-0d29-45ca-a06c-b0737f7c8fe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:52.455840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 815/1647] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 27 05:05:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:52.456863 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500903e-0a32-4b16-aff3-d7e173f1ee35 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:52.476948 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500903e-0a32-4b16-aff3-d7e173f1ee35 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:52.488619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422473a2-7092-4b14-952e-57ff45c8124f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:52.489363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422473a2-7092-4b14-952e-57ff45c8124f service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:52.489652 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422473a2-7092-4b14-952e-57ff45c8124f service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:52.490012 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422473a2-7092-4b14-952e-57ff45c8124f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:52.495325 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-422473a2-7092-4b14-952e-57ff45c8124f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:52.563809 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baaf5e-0d29-45ca-a06c-b0737f7c8fe2 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:52.574415 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e59e14-8d3a-43fc-a972-4d39fc7ec670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:52.575085 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e59e14-8d3a-43fc-a972-4d39fc7ec670 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:52.575367 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e59e14-8d3a-43fc-a972-4d39fc7ec670 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:52.575640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e59e14-8d3a-43fc-a972-4d39fc7ec670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:52.597726 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e59e14-8d3a-43fc-a972-4d39fc7ec670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:52.601018 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e59e14-8d3a-43fc-a972-4d39fc7ec670 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:52.621755 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 833/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:05:52.622589 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422473a2-7092-4b14-952e-57ff45c8124f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:52.624112 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422473a2-7092-4b14-952e-57ff45c8124f service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:52.635313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 816/1649] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:05:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:05:52.962686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e59e14-8d3a-43fc-a972-4d39fc7ec670 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:52.993649 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e59e14-8d3a-43fc-a972-4d39fc7ec670 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:52.998913 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0901da-221d-4bf9-9a44-a67d63e300fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:52.999843 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0901da-221d-4bf9-9a44-a67d63e300fe service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:53.000542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0901da-221d-4bf9-9a44-a67d63e300fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:53.001069 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0901da-221d-4bf9-9a44-a67d63e300fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:53.015340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0901da-221d-4bf9-9a44-a67d63e300fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:53.016924 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0901da-221d-4bf9-9a44-a67d63e300fe service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:53.043379 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 834/1650] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:05:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:05:53.934029 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff9c55-0b3a-43b7-b303-b422ba418064 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:53.934573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff9c55-0b3a-43b7-b303-b422ba418064 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:53.934748 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff9c55-0b3a-43b7-b303-b422ba418064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:53.968028 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-bdff9c55-0b3a-43b7-b303-b422ba418064 None None] MFA Rules not processed for user `5cfd3811527a48aba4bd6228a9eda91d`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:53.969274 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bdff9c55-0b3a-43b7-b303-b422ba418064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:53.990304 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0901da-221d-4bf9-9a44-a67d63e300fe service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:53.992526 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0e0901da-221d-4bf9-9a44-a67d63e300fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:54.023227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0901da-221d-4bf9-9a44-a67d63e300fe service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:54.034669 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc32652-1e34-4899-ac3d-e4811425c927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:54.036214 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc32652-1e34-4899-ac3d-e4811425c927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:54.037227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc32652-1e34-4899-ac3d-e4811425c927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:54.037753 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc32652-1e34-4899-ac3d-e4811425c927 admin admin] PATH_INFO: `/v3/projects/f2f1fc523ce54f76a6c418d32af91a2d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:54.040156 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc32652-1e34-4899-ac3d-e4811425c927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f1fc523ce54f76a6c418d32af91a2d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:54.041474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: WARNING py.warnings [None req-5cc32652-1e34-4899-ac3d-e4811425c927 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 05:05:54.041474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: warnings.warn(msg) Sep 27 05:05:54.041474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: Sep 27 05:05:54.043062 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc32652-1e34-4899-ac3d-e4811425c927 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:54.130233 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 817/1651] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:54.135191 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff9c55-0b3a-43b7-b303-b422ba418064 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:54.138813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bdff9c55-0b3a-43b7-b303-b422ba418064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:54.191164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff9c55-0b3a-43b7-b303-b422ba418064 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:54.195820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5cc32652-1e34-4899-ac3d-e4811425c927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f1fc523ce54f76a6c418d32af91a2d', 'request_id': 'req-5cc32652-1e34-4899-ac3d-e4811425c927'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:54.255585 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5cc32652-1e34-4899-ac3d-e4811425c927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f1fc523ce54f76a6c418d32af91a2d', 'request_id': 'req-5cc32652-1e34-4899-ac3d-e4811425c927'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:54.268777 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5cc32652-1e34-4899-ac3d-e4811425c927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f1fc523ce54f76a6c418d32af91a2d', 'request_id': 'req-5cc32652-1e34-4899-ac3d-e4811425c927'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:54.289215 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5cc32652-1e34-4899-ac3d-e4811425c927 admin admin] The token cache is being invalidate because project f2f1fc523ce54f76a6c418d32af91a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:05:54.289526 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5cc32652-1e34-4899-ac3d-e4811425c927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:54.291498 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5cc32652-1e34-4899-ac3d-e4811425c927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:54.295748 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 835/1652] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:05:53 2022] DELETE /identity/v3/projects/f2f1fc523ce54f76a6c418d32af91a2d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:05:54.300209 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc32652-1e34-4899-ac3d-e4811425c927 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:54.305723 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5cc32652-1e34-4899-ac3d-e4811425c927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:54.360463 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9810d2-b0dd-462e-9251-fe66366eea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:54.360463 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9810d2-b0dd-462e-9251-fe66366eea89 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:54.361021 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9810d2-b0dd-462e-9251-fe66366eea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:54.361553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9810d2-b0dd-462e-9251-fe66366eea89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:54.362661 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9810d2-b0dd-462e-9251-fe66366eea89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:54.366826 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9810d2-b0dd-462e-9251-fe66366eea89 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:54.421081 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc32652-1e34-4899-ac3d-e4811425c927 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:54.429532 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cebb6-bf6c-4d78-ac26-fce24ba356a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:54.430713 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cebb6-bf6c-4d78-ac26-fce24ba356a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:54.432302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cebb6-bf6c-4d78-ac26-fce24ba356a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:54.432670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cebb6-bf6c-4d78-ac26-fce24ba356a1 admin admin] PATH_INFO: `/v3/users/00020ed4dff84fc699037b38fe7c8979` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:54.441899 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cebb6-bf6c-4d78-ac26-fce24ba356a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00020ed4dff84fc699037b38fe7c8979)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:54.447255 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cebb6-bf6c-4d78-ac26-fce24ba356a1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:54.454952 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 818/1653] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:05:54 2022] POST /identity/v3/projects => generated 403 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:54.458003 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9810d2-b0dd-462e-9251-fe66366eea89 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:54.463736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ef9810d2-b0dd-462e-9251-fe66366eea89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:54.558530 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e02cebb6-bf6c-4d78-ac26-fce24ba356a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00020ed4dff84fc699037b38fe7c8979'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:54.560276 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e02cebb6-bf6c-4d78-ac26-fce24ba356a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00020ed4dff84fc699037b38fe7c8979'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:54.560954 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e02cebb6-bf6c-4d78-ac26-fce24ba356a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00020ed4dff84fc699037b38fe7c8979'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:54.580678 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e02cebb6-bf6c-4d78-ac26-fce24ba356a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00020ed4dff84fc699037b38fe7c8979'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:54.602130 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e02cebb6-bf6c-4d78-ac26-fce24ba356a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00020ed4dff84fc699037b38fe7c8979'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:54.615735 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9810d2-b0dd-462e-9251-fe66366eea89 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:54.621536 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cfc46-327d-48dd-8607-86f4554ef9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:54.622342 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cfc46-327d-48dd-8607-86f4554ef9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:54.622726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cfc46-327d-48dd-8607-86f4554ef9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:54.623107 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cfc46-327d-48dd-8607-86f4554ef9a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:54.625727 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cfc46-327d-48dd-8607-86f4554ef9a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:54.628087 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 836/1654] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:05:54 2022] DELETE /identity/v3/users/00020ed4dff84fc699037b38fe7c8979 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:54.633862 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cfc46-327d-48dd-8607-86f4554ef9a6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:54.672730 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 819/1655] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:05:54 2022] POST /identity/v3/users => generated 308 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:54.677287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cebb6-bf6c-4d78-ac26-fce24ba356a1 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:54.679633 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e02cebb6-bf6c-4d78-ac26-fce24ba356a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:54.896302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cebb6-bf6c-4d78-ac26-fce24ba356a1 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:54.922095 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ef066-d690-4988-97b8-8d3f47729e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:54.922807 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ef066-d690-4988-97b8-8d3f47729e08 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:54.923273 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ef066-d690-4988-97b8-8d3f47729e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:54.925949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ef066-d690-4988-97b8-8d3f47729e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:54.927082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ef066-d690-4988-97b8-8d3f47729e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:54.934324 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ef066-d690-4988-97b8-8d3f47729e08 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:54.982983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 837/1656] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:54.986917 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cfc46-327d-48dd-8607-86f4554ef9a6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:55.013226 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cfc46-327d-48dd-8607-86f4554ef9a6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:55.046417 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6357f8f-884f-42d3-9350-0c73d99ba00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:55.072938 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6357f8f-884f-42d3-9350-0c73d99ba00c admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:55.082238 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6357f8f-884f-42d3-9350-0c73d99ba00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:55.085360 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6357f8f-884f-42d3-9350-0c73d99ba00c admin admin] PATH_INFO: `/v3/projects/75a914285c094ae0b2611a3967b7c597/users/661617a587384f2ab360f9a278e61baf/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:55.138812 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6357f8f-884f-42d3-9350-0c73d99ba00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a914285c094ae0b2611a3967b7c597, user_id=661617a587384f2ab360f9a278e61baf, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:55.142485 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6357f8f-884f-42d3-9350-0c73d99ba00c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:55.179704 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 820/1657] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:54 2022] PUT /identity/v3/projects/75a914285c094ae0b2611a3967b7c597/users/661617a587384f2ab360f9a278e61baf/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:55.184939 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ef066-d690-4988-97b8-8d3f47729e08 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:55.222952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ef066-d690-4988-97b8-8d3f47729e08 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:55.455835 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249185f1-499d-45ca-9268-6d13a167683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:55.456868 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249185f1-499d-45ca-9268-6d13a167683b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:55.457314 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249185f1-499d-45ca-9268-6d13a167683b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:55.457734 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249185f1-499d-45ca-9268-6d13a167683b admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:55.458630 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249185f1-499d-45ca-9268-6d13a167683b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:55.461631 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249185f1-499d-45ca-9268-6d13a167683b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:55.473913 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 838/1658] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:55.478314 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6357f8f-884f-42d3-9350-0c73d99ba00c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:55.491906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6357f8f-884f-42d3-9350-0c73d99ba00c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:55.497631 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576dec6-6ae9-41e4-be86-d8aa2a6423a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:55.498889 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576dec6-6ae9-41e4-be86-d8aa2a6423a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:55.499424 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576dec6-6ae9-41e4-be86-d8aa2a6423a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:55.499860 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576dec6-6ae9-41e4-be86-d8aa2a6423a5 admin admin] PATH_INFO: `/v3/projects/75a914285c094ae0b2611a3967b7c597/users/661617a587384f2ab360f9a278e61baf/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:55.504617 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576dec6-6ae9-41e4-be86-d8aa2a6423a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a914285c094ae0b2611a3967b7c597, user_id=661617a587384f2ab360f9a278e61baf, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:55.517355 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576dec6-6ae9-41e4-be86-d8aa2a6423a5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:55.551441 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 821/1659] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:55 2022] PUT /identity/v3/projects/75a914285c094ae0b2611a3967b7c597/users/661617a587384f2ab360f9a278e61baf/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:56.007056 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249185f1-499d-45ca-9268-6d13a167683b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:56.009441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-249185f1-499d-45ca-9268-6d13a167683b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:56.032516 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249185f1-499d-45ca-9268-6d13a167683b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:56.152900 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da21bd-2a70-4fcc-9e1c-0115966c6b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:56.153958 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da21bd-2a70-4fcc-9e1c-0115966c6b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:56.155007 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da21bd-2a70-4fcc-9e1c-0115966c6b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:56.155450 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da21bd-2a70-4fcc-9e1c-0115966c6b6b admin admin] PATH_INFO: `/v3/projects/8b8cc2009b2445c99a680de8b6e2861c` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:56.157720 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da21bd-2a70-4fcc-9e1c-0115966c6b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8cc2009b2445c99a680de8b6e2861c)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:56.163666 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da21bd-2a70-4fcc-9e1c-0115966c6b6b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:56.293635 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f9da21bd-2a70-4fcc-9e1c-0115966c6b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8cc2009b2445c99a680de8b6e2861c', 'request_id': 'req-f9da21bd-2a70-4fcc-9e1c-0115966c6b6b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:56.300347 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f9da21bd-2a70-4fcc-9e1c-0115966c6b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8cc2009b2445c99a680de8b6e2861c', 'request_id': 'req-f9da21bd-2a70-4fcc-9e1c-0115966c6b6b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:56.312095 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f9da21bd-2a70-4fcc-9e1c-0115966c6b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8cc2009b2445c99a680de8b6e2861c', 'request_id': 'req-f9da21bd-2a70-4fcc-9e1c-0115966c6b6b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:56.336260 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f9da21bd-2a70-4fcc-9e1c-0115966c6b6b admin admin] The token cache is being invalidate because project 8b8cc2009b2445c99a680de8b6e2861c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:05:56.337597 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f9da21bd-2a70-4fcc-9e1c-0115966c6b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:56.338695 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f9da21bd-2a70-4fcc-9e1c-0115966c6b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:56.341968 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 839/1660] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:05:56 2022] DELETE /identity/v3/projects/8b8cc2009b2445c99a680de8b6e2861c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:56.346575 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b5e37-d06c-42ca-a8e3-98df3c892df2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:56.347393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b5e37-d06c-42ca-a8e3-98df3c892df2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:56.347821 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b5e37-d06c-42ca-a8e3-98df3c892df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:56.382875 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4f4b5e37-d06c-42ca-a8e3-98df3c892df2 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:56.383965 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4f4b5e37-d06c-42ca-a8e3-98df3c892df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:56.519682 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 822/1661] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:56.521622 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c01739-6ddd-445d-be7d-694ab758a13a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:56.522117 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c01739-6ddd-445d-be7d-694ab758a13a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:56.522524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c01739-6ddd-445d-be7d-694ab758a13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:56.556079 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-95c01739-6ddd-445d-be7d-694ab758a13a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:56.557566 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-95c01739-6ddd-445d-be7d-694ab758a13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:56.571172 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 840/1662] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:56.572274 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b5e37-d06c-42ca-a8e3-98df3c892df2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:56.590215 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b5e37-d06c-42ca-a8e3-98df3c892df2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:56.601074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23c1c1-582d-4dd9-9d1e-f79a1b0a0ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:56.601802 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23c1c1-582d-4dd9-9d1e-f79a1b0a0ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:56.602285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23c1c1-582d-4dd9-9d1e-f79a1b0a0ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:56.602771 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23c1c1-582d-4dd9-9d1e-f79a1b0a0ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:56.603766 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23c1c1-582d-4dd9-9d1e-f79a1b0a0ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:05:56.604324 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23c1c1-582d-4dd9-9d1e-f79a1b0a0ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:56.610566 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23c1c1-582d-4dd9-9d1e-f79a1b0a0ac2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:56.627794 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c01739-6ddd-445d-be7d-694ab758a13a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:56.630434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-95c01739-6ddd-445d-be7d-694ab758a13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:56.636333 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 823/1663] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:05:56.637775 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23c1c1-582d-4dd9-9d1e-f79a1b0a0ac2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:56.648828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23c1c1-582d-4dd9-9d1e-f79a1b0a0ac2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:56.654935 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1218dd-32f3-4b31-a6e0-966e8367a5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:56.656057 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1218dd-32f3-4b31-a6e0-966e8367a5ee admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:56.656649 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1218dd-32f3-4b31-a6e0-966e8367a5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:56.657292 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1218dd-32f3-4b31-a6e0-966e8367a5ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:56.658203 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1218dd-32f3-4b31-a6e0-966e8367a5ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:56.658374 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c01739-6ddd-445d-be7d-694ab758a13a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:56.660697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1218dd-32f3-4b31-a6e0-966e8367a5ee admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:56.680902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f0b09-43d7-44f5-b0d2-b7b998c5085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:56.682782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f0b09-43d7-44f5-b0d2-b7b998c5085f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:56.683649 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f0b09-43d7-44f5-b0d2-b7b998c5085f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:56.684257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f0b09-43d7-44f5-b0d2-b7b998c5085f admin admin] PATH_INFO: `/v3/users/0cfdd706a8be4f45b7cc2236b0fb741d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:56.686509 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f0b09-43d7-44f5-b0d2-b7b998c5085f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cfdd706a8be4f45b7cc2236b0fb741d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:56.695445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f0b09-43d7-44f5-b0d2-b7b998c5085f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:56.707720 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 824/1664] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:05:56 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:56.709287 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1218dd-32f3-4b31-a6e0-966e8367a5ee admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:56.843814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-dd1f0b09-43d7-44f5-b0d2-b7b998c5085f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cfdd706a8be4f45b7cc2236b0fb741d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:56.846546 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-dd1f0b09-43d7-44f5-b0d2-b7b998c5085f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cfdd706a8be4f45b7cc2236b0fb741d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:56.848356 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-dd1f0b09-43d7-44f5-b0d2-b7b998c5085f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cfdd706a8be4f45b7cc2236b0fb741d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:56.875460 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-dd1f0b09-43d7-44f5-b0d2-b7b998c5085f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cfdd706a8be4f45b7cc2236b0fb741d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:56.881275 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1218dd-32f3-4b31-a6e0-966e8367a5ee admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:56.890611 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4049b1-89b5-4165-9fbf-4b817b4efae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:56.891794 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4049b1-89b5-4165-9fbf-4b817b4efae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:56.892275 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4049b1-89b5-4165-9fbf-4b817b4efae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:56.892726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4049b1-89b5-4165-9fbf-4b817b4efae0 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:56.893933 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4049b1-89b5-4165-9fbf-4b817b4efae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:56.898490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4049b1-89b5-4165-9fbf-4b817b4efae0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:56.912983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-dd1f0b09-43d7-44f5-b0d2-b7b998c5085f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cfdd706a8be4f45b7cc2236b0fb741d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:56.984971 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 825/1665] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:05:56 2022] POST /identity/v3/users => generated 287 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:57.002194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4049b1-89b5-4165-9fbf-4b817b4efae0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:57.009045 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3e4049b1-89b5-4165-9fbf-4b817b4efae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:57.015247 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 841/1666] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:05:56 2022] DELETE /identity/v3/users/0cfdd706a8be4f45b7cc2236b0fb741d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:05:57.021644 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034c6a2-cea4-4b24-a874-77f8b4b823cd None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:57.025257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034c6a2-cea4-4b24-a874-77f8b4b823cd None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:57.025771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034c6a2-cea4-4b24-a874-77f8b4b823cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:57.063210 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4049b1-89b5-4165-9fbf-4b817b4efae0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:57.085590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8034c6a2-cea4-4b24-a874-77f8b4b823cd None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:57.089554 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8034c6a2-cea4-4b24-a874-77f8b4b823cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:57.251382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada17d16-63dc-4e37-902a-e18cca8e170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:57.251382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada17d16-63dc-4e37-902a-e18cca8e170f admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:57.251382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada17d16-63dc-4e37-902a-e18cca8e170f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:57.251382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada17d16-63dc-4e37-902a-e18cca8e170f admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:57.253860 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada17d16-63dc-4e37-902a-e18cca8e170f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:57.260904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada17d16-63dc-4e37-902a-e18cca8e170f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:57.281241 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 842/1667] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:57.295731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 826/1668] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:57.298305 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034c6a2-cea4-4b24-a874-77f8b4b823cd None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:57.313244 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada17d16-63dc-4e37-902a-e18cca8e170f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:57.316698 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ada17d16-63dc-4e37-902a-e18cca8e170f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:57.324888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034c6a2-cea4-4b24-a874-77f8b4b823cd None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:57.339621 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab397ba-ca14-431a-8544-41e832b75c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:57.340271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab397ba-ca14-431a-8544-41e832b75c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:57.340556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab397ba-ca14-431a-8544-41e832b75c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:57.340852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab397ba-ca14-431a-8544-41e832b75c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:57.343336 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab397ba-ca14-431a-8544-41e832b75c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:57.345003 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab397ba-ca14-431a-8544-41e832b75c45 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:57.384305 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 843/1669] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:57.388734 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab397ba-ca14-431a-8544-41e832b75c45 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:57.405103 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab397ba-ca14-431a-8544-41e832b75c45 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:57.413480 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb96968-ccf0-418f-81ed-869aec3ea30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:57.415480 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb96968-ccf0-418f-81ed-869aec3ea30d admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:57.418714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb96968-ccf0-418f-81ed-869aec3ea30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:57.419025 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb96968-ccf0-418f-81ed-869aec3ea30d admin admin] PATH_INFO: `/v3/projects/5e68dbe520ae4412970e9ef647949b62/users/caaf02cc874a4f79853bc8e9bdabccc9/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:57.492529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb96968-ccf0-418f-81ed-869aec3ea30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e68dbe520ae4412970e9ef647949b62, user_id=caaf02cc874a4f79853bc8e9bdabccc9, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:57.495608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb96968-ccf0-418f-81ed-869aec3ea30d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:57.510287 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada17d16-63dc-4e37-902a-e18cca8e170f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:57.522922 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 844/1670] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:57 2022] PUT /identity/v3/projects/5e68dbe520ae4412970e9ef647949b62/users/caaf02cc874a4f79853bc8e9bdabccc9/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:05:57.534550 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59651c62-d07f-44bd-96bb-923c5b1b9791 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:57.534953 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8b529-1bb0-4253-8c59-d6dd3ca37fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:57.535098 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59651c62-d07f-44bd-96bb-923c5b1b9791 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:57.535452 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59651c62-d07f-44bd-96bb-923c5b1b9791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:57.535611 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8b529-1bb0-4253-8c59-d6dd3ca37fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:57.535893 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8b529-1bb0-4253-8c59-d6dd3ca37fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:57.536164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8b529-1bb0-4253-8c59-d6dd3ca37fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:57.566874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8b529-1bb0-4253-8c59-d6dd3ca37fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:57.568337 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8b529-1bb0-4253-8c59-d6dd3ca37fb3 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:57.592906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 827/1671] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:05:57.620731 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-59651c62-d07f-44bd-96bb-923c5b1b9791 None None] MFA Rules not processed for user `caaf02cc874a4f79853bc8e9bdabccc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:57.622354 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-59651c62-d07f-44bd-96bb-923c5b1b9791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:57.774454 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 845/1672] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:05:57.779466 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8b529-1bb0-4253-8c59-d6dd3ca37fb3 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:57.792507 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8b529-1bb0-4253-8c59-d6dd3ca37fb3 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:57.902972 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bcf79-777f-436a-bb6e-7697312d1c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:57.904513 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bcf79-777f-436a-bb6e-7697312d1c97 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:57.908567 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bcf79-777f-436a-bb6e-7697312d1c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:57.909110 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bcf79-777f-436a-bb6e-7697312d1c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:57.910062 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bcf79-777f-436a-bb6e-7697312d1c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:57.913044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bcf79-777f-436a-bb6e-7697312d1c97 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:57.964453 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 828/1673] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:05:57 2022] POST /identity/v3/projects => generated 371 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:57.968582 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59651c62-d07f-44bd-96bb-923c5b1b9791 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:57.983486 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59651c62-d07f-44bd-96bb-923c5b1b9791 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:58.125570 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ce045-00c5-4309-a409-839ec35f9d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:58.126266 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ce045-00c5-4309-a409-839ec35f9d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:58.126535 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ce045-00c5-4309-a409-839ec35f9d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:58.126810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ce045-00c5-4309-a409-839ec35f9d8e admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:58.127760 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ce045-00c5-4309-a409-839ec35f9d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:58.129731 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ce045-00c5-4309-a409-839ec35f9d8e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:58.180701 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 846/1674] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:05:57 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:05:58.186709 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bcf79-777f-436a-bb6e-7697312d1c97 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:58.202826 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bcf79-777f-436a-bb6e-7697312d1c97 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:58.208313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00039c-d7d3-475c-a34b-d146d80e51fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:58.209546 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00039c-d7d3-475c-a34b-d146d80e51fb admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:58.210345 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00039c-d7d3-475c-a34b-d146d80e51fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:58.210856 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00039c-d7d3-475c-a34b-d146d80e51fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:58.211820 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00039c-d7d3-475c-a34b-d146d80e51fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:58.213778 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00039c-d7d3-475c-a34b-d146d80e51fb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:58.239630 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ce045-00c5-4309-a409-839ec35f9d8e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:58.250223 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 829/1675] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:58.255269 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ce045-00c5-4309-a409-839ec35f9d8e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:58.262850 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38b7eb-23e7-42cf-a854-e6dcac4c1b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:58.264173 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38b7eb-23e7-42cf-a854-e6dcac4c1b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:58.266205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38b7eb-23e7-42cf-a854-e6dcac4c1b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:58.267002 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38b7eb-23e7-42cf-a854-e6dcac4c1b4c admin admin] PATH_INFO: `/v3/projects/b690db6e90784ab5844ea6cf7cf8203d/users/91144dd13f6e4da788e033034eb3ab08/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:58.308675 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38b7eb-23e7-42cf-a854-e6dcac4c1b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b690db6e90784ab5844ea6cf7cf8203d, user_id=91144dd13f6e4da788e033034eb3ab08, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:58.311683 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38b7eb-23e7-42cf-a854-e6dcac4c1b4c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:58.350895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00039c-d7d3-475c-a34b-d146d80e51fb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:58.351116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 847/1676] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:58 2022] PUT /identity/v3/projects/b690db6e90784ab5844ea6cf7cf8203d/users/91144dd13f6e4da788e033034eb3ab08/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:58.360685 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00039c-d7d3-475c-a34b-d146d80e51fb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:58.518854 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d1493-efe8-4164-b9f8-f9eff5adc0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:58.522758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1493-efe8-4164-b9f8-f9eff5adc0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:58.523616 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1493-efe8-4164-b9f8-f9eff5adc0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:58.524090 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1493-efe8-4164-b9f8-f9eff5adc0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:58.525067 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d1493-efe8-4164-b9f8-f9eff5adc0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:58.526924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d1493-efe8-4164-b9f8-f9eff5adc0e2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:58.550791 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38b7eb-23e7-42cf-a854-e6dcac4c1b4c admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:58.551677 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 830/1677] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:05:58.564849 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38b7eb-23e7-42cf-a854-e6dcac4c1b4c admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:58.577306 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df6c8b-9764-4326-81b5-f448a414532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:58.578618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df6c8b-9764-4326-81b5-f448a414532c admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:58.579092 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df6c8b-9764-4326-81b5-f448a414532c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:58.579556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df6c8b-9764-4326-81b5-f448a414532c admin admin] PATH_INFO: `/v3/projects/b690db6e90784ab5844ea6cf7cf8203d/users/91144dd13f6e4da788e033034eb3ab08/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:58.581840 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df6c8b-9764-4326-81b5-f448a414532c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b690db6e90784ab5844ea6cf7cf8203d, user_id=91144dd13f6e4da788e033034eb3ab08, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:58.587528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df6c8b-9764-4326-81b5-f448a414532c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:58.617375 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 848/1678] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:05:58 2022] PUT /identity/v3/projects/b690db6e90784ab5844ea6cf7cf8203d/users/91144dd13f6e4da788e033034eb3ab08/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:58.629431 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e8cb-7c0f-4236-bf72-0f3063b4af8e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:58.630515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e8cb-7c0f-4236-bf72-0f3063b4af8e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:58.630995 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e8cb-7c0f-4236-bf72-0f3063b4af8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:58.682056 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f350e8cb-7c0f-4236-bf72-0f3063b4af8e None None] MFA Rules not processed for user `91144dd13f6e4da788e033034eb3ab08`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:58.683661 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f350e8cb-7c0f-4236-bf72-0f3063b4af8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:58.876191 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 831/1679] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:05:58.897981 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df6c8b-9764-4326-81b5-f448a414532c admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:58.900181 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d7df6c8b-9764-4326-81b5-f448a414532c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:59.015004 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df6c8b-9764-4326-81b5-f448a414532c admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:59.021683 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dc912-5837-4051-aad1-d43a083350b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:59.022758 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dc912-5837-4051-aad1-d43a083350b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:59.023552 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dc912-5837-4051-aad1-d43a083350b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:59.023900 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dc912-5837-4051-aad1-d43a083350b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:59.039540 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788dc912-5837-4051-aad1-d43a083350b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:59.042689 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788dc912-5837-4051-aad1-d43a083350b7 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:59.049406 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350e8cb-7c0f-4236-bf72-0f3063b4af8e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:59.051052 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f350e8cb-7c0f-4236-bf72-0f3063b4af8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:59.096817 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 849/1680] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:05:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:05:59.155859 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dc912-5837-4051-aad1-d43a083350b7 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:59.158064 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-788dc912-5837-4051-aad1-d43a083350b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:59.190762 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350e8cb-7c0f-4236-bf72-0f3063b4af8e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:59.202799 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab25c99-3616-463c-a082-5b8ad42c3ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:59.203761 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab25c99-3616-463c-a082-5b8ad42c3ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:59.204115 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab25c99-3616-463c-a082-5b8ad42c3ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:59.204395 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab25c99-3616-463c-a082-5b8ad42c3ca5 admin admin] PATH_INFO: `/v3/projects/dcf9003906f544daa9b23ef545bdb173` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:59.205780 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab25c99-3616-463c-a082-5b8ad42c3ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf9003906f544daa9b23ef545bdb173)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:59.210353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab25c99-3616-463c-a082-5b8ad42c3ca5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:59.302202 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3ab25c99-3616-463c-a082-5b8ad42c3ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf9003906f544daa9b23ef545bdb173', 'request_id': 'req-3ab25c99-3616-463c-a082-5b8ad42c3ca5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:59.321887 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3ab25c99-3616-463c-a082-5b8ad42c3ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf9003906f544daa9b23ef545bdb173', 'request_id': 'req-3ab25c99-3616-463c-a082-5b8ad42c3ca5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:59.333333 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3ab25c99-3616-463c-a082-5b8ad42c3ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf9003906f544daa9b23ef545bdb173', 'request_id': 'req-3ab25c99-3616-463c-a082-5b8ad42c3ca5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:59.348743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3ab25c99-3616-463c-a082-5b8ad42c3ca5 admin admin] The token cache is being invalidate because project dcf9003906f544daa9b23ef545bdb173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:05:59.349401 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3ab25c99-3616-463c-a082-5b8ad42c3ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:59.350340 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3ab25c99-3616-463c-a082-5b8ad42c3ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:59.352610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 832/1681] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:05:59 2022] DELETE /identity/v3/projects/dcf9003906f544daa9b23ef545bdb173 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:05:59.357630 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab25c99-3616-463c-a082-5b8ad42c3ca5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:05:59.361497 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3ab25c99-3616-463c-a082-5b8ad42c3ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:59.402428 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dc912-5837-4051-aad1-d43a083350b7 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:59.547477 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af4f86-6433-4227-b208-f7326df0ac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:59.548771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af4f86-6433-4227-b208-f7326df0ac4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:59.549192 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af4f86-6433-4227-b208-f7326df0ac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:59.550046 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af4f86-6433-4227-b208-f7326df0ac4e admin admin] PATH_INFO: `/v3/users/d6b028801e5c441cba20427865a85c1e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:59.551502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af4f86-6433-4227-b208-f7326df0ac4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b028801e5c441cba20427865a85c1e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:59.554495 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af4f86-6433-4227-b208-f7326df0ac4e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:59.573870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab25c99-3616-463c-a082-5b8ad42c3ca5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:05:59.578914 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb152532-2e73-4621-967a-e7ea3e27fa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:05:59.579958 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb152532-2e73-4621-967a-e7ea3e27fa27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:59.588531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb152532-2e73-4621-967a-e7ea3e27fa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:59.589236 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb152532-2e73-4621-967a-e7ea3e27fa27 admin admin] PATH_INFO: `/v3/users/97270d059ae74c4b81aaca4f4378557a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:59.590982 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb152532-2e73-4621-967a-e7ea3e27fa27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97270d059ae74c4b81aaca4f4378557a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:05:59.592335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-eb152532-2e73-4621-967a-e7ea3e27fa27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 27 05:05:59.592335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: warnings.warn(msg) Sep 27 05:05:59.592335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: Sep 27 05:05:59.593761 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb152532-2e73-4621-967a-e7ea3e27fa27 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:05:59.632812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f7af4f86-6433-4227-b208-f7326df0ac4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b028801e5c441cba20427865a85c1e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:59.635293 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f7af4f86-6433-4227-b208-f7326df0ac4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b028801e5c441cba20427865a85c1e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:59.637167 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f7af4f86-6433-4227-b208-f7326df0ac4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b028801e5c441cba20427865a85c1e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:59.676687 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f7af4f86-6433-4227-b208-f7326df0ac4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b028801e5c441cba20427865a85c1e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:59.729880 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f7af4f86-6433-4227-b208-f7326df0ac4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b028801e5c441cba20427865a85c1e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:59.742872 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-eb152532-2e73-4621-967a-e7ea3e27fa27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97270d059ae74c4b81aaca4f4378557a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:59.744369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-eb152532-2e73-4621-967a-e7ea3e27fa27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97270d059ae74c4b81aaca4f4378557a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:59.745220 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-eb152532-2e73-4621-967a-e7ea3e27fa27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97270d059ae74c4b81aaca4f4378557a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:59.751157 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 850/1682] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:05:59 2022] DELETE /identity/v3/users/d6b028801e5c441cba20427865a85c1e => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:05:59.754675 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ec535-3e82-452c-b8b3-c4510aad1d2d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:59.754996 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ec535-3e82-452c-b8b3-c4510aad1d2d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:59.755376 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ec535-3e82-452c-b8b3-c4510aad1d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:59.781348 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-eb152532-2e73-4621-967a-e7ea3e27fa27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97270d059ae74c4b81aaca4f4378557a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:59.832219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-121ec535-3e82-452c-b8b3-c4510aad1d2d None None] MFA Rules not processed for user `661617a587384f2ab360f9a278e61baf`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:59.833768 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-121ec535-3e82-452c-b8b3-c4510aad1d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:05:59.836446 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-eb152532-2e73-4621-967a-e7ea3e27fa27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97270d059ae74c4b81aaca4f4378557a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:05:59.883911 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 833/1683] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:05:59 2022] DELETE /identity/v3/users/97270d059ae74c4b81aaca4f4378557a => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:05:59.885669 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d501a03-6276-469d-b115-2cae45b397a9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:05:59.887804 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d501a03-6276-469d-b115-2cae45b397a9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:05:59.888421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d501a03-6276-469d-b115-2cae45b397a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:05:59.929216 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9d501a03-6276-469d-b115-2cae45b397a9 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:05:59.930843 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9d501a03-6276-469d-b115-2cae45b397a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:00.044662 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 851/1684] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:00.045625 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ec535-3e82-452c-b8b3-c4510aad1d2d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:00.046945 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-121ec535-3e82-452c-b8b3-c4510aad1d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:00.142846 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 834/1685] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:00.170897 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d501a03-6276-469d-b115-2cae45b397a9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:00.172444 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9d501a03-6276-469d-b115-2cae45b397a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:00.191305 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ec535-3e82-452c-b8b3-c4510aad1d2d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:00.198567 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9554c91-6619-426f-9052-843d7e2ba991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:00.199884 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9554c91-6619-426f-9052-843d7e2ba991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:00.200463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9554c91-6619-426f-9052-843d7e2ba991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:00.201053 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9554c91-6619-426f-9052-843d7e2ba991 admin admin] PATH_INFO: `/v3/users/caaf02cc874a4f79853bc8e9bdabccc9` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:00.203435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9554c91-6619-426f-9052-843d7e2ba991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caaf02cc874a4f79853bc8e9bdabccc9)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:00.205942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9554c91-6619-426f-9052-843d7e2ba991 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:00.263869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d501a03-6276-469d-b115-2cae45b397a9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:00.271224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d1a1e-d994-44ca-80e5-f16f26809e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:00.273897 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d1a1e-d994-44ca-80e5-f16f26809e69 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:00.273897 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d1a1e-d994-44ca-80e5-f16f26809e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:00.274070 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d1a1e-d994-44ca-80e5-f16f26809e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:00.293130 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d1a1e-d994-44ca-80e5-f16f26809e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:00.295500 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d1a1e-d994-44ca-80e5-f16f26809e69 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:00.312915 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 835/1686] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:06:00.329071 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a9554c91-6619-426f-9052-843d7e2ba991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caaf02cc874a4f79853bc8e9bdabccc9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:00.330454 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a9554c91-6619-426f-9052-843d7e2ba991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caaf02cc874a4f79853bc8e9bdabccc9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:00.331294 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a9554c91-6619-426f-9052-843d7e2ba991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caaf02cc874a4f79853bc8e9bdabccc9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:00.348288 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a9554c91-6619-426f-9052-843d7e2ba991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caaf02cc874a4f79853bc8e9bdabccc9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:00.366343 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a9554c91-6619-426f-9052-843d7e2ba991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caaf02cc874a4f79853bc8e9bdabccc9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:00.395804 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 852/1687] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:00 2022] DELETE /identity/v3/users/caaf02cc874a4f79853bc8e9bdabccc9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:00.401196 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b083a9-6e39-46fa-b682-32682e513e92 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:00.401835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b083a9-6e39-46fa-b682-32682e513e92 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:00.402269 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b083a9-6e39-46fa-b682-32682e513e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:00.426229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-35b083a9-6e39-46fa-b682-32682e513e92 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:00.430000 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-35b083a9-6e39-46fa-b682-32682e513e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:00.511925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 836/1688] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:00.562980 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9554c91-6619-426f-9052-843d7e2ba991 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:00.564516 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a9554c91-6619-426f-9052-843d7e2ba991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:00.663649 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9554c91-6619-426f-9052-843d7e2ba991 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:00.669276 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c98c69-3982-4783-b888-3d9a7c682a35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:00.670439 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c98c69-3982-4783-b888-3d9a7c682a35 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:00.670439 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c98c69-3982-4783-b888-3d9a7c682a35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:00.670600 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c98c69-3982-4783-b888-3d9a7c682a35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:00.686942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c98c69-3982-4783-b888-3d9a7c682a35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:00.689071 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c98c69-3982-4783-b888-3d9a7c682a35 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:00.702446 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 853/1689] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:00.847322 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b083a9-6e39-46fa-b682-32682e513e92 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:00.848949 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-35b083a9-6e39-46fa-b682-32682e513e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:00.870324 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b083a9-6e39-46fa-b682-32682e513e92 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:00.886992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e88533-a815-4ffd-9662-dd1366a3732e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:00.888068 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e88533-a815-4ffd-9662-dd1366a3732e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:00.888477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e88533-a815-4ffd-9662-dd1366a3732e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:00.889038 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e88533-a815-4ffd-9662-dd1366a3732e admin admin] PATH_INFO: `/v3/projects/1699356743c846c48e12bb0c6422b9b1` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:00.890641 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e88533-a815-4ffd-9662-dd1366a3732e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1699356743c846c48e12bb0c6422b9b1)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:00.892909 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e88533-a815-4ffd-9662-dd1366a3732e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:00.993628 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-69e88533-a815-4ffd-9662-dd1366a3732e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1699356743c846c48e12bb0c6422b9b1', 'request_id': 'req-69e88533-a815-4ffd-9662-dd1366a3732e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:01.011932 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-69e88533-a815-4ffd-9662-dd1366a3732e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1699356743c846c48e12bb0c6422b9b1', 'request_id': 'req-69e88533-a815-4ffd-9662-dd1366a3732e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:01.035893 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-69e88533-a815-4ffd-9662-dd1366a3732e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1699356743c846c48e12bb0c6422b9b1', 'request_id': 'req-69e88533-a815-4ffd-9662-dd1366a3732e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:01.062128 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-69e88533-a815-4ffd-9662-dd1366a3732e admin admin] The token cache is being invalidate because project 1699356743c846c48e12bb0c6422b9b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:01.062587 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-69e88533-a815-4ffd-9662-dd1366a3732e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:01.063972 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-69e88533-a815-4ffd-9662-dd1366a3732e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:01.066820 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 837/1690] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:00 2022] DELETE /identity/v3/projects/1699356743c846c48e12bb0c6422b9b1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:01.072374 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1c083-8c04-40ca-ad18-8e2349017e7b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:01.072672 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1c083-8c04-40ca-ad18-8e2349017e7b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:01.072992 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce1c083-8c04-40ca-ad18-8e2349017e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:01.104660 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-cce1c083-8c04-40ca-ad18-8e2349017e7b None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:01.114006 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-cce1c083-8c04-40ca-ad18-8e2349017e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:01.240307 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 854/1691] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:01.249477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c5b06-bd8c-4d7d-972e-55978427e820 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:01.249477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c5b06-bd8c-4d7d-972e-55978427e820 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:01.249896 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c5b06-bd8c-4d7d-972e-55978427e820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:01.257196 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1c083-8c04-40ca-ad18-8e2349017e7b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:01.260955 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-cce1c083-8c04-40ca-ad18-8e2349017e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:01.284463 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e55c5b06-bd8c-4d7d-972e-55978427e820 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:01.286404 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e55c5b06-bd8c-4d7d-972e-55978427e820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:01.287493 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce1c083-8c04-40ca-ad18-8e2349017e7b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:01.302295 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fabc0-a994-49b5-b19c-abc025616ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:01.306947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fabc0-a994-49b5-b19c-abc025616ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:01.307248 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fabc0-a994-49b5-b19c-abc025616ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:01.307530 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fabc0-a994-49b5-b19c-abc025616ed8 admin admin] PATH_INFO: `/v3/projects/c93a5ee96bd24aebb1827039d46b2237` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:01.311428 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 838/1692] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:01.313894 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fabc0-a994-49b5-b19c-abc025616ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c93a5ee96bd24aebb1827039d46b2237)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:01.314993 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c5b06-bd8c-4d7d-972e-55978427e820 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:01.333255 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502fabc0-a994-49b5-b19c-abc025616ed8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:01.369263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c5b06-bd8c-4d7d-972e-55978427e820 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:01.384759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2dfaa-6eb9-4896-b768-02637605052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:01.387642 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2dfaa-6eb9-4896-b768-02637605052f admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:01.389258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2dfaa-6eb9-4896-b768-02637605052f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:01.389686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2dfaa-6eb9-4896-b768-02637605052f admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:01.390631 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2dfaa-6eb9-4896-b768-02637605052f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:01.392433 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2dfaa-6eb9-4896-b768-02637605052f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:01.395850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2dfaa-6eb9-4896-b768-02637605052f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:01.430790 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 839/1693] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:01.432047 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2dfaa-6eb9-4896-b768-02637605052f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:01.501022 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2dfaa-6eb9-4896-b768-02637605052f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:01.517952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-502fabc0-a994-49b5-b19c-abc025616ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c93a5ee96bd24aebb1827039d46b2237', 'request_id': 'req-502fabc0-a994-49b5-b19c-abc025616ed8'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:01.529961 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-502fabc0-a994-49b5-b19c-abc025616ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c93a5ee96bd24aebb1827039d46b2237', 'request_id': 'req-502fabc0-a994-49b5-b19c-abc025616ed8'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:01.551167 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-502fabc0-a994-49b5-b19c-abc025616ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c93a5ee96bd24aebb1827039d46b2237', 'request_id': 'req-502fabc0-a994-49b5-b19c-abc025616ed8'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:01.575801 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-502fabc0-a994-49b5-b19c-abc025616ed8 admin admin] The token cache is being invalidate because project c93a5ee96bd24aebb1827039d46b2237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:01.576372 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-502fabc0-a994-49b5-b19c-abc025616ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:01.577205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-502fabc0-a994-49b5-b19c-abc025616ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:01.580542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 855/1694] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:01 2022] DELETE /identity/v3/projects/c93a5ee96bd24aebb1827039d46b2237 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:01.581373 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fabc0-a994-49b5-b19c-abc025616ed8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:01.583793 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-502fabc0-a994-49b5-b19c-abc025616ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:01.633138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0193340-cfd3-4f0c-882c-bb8a0166c292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:01.635115 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0193340-cfd3-4f0c-882c-bb8a0166c292 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:01.635543 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0193340-cfd3-4f0c-882c-bb8a0166c292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:01.636033 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0193340-cfd3-4f0c-882c-bb8a0166c292 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:01.637835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0193340-cfd3-4f0c-882c-bb8a0166c292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:01.650159 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0193340-cfd3-4f0c-882c-bb8a0166c292 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:01.683327 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fabc0-a994-49b5-b19c-abc025616ed8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:01.691063 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a103bd8-08c6-4244-b0c5-cc3e71b12d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:01.692022 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a103bd8-08c6-4244-b0c5-cc3e71b12d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:01.692379 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a103bd8-08c6-4244-b0c5-cc3e71b12d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:01.692768 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a103bd8-08c6-4244-b0c5-cc3e71b12d3c admin admin] PATH_INFO: `/v3/users/8e7fde9ae9c7483ca56d517e3d5a0f45` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:01.695868 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a103bd8-08c6-4244-b0c5-cc3e71b12d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e7fde9ae9c7483ca56d517e3d5a0f45)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:01.698494 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a103bd8-08c6-4244-b0c5-cc3e71b12d3c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:01.702439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 840/1695] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:01 2022] POST /identity/v3/projects => generated 379 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:01.705418 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5aa25-b8c3-40d9-ac7a-4a620c0a0485 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:01.705944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5aa25-b8c3-40d9-ac7a-4a620c0a0485 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:01.706366 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5aa25-b8c3-40d9-ac7a-4a620c0a0485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:01.749381 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-83a5aa25-b8c3-40d9-ac7a-4a620c0a0485 None None] MFA Rules not processed for user `43aeedbf8ef94c969eba750306890f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:01.750866 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-83a5aa25-b8c3-40d9-ac7a-4a620c0a0485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:01.796238 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0a103bd8-08c6-4244-b0c5-cc3e71b12d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e7fde9ae9c7483ca56d517e3d5a0f45'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:01.797082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0a103bd8-08c6-4244-b0c5-cc3e71b12d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e7fde9ae9c7483ca56d517e3d5a0f45'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:01.797942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0a103bd8-08c6-4244-b0c5-cc3e71b12d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e7fde9ae9c7483ca56d517e3d5a0f45'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:01.818050 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0a103bd8-08c6-4244-b0c5-cc3e71b12d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e7fde9ae9c7483ca56d517e3d5a0f45'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:01.836569 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0a103bd8-08c6-4244-b0c5-cc3e71b12d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e7fde9ae9c7483ca56d517e3d5a0f45'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:01.855291 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 856/1696] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:01 2022] DELETE /identity/v3/users/8e7fde9ae9c7483ca56d517e3d5a0f45 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:01.856638 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cf566-77dc-4862-a9e1-8313cf11b2c7 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:01.857281 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cf566-77dc-4862-a9e1-8313cf11b2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:01.857463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79cf566-77dc-4862-a9e1-8313cf11b2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:01.862383 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 841/1697] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:01.863978 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5aa25-b8c3-40d9-ac7a-4a620c0a0485 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:01.866347 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-83a5aa25-b8c3-40d9-ac7a-4a620c0a0485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:01.905856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b79cf566-77dc-4862-a9e1-8313cf11b2c7 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:01.907182 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b79cf566-77dc-4862-a9e1-8313cf11b2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:02.027795 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5aa25-b8c3-40d9-ac7a-4a620c0a0485 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:02.064597 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 857/1698] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:02.073966 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6636e2-00ad-4466-a1b4-5e8f3a6ff463 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:02.074408 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6636e2-00ad-4466-a1b4-5e8f3a6ff463 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:02.074699 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6636e2-00ad-4466-a1b4-5e8f3a6ff463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:02.114241 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-6e6636e2-00ad-4466-a1b4-5e8f3a6ff463 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:02.120226 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6e6636e2-00ad-4466-a1b4-5e8f3a6ff463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:02.145105 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 858/1699] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:02.145985 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee654146-1cb1-4f00-bb69-2811524edb74 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:02.146273 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee654146-1cb1-4f00-bb69-2811524edb74 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:02.146550 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee654146-1cb1-4f00-bb69-2811524edb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:02.169664 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798505f2-56c8-4de5-9626-464223351c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:02.170317 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798505f2-56c8-4de5-9626-464223351c68 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:02.170597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798505f2-56c8-4de5-9626-464223351c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:02.170867 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798505f2-56c8-4de5-9626-464223351c68 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:02.171564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798505f2-56c8-4de5-9626-464223351c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:02.173558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798505f2-56c8-4de5-9626-464223351c68 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:02.190543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ee654146-1cb1-4f00-bb69-2811524edb74 None None] MFA Rules not processed for user `43aeedbf8ef94c969eba750306890f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:02.191757 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ee654146-1cb1-4f00-bb69-2811524edb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:02.219726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 842/1700] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:01 2022] POST /identity/v3/users => generated 290 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:02.219726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798505f2-56c8-4de5-9626-464223351c68 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:02.221955 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-798505f2-56c8-4de5-9626-464223351c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:02.250193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798505f2-56c8-4de5-9626-464223351c68 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:02.262325 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c93617-f933-4deb-a15e-a7384c8b4af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:02.263201 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c93617-f933-4deb-a15e-a7384c8b4af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:02.263479 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c93617-f933-4deb-a15e-a7384c8b4af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:02.263749 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c93617-f933-4deb-a15e-a7384c8b4af8 admin admin] PATH_INFO: `/v3/projects/5e68dbe520ae4412970e9ef647949b62` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:02.269635 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c93617-f933-4deb-a15e-a7384c8b4af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e68dbe520ae4412970e9ef647949b62)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:02.276426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c93617-f933-4deb-a15e-a7384c8b4af8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:02.309200 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 859/1701] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:02.315271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5178297-775c-466f-997f-15a850e98823 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:02.315565 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5178297-775c-466f-997f-15a850e98823 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:02.316123 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5178297-775c-466f-997f-15a850e98823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:02.351872 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b5178297-775c-466f-997f-15a850e98823 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:02.358146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b5178297-775c-466f-997f-15a850e98823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:02.380362 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-57c93617-f933-4deb-a15e-a7384c8b4af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e68dbe520ae4412970e9ef647949b62', 'request_id': 'req-57c93617-f933-4deb-a15e-a7384c8b4af8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:02.403150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-57c93617-f933-4deb-a15e-a7384c8b4af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e68dbe520ae4412970e9ef647949b62', 'request_id': 'req-57c93617-f933-4deb-a15e-a7384c8b4af8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:02.411409 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-57c93617-f933-4deb-a15e-a7384c8b4af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e68dbe520ae4412970e9ef647949b62', 'request_id': 'req-57c93617-f933-4deb-a15e-a7384c8b4af8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:02.437973 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-57c93617-f933-4deb-a15e-a7384c8b4af8 admin admin] The token cache is being invalidate because project 5e68dbe520ae4412970e9ef647949b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:02.438263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-57c93617-f933-4deb-a15e-a7384c8b4af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:02.442421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-57c93617-f933-4deb-a15e-a7384c8b4af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:02.448469 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 843/1702] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:02 2022] DELETE /identity/v3/projects/5e68dbe520ae4412970e9ef647949b62 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:02.449406 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c93617-f933-4deb-a15e-a7384c8b4af8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:02.454459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-57c93617-f933-4deb-a15e-a7384c8b4af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:02.521314 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 860/1703] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:02.525887 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5178297-775c-466f-997f-15a850e98823 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:02.532746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b5178297-775c-466f-997f-15a850e98823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:02.559678 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5178297-775c-466f-997f-15a850e98823 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:02.574761 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc6252-323e-40ad-8c2b-c1c7894a8e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:02.575445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc6252-323e-40ad-8c2b-c1c7894a8e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:02.575734 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc6252-323e-40ad-8c2b-c1c7894a8e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:02.575995 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc6252-323e-40ad-8c2b-c1c7894a8e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:02.576723 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc6252-323e-40ad-8c2b-c1c7894a8e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:02.578411 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc6252-323e-40ad-8c2b-c1c7894a8e0b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:02.595185 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c93617-f933-4deb-a15e-a7384c8b4af8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:02.603620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 861/1704] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:02.604647 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc6252-323e-40ad-8c2b-c1c7894a8e0b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:02.608826 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832cf41-281e-4949-bb03-402cb1ad9955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:02.609260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832cf41-281e-4949-bb03-402cb1ad9955 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:02.609540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832cf41-281e-4949-bb03-402cb1ad9955 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:02.609900 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832cf41-281e-4949-bb03-402cb1ad9955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:02.611111 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-04cc6252-323e-40ad-8c2b-c1c7894a8e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:02.614472 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4832cf41-281e-4949-bb03-402cb1ad9955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:02.637117 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832cf41-281e-4949-bb03-402cb1ad9955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:02.640337 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832cf41-281e-4949-bb03-402cb1ad9955 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:02.668777 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 844/1705] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:02.671867 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832cf41-281e-4949-bb03-402cb1ad9955 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:02.673972 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4832cf41-281e-4949-bb03-402cb1ad9955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:02.704766 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832cf41-281e-4949-bb03-402cb1ad9955 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:02.717904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab782e22-31ec-40f4-84a6-8c9f804affb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:02.718828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab782e22-31ec-40f4-84a6-8c9f804affb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:02.719183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab782e22-31ec-40f4-84a6-8c9f804affb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:02.719538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab782e22-31ec-40f4-84a6-8c9f804affb6 admin admin] PATH_INFO: `/v3/users/91144dd13f6e4da788e033034eb3ab08` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:02.721181 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab782e22-31ec-40f4-84a6-8c9f804affb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91144dd13f6e4da788e033034eb3ab08)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:02.723964 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab782e22-31ec-40f4-84a6-8c9f804affb6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:02.803507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc6252-323e-40ad-8c2b-c1c7894a8e0b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:02.822735 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b9ad6-7f12-4b52-9513-525d52772f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:02.823422 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b9ad6-7f12-4b52-9513-525d52772f52 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:02.823711 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b9ad6-7f12-4b52-9513-525d52772f52 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:02.823991 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b9ad6-7f12-4b52-9513-525d52772f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:02.826367 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-303b9ad6-7f12-4b52-9513-525d52772f52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:02.858227 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ab782e22-31ec-40f4-84a6-8c9f804affb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91144dd13f6e4da788e033034eb3ab08'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:02.858936 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ab782e22-31ec-40f4-84a6-8c9f804affb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91144dd13f6e4da788e033034eb3ab08'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:02.863068 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ab782e22-31ec-40f4-84a6-8c9f804affb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91144dd13f6e4da788e033034eb3ab08'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:02.886454 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ab782e22-31ec-40f4-84a6-8c9f804affb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91144dd13f6e4da788e033034eb3ab08'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:02.904965 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ab782e22-31ec-40f4-84a6-8c9f804affb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91144dd13f6e4da788e033034eb3ab08'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:02.924204 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 845/1706] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:02 2022] DELETE /identity/v3/users/91144dd13f6e4da788e033034eb3ab08 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:02.927336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78579831-9fc2-45bd-ad9f-abd431c7c507 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:02.928455 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78579831-9fc2-45bd-ad9f-abd431c7c507 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:02.929303 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78579831-9fc2-45bd-ad9f-abd431c7c507 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:02.932678 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 846/1707] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 27 05:06:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:06:02.933933 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78579831-9fc2-45bd-ad9f-abd431c7c507 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:02.945892 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-78579831-9fc2-45bd-ad9f-abd431c7c507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:02.972210 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b9ad6-7f12-4b52-9513-525d52772f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:02.974029 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b9ad6-7f12-4b52-9513-525d52772f52 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:02.991731 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 862/1708] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:03.011843 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b9ad6-7f12-4b52-9513-525d52772f52 service nova] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:03.044267 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b9ad6-7f12-4b52-9513-525d52772f52 service nova] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:03.045900 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78579831-9fc2-45bd-ad9f-abd431c7c507 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:03.052490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee12a1c-b6e6-4169-a68a-0d25df26f91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:03.054333 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee12a1c-b6e6-4169-a68a-0d25df26f91b admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:03.055045 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee12a1c-b6e6-4169-a68a-0d25df26f91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:03.055045 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee12a1c-b6e6-4169-a68a-0d25df26f91b admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:03.055778 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee12a1c-b6e6-4169-a68a-0d25df26f91b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:03.056129 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee12a1c-b6e6-4169-a68a-0d25df26f91b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:03.058513 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee12a1c-b6e6-4169-a68a-0d25df26f91b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:03.076998 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194080bb-5707-4cff-b62f-9fca468dfe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:03.077832 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194080bb-5707-4cff-b62f-9fca468dfe7e admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:03.077949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194080bb-5707-4cff-b62f-9fca468dfe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:03.078229 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194080bb-5707-4cff-b62f-9fca468dfe7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:03.078969 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194080bb-5707-4cff-b62f-9fca468dfe7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:03.080581 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194080bb-5707-4cff-b62f-9fca468dfe7e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:03.086553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 847/1709] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:03.089865 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc112a0-c5a2-43f2-b6d1-07f2ce6f9bd3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:03.090317 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc112a0-c5a2-43f2-b6d1-07f2ce6f9bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:03.090493 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc112a0-c5a2-43f2-b6d1-07f2ce6f9bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:03.123176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6cc112a0-c5a2-43f2-b6d1-07f2ce6f9bd3 None None] MFA Rules not processed for user `8489647547d544a681131dad99e058bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:03.125913 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6cc112a0-c5a2-43f2-b6d1-07f2ce6f9bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:03.133842 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 863/1710] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:03.133842 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194080bb-5707-4cff-b62f-9fca468dfe7e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:03.181966 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194080bb-5707-4cff-b62f-9fca468dfe7e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:03.195441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83710c5-3e8c-4b9e-9868-192a21677ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:03.196393 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83710c5-3e8c-4b9e-9868-192a21677ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:03.196699 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83710c5-3e8c-4b9e-9868-192a21677ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:03.196986 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83710c5-3e8c-4b9e-9868-192a21677ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:03.204470 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83710c5-3e8c-4b9e-9868-192a21677ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:03.208216 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83710c5-3e8c-4b9e-9868-192a21677ca0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:03.251672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 848/1711] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 27 05:06:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:03.253371 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc112a0-c5a2-43f2-b6d1-07f2ce6f9bd3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:03.255450 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6cc112a0-c5a2-43f2-b6d1-07f2ce6f9bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:03.281226 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 864/1712] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:03 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:03.282589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83710c5-3e8c-4b9e-9868-192a21677ca0 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:03.292045 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc112a0-c5a2-43f2-b6d1-07f2ce6f9bd3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:03.374585 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f548d66-cc88-4c30-a2db-a39e5cc581f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:03.375502 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f548d66-cc88-4c30-a2db-a39e5cc581f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:03.375777 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f548d66-cc88-4c30-a2db-a39e5cc581f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:03.376303 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f548d66-cc88-4c30-a2db-a39e5cc581f4 admin admin] PATH_INFO: `/v3/projects/14268d144b9b43e581c2c4104962c65f/users/23f6efe01e814ea8a87183ebe6a0a9ee/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:03.402461 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f548d66-cc88-4c30-a2db-a39e5cc581f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14268d144b9b43e581c2c4104962c65f, user_id=23f6efe01e814ea8a87183ebe6a0a9ee, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:03.409151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f548d66-cc88-4c30-a2db-a39e5cc581f4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:03.440881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 849/1713] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:03 2022] PUT /identity/v3/projects/14268d144b9b43e581c2c4104962c65f/users/23f6efe01e814ea8a87183ebe6a0a9ee/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:03.441106 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83710c5-3e8c-4b9e-9868-192a21677ca0 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:03.445652 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9866b01-712a-440d-9111-c978833e0ef6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:03.445947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9866b01-712a-440d-9111-c978833e0ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:03.446223 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9866b01-712a-440d-9111-c978833e0ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:03.565747 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b9866b01-712a-440d-9111-c978833e0ef6 None None] MFA Rules not processed for user `23f6efe01e814ea8a87183ebe6a0a9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:03.567717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b9866b01-712a-440d-9111-c978833e0ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:03.593671 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858805b-3cd9-4136-a6f1-75a7bf0d1902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:03.595471 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858805b-3cd9-4136-a6f1-75a7bf0d1902 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:03.597471 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858805b-3cd9-4136-a6f1-75a7bf0d1902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:03.599412 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858805b-3cd9-4136-a6f1-75a7bf0d1902 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:03.601491 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858805b-3cd9-4136-a6f1-75a7bf0d1902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:03.606984 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858805b-3cd9-4136-a6f1-75a7bf0d1902 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:03.656274 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 865/1714] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:03 2022] POST /identity/v3/users => generated 288 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:06:03.658090 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec920b-280e-4f6c-b4f1-9e2ac3970b21 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:03.658605 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec920b-280e-4f6c-b4f1-9e2ac3970b21 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:03.659127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec920b-280e-4f6c-b4f1-9e2ac3970b21 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:03.664046 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 866/1715] 10.222.0.27 () {54 vars in 960 bytes} [Tue Sep 27 05:06:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:06:03.667227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec920b-280e-4f6c-b4f1-9e2ac3970b21 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:03.703299 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec920b-280e-4f6c-b4f1-9e2ac3970b21 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:03.722575 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04179ec2-4bfd-44bc-91d0-95f2125060ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:03.724269 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04179ec2-4bfd-44bc-91d0-95f2125060ea admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:03.724559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04179ec2-4bfd-44bc-91d0-95f2125060ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:03.724963 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04179ec2-4bfd-44bc-91d0-95f2125060ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:03.737362 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04179ec2-4bfd-44bc-91d0-95f2125060ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:03.742620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04179ec2-4bfd-44bc-91d0-95f2125060ea admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:03.766941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 850/1716] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:03.766941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb219f2a-f61b-424c-8873-2b15ba06c51b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:03.766941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb219f2a-f61b-424c-8873-2b15ba06c51b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:03.766941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb219f2a-f61b-424c-8873-2b15ba06c51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:03.779808 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 867/1717] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:03.780942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04179ec2-4bfd-44bc-91d0-95f2125060ea admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:03.809628 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04179ec2-4bfd-44bc-91d0-95f2125060ea admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:03.815120 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-bb219f2a-f61b-424c-8873-2b15ba06c51b None None] MFA Rules not processed for user `8489647547d544a681131dad99e058bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:03.816207 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bb219f2a-f61b-424c-8873-2b15ba06c51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:03.824139 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab698b-4049-48e0-bc38-8d7ef5ec0740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:03.825220 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab698b-4049-48e0-bc38-8d7ef5ec0740 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:03.825508 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab698b-4049-48e0-bc38-8d7ef5ec0740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:03.825783 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab698b-4049-48e0-bc38-8d7ef5ec0740 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:03.826487 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab698b-4049-48e0-bc38-8d7ef5ec0740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:03.828453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab698b-4049-48e0-bc38-8d7ef5ec0740 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:03.891372 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 868/1718] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:03 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:03.895211 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab698b-4049-48e0-bc38-8d7ef5ec0740 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:04.057190 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 851/1719] 10.222.0.27 () {58 vars in 1057 bytes} [Tue Sep 27 05:06:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:04.058159 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb219f2a-f61b-424c-8873-2b15ba06c51b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:04.087868 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab698b-4049-48e0-bc38-8d7ef5ec0740 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:04.089639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb219f2a-f61b-424c-8873-2b15ba06c51b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:04.106693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faac4c4-2862-4750-845d-2673d95d8a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:04.107393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faac4c4-2862-4750-845d-2673d95d8a71 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:04.107676 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faac4c4-2862-4750-845d-2673d95d8a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:04.107953 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faac4c4-2862-4750-845d-2673d95d8a71 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:04.108676 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faac4c4-2862-4750-845d-2673d95d8a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:04.110686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faac4c4-2862-4750-845d-2673d95d8a71 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:04.112781 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae42aa2-5c9d-4d69-ba16-a44b332471a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:04.125148 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae42aa2-5c9d-4d69-ba16-a44b332471a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:04.125525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae42aa2-5c9d-4d69-ba16-a44b332471a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:04.125809 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae42aa2-5c9d-4d69-ba16-a44b332471a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:04.126673 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae42aa2-5c9d-4d69-ba16-a44b332471a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:04.128536 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae42aa2-5c9d-4d69-ba16-a44b332471a8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:04.150449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 869/1720] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:04.151128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae42aa2-5c9d-4d69-ba16-a44b332471a8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:04.194898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 852/1721] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:04 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:04.195999 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faac4c4-2862-4750-845d-2673d95d8a71 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:04.223622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faac4c4-2862-4750-845d-2673d95d8a71 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:04.245875 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334fff4-72c2-4b44-acc5-5a21bfd57b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:04.247459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334fff4-72c2-4b44-acc5-5a21bfd57b06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:04.250264 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334fff4-72c2-4b44-acc5-5a21bfd57b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:04.250557 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334fff4-72c2-4b44-acc5-5a21bfd57b06 admin admin] PATH_INFO: `/v3/projects/0fa86341da844a09a9bb2e14f85de228/users/b81201945f914b52a7434c57cbe45923/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:04.290229 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae42aa2-5c9d-4d69-ba16-a44b332471a8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:04.295066 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334fff4-72c2-4b44-acc5-5a21bfd57b06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa86341da844a09a9bb2e14f85de228, user_id=b81201945f914b52a7434c57cbe45923, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:04.301948 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334fff4-72c2-4b44-acc5-5a21bfd57b06 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:04.308259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db1008-62ea-4365-a92d-6d492ea907dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8489647547d544a681131dad99e058bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:04.309563 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db1008-62ea-4365-a92d-6d492ea907dd service placement] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:04.314205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db1008-62ea-4365-a92d-6d492ea907dd service placement] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:04.315414 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db1008-62ea-4365-a92d-6d492ea907dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:04.344877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 853/1722] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:04 2022] PUT /identity/v3/projects/0fa86341da844a09a9bb2e14f85de228/users/b81201945f914b52a7434c57cbe45923/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:04.344877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334fff4-72c2-4b44-acc5-5a21bfd57b06 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:04.365989 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db1008-62ea-4365-a92d-6d492ea907dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:04.371597 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db1008-62ea-4365-a92d-6d492ea907dd service placement] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:04.416822 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 870/1723] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:04.421194 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590988aa-2d2a-4616-bf48-5037889cb3ea None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:04.421500 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590988aa-2d2a-4616-bf48-5037889cb3ea None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:04.421764 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590988aa-2d2a-4616-bf48-5037889cb3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:04.532840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334fff4-72c2-4b44-acc5-5a21bfd57b06 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:04.536867 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-590988aa-2d2a-4616-bf48-5037889cb3ea None None] MFA Rules not processed for user `b81201945f914b52a7434c57cbe45923`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:04.539810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-590988aa-2d2a-4616-bf48-5037889cb3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:04.544910 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1fa52-8b1f-468e-86e2-2a0faa24e31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:04.545618 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1fa52-8b1f-468e-86e2-2a0faa24e31a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:04.545901 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1fa52-8b1f-468e-86e2-2a0faa24e31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:04.548490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1fa52-8b1f-468e-86e2-2a0faa24e31a admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:04.550002 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1fa52-8b1f-468e-86e2-2a0faa24e31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:04.551794 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1fa52-8b1f-468e-86e2-2a0faa24e31a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:04.596344 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 854/1724] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:04.603591 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1fa52-8b1f-468e-86e2-2a0faa24e31a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:04.634026 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1fa52-8b1f-468e-86e2-2a0faa24e31a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:04.647664 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804b502-ee40-41bd-b774-be53e3112410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:04.649257 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804b502-ee40-41bd-b774-be53e3112410 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:04.649541 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804b502-ee40-41bd-b774-be53e3112410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:04.649816 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804b502-ee40-41bd-b774-be53e3112410 admin admin] PATH_INFO: `/v3/projects/1f847b04c4094cceb496438b070f38a7/users/e5701febea7a454ab2c3a1ae31102a61/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:04.696113 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804b502-ee40-41bd-b774-be53e3112410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f847b04c4094cceb496438b070f38a7, user_id=e5701febea7a454ab2c3a1ae31102a61, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:04.703457 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804b502-ee40-41bd-b774-be53e3112410 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:04.752695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 855/1725] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:04 2022] PUT /identity/v3/projects/1f847b04c4094cceb496438b070f38a7/users/e5701febea7a454ab2c3a1ae31102a61/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:04.756734 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804b502-ee40-41bd-b774-be53e3112410 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:04.806181 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 871/1726] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:04.808127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20418387-4a47-4c64-bb1e-e5ad9b894095 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:04.808127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20418387-4a47-4c64-bb1e-e5ad9b894095 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:04.808353 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20418387-4a47-4c64-bb1e-e5ad9b894095 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:04.810693 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 872/1727] 10.222.0.27 () {54 vars in 912 bytes} [Tue Sep 27 05:06:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:06:04.811410 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20418387-4a47-4c64-bb1e-e5ad9b894095 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:04.924422 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804b502-ee40-41bd-b774-be53e3112410 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:04.964574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20418387-4a47-4c64-bb1e-e5ad9b894095 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:04.978646 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbb226-1eb0-4f03-83b7-7028ae87e3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:04.978937 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26850ca1-5e15-45e7-b7a3-5b104562965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:04.980083 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbb226-1eb0-4f03-83b7-7028ae87e3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:04.980470 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbb226-1eb0-4f03-83b7-7028ae87e3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:04.980941 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbb226-1eb0-4f03-83b7-7028ae87e3b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:04.981096 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26850ca1-5e15-45e7-b7a3-5b104562965a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:04.981397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26850ca1-5e15-45e7-b7a3-5b104562965a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:04.981856 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26850ca1-5e15-45e7-b7a3-5b104562965a admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:04.982086 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbb226-1eb0-4f03-83b7-7028ae87e3b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:04.982605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26850ca1-5e15-45e7-b7a3-5b104562965a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:04.984511 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbb226-1eb0-4f03-83b7-7028ae87e3b2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:04.984777 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26850ca1-5e15-45e7-b7a3-5b104562965a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:05.005381 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 856/1728] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:05.007492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320e7c-1e60-4dc1-8549-b9b9a8eb66b4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:05.007788 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320e7c-1e60-4dc1-8549-b9b9a8eb66b4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:05.008068 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320e7c-1e60-4dc1-8549-b9b9a8eb66b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:05.060189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 873/1729] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:04 2022] POST /identity/v3/projects => generated 377 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:05.065429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbb226-1eb0-4f03-83b7-7028ae87e3b2 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:05.136383 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7a320e7c-1e60-4dc1-8549-b9b9a8eb66b4 None None] MFA Rules not processed for user `639126e5b13345cda6490073ec57f4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:05.139346 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7a320e7c-1e60-4dc1-8549-b9b9a8eb66b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:05.254835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 857/1730] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 27 05:06:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:05.256341 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a320e7c-1e60-4dc1-8549-b9b9a8eb66b4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:05.297043 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbb226-1eb0-4f03-83b7-7028ae87e3b2 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:05.311279 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c9be2-a26c-4c4e-8d6c-b95ad275d660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:05.312200 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c9be2-a26c-4c4e-8d6c-b95ad275d660 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:05.312474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c9be2-a26c-4c4e-8d6c-b95ad275d660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:05.312754 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c9be2-a26c-4c4e-8d6c-b95ad275d660 admin admin] PATH_INFO: `/v3/projects/1f847b04c4094cceb496438b070f38a7/users/e5701febea7a454ab2c3a1ae31102a61/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:05.318320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c9be2-a26c-4c4e-8d6c-b95ad275d660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f847b04c4094cceb496438b070f38a7, user_id=e5701febea7a454ab2c3a1ae31102a61, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:05.321312 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c9be2-a26c-4c4e-8d6c-b95ad275d660 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:05.356252 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 874/1731] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:05 2022] PUT /identity/v3/projects/1f847b04c4094cceb496438b070f38a7/users/e5701febea7a454ab2c3a1ae31102a61/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:05.357742 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c9be2-a26c-4c4e-8d6c-b95ad275d660 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:05.367190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-465c9be2-a26c-4c4e-8d6c-b95ad275d660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:05.409050 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a320e7c-1e60-4dc1-8549-b9b9a8eb66b4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:05.466966 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c9be2-a26c-4c4e-8d6c-b95ad275d660 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:05.475688 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:05.476945 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:05.477228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:05.477531 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a admin admin] PATH_INFO: `/v3/projects/b690db6e90784ab5844ea6cf7cf8203d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:05.479146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b690db6e90784ab5844ea6cf7cf8203d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:05.482392 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:05.484884 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962abd7-f845-49ff-8f6a-7a56a14db1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:05.485580 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962abd7-f845-49ff-8f6a-7a56a14db1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:05.486049 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962abd7-f845-49ff-8f6a-7a56a14db1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:05.486333 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962abd7-f845-49ff-8f6a-7a56a14db1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:05.487176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962abd7-f845-49ff-8f6a-7a56a14db1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:05.490013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962abd7-f845-49ff-8f6a-7a56a14db1a5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:05.536172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 858/1732] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:05 2022] POST /identity/v3/users => generated 295 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:05.537966 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962abd7-f845-49ff-8f6a-7a56a14db1a5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:05.542960 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2962abd7-f845-49ff-8f6a-7a56a14db1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:05.548771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b690db6e90784ab5844ea6cf7cf8203d', 'request_id': 'req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:05.558644 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b690db6e90784ab5844ea6cf7cf8203d', 'request_id': 'req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:05.574022 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962abd7-f845-49ff-8f6a-7a56a14db1a5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:05.576565 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b690db6e90784ab5844ea6cf7cf8203d', 'request_id': 'req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:05.607109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a admin admin] The token cache is being invalidate because project b690db6e90784ab5844ea6cf7cf8203d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:05.607401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:05.609271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:05.611664 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 875/1733] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:05 2022] DELETE /identity/v3/projects/b690db6e90784ab5844ea6cf7cf8203d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:05.617762 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:05.619625 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:05.676156 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512927e-578f-48d4-a0fd-2c10dccb5296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:05.677765 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512927e-578f-48d4-a0fd-2c10dccb5296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:05.678340 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512927e-578f-48d4-a0fd-2c10dccb5296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:05.678767 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512927e-578f-48d4-a0fd-2c10dccb5296 admin admin] PATH_INFO: `/v3/projects/a6620801c7c94e5bb9b54033f23382a3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:05.680504 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512927e-578f-48d4-a0fd-2c10dccb5296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6620801c7c94e5bb9b54033f23382a3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:05.682696 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512927e-578f-48d4-a0fd-2c10dccb5296 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:05.713757 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d7929-e8ca-4532-aa70-2e2a0debbc2a admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:05.730333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016904e-68d7-4038-9a99-e27ce024463a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:05.731694 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016904e-68d7-4038-9a99-e27ce024463a service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:05.732125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016904e-68d7-4038-9a99-e27ce024463a service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:05.732660 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016904e-68d7-4038-9a99-e27ce024463a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:05.734735 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6016904e-68d7-4038-9a99-e27ce024463a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:05.751841 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016904e-68d7-4038-9a99-e27ce024463a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:05.754301 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016904e-68d7-4038-9a99-e27ce024463a service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:05.788215 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 876/1734] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:05.792916 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ad737-17f3-4f47-842a-ed6e5ee0308a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:05.793485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ad737-17f3-4f47-842a-ed6e5ee0308a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:05.794108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ad737-17f3-4f47-842a-ed6e5ee0308a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:05.811562 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0512927e-578f-48d4-a0fd-2c10dccb5296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6620801c7c94e5bb9b54033f23382a3', 'request_id': 'req-0512927e-578f-48d4-a0fd-2c10dccb5296'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:05.834386 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0512927e-578f-48d4-a0fd-2c10dccb5296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6620801c7c94e5bb9b54033f23382a3', 'request_id': 'req-0512927e-578f-48d4-a0fd-2c10dccb5296'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:05.838681 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-960ad737-17f3-4f47-842a-ed6e5ee0308a None None] MFA Rules not processed for user `e5701febea7a454ab2c3a1ae31102a61`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:05.840489 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-960ad737-17f3-4f47-842a-ed6e5ee0308a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:05.848458 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0512927e-578f-48d4-a0fd-2c10dccb5296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6620801c7c94e5bb9b54033f23382a3', 'request_id': 'req-0512927e-578f-48d4-a0fd-2c10dccb5296'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:05.892080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0512927e-578f-48d4-a0fd-2c10dccb5296 admin admin] The token cache is being invalidate because project a6620801c7c94e5bb9b54033f23382a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:05.893767 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0512927e-578f-48d4-a0fd-2c10dccb5296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:05.897606 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0512927e-578f-48d4-a0fd-2c10dccb5296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:05.899836 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 859/1735] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:05 2022] DELETE /identity/v3/projects/a6620801c7c94e5bb9b54033f23382a3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:05.902933 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f43e6-a6b2-42f5-b962-205e1f6f9f96 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:05.903412 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f43e6-a6b2-42f5-b962-205e1f6f9f96 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:05.904487 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f43e6-a6b2-42f5-b962-205e1f6f9f96 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:05.909738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 860/1736] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 27 05:06:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:06:05.912948 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b0c01-85de-4b62-b996-bf580fb9ff73 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:05.914511 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b0c01-85de-4b62-b996-bf580fb9ff73 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:05.914984 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b0c01-85de-4b62-b996-bf580fb9ff73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:05.974474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 877/1737] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:05.976094 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ad737-17f3-4f47-842a-ed6e5ee0308a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:05.980161 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-960ad737-17f3-4f47-842a-ed6e5ee0308a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:05.982674 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ac3b0c01-85de-4b62-b996-bf580fb9ff73 None None] MFA Rules not processed for user `86f1f7433c86479a88c84b9176bcbb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:05.986882 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ac3b0c01-85de-4b62-b996-bf580fb9ff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:06.128533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ad737-17f3-4f47-842a-ed6e5ee0308a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:06.143787 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2893e0d-1e10-464a-abac-1d8bb20272cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:06.144834 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2893e0d-1e10-464a-abac-1d8bb20272cb admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:06.145123 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2893e0d-1e10-464a-abac-1d8bb20272cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:06.145393 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2893e0d-1e10-464a-abac-1d8bb20272cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:06.146127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2893e0d-1e10-464a-abac-1d8bb20272cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:06.156878 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 861/1738] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:06.156878 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b0c01-85de-4b62-b996-bf580fb9ff73 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:06.156878 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ac3b0c01-85de-4b62-b996-bf580fb9ff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:06.157542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2893e0d-1e10-464a-abac-1d8bb20272cb admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:06.173782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 878/1739] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:06.176828 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9f762-3929-4dff-9ae9-b14818d5c9ea None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:06.179182 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b0c01-85de-4b62-b996-bf580fb9ff73 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:06.179705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9f762-3929-4dff-9ae9-b14818d5c9ea None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:06.180149 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9f762-3929-4dff-9ae9-b14818d5c9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:06.191584 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269c2f5-8a4e-4f43-949a-55d5c50d6a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:06.192759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c2f5-8a4e-4f43-949a-55d5c50d6a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:06.194034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c2f5-8a4e-4f43-949a-55d5c50d6a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:06.194503 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269c2f5-8a4e-4f43-949a-55d5c50d6a01 admin admin] PATH_INFO: `/v3/users/5cfd3811527a48aba4bd6228a9eda91d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:06.198171 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269c2f5-8a4e-4f43-949a-55d5c50d6a01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cfd3811527a48aba4bd6228a9eda91d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:06.205105 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269c2f5-8a4e-4f43-949a-55d5c50d6a01 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:06.217490 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-87a9f762-3929-4dff-9ae9-b14818d5c9ea None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:06.223788 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-87a9f762-3929-4dff-9ae9-b14818d5c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:06.263322 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 879/1740] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:06.267510 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff855e-f769-49b5-ada4-911f66db3eb8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:06.267799 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff855e-f769-49b5-ada4-911f66db3eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:06.269288 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff855e-f769-49b5-ada4-911f66db3eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:06.315993 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-baff855e-f769-49b5-ada4-911f66db3eb8 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:06.323504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-baff855e-f769-49b5-ada4-911f66db3eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:06.323671 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3269c2f5-8a4e-4f43-949a-55d5c50d6a01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cfd3811527a48aba4bd6228a9eda91d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:06.324395 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3269c2f5-8a4e-4f43-949a-55d5c50d6a01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cfd3811527a48aba4bd6228a9eda91d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:06.325109 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3269c2f5-8a4e-4f43-949a-55d5c50d6a01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cfd3811527a48aba4bd6228a9eda91d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:06.342740 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 880/1741] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:06.342912 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3269c2f5-8a4e-4f43-949a-55d5c50d6a01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cfd3811527a48aba4bd6228a9eda91d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:06.344714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499727a-56a7-4c64-9d08-3754ccecc874 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:06.345219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499727a-56a7-4c64-9d08-3754ccecc874 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:06.345685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499727a-56a7-4c64-9d08-3754ccecc874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:06.363081 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3269c2f5-8a4e-4f43-949a-55d5c50d6a01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cfd3811527a48aba4bd6228a9eda91d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:06.388290 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 862/1742] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:06 2022] DELETE /identity/v3/users/5cfd3811527a48aba4bd6228a9eda91d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:06.389390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269c2f5-8a4e-4f43-949a-55d5c50d6a01 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:06.390770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3269c2f5-8a4e-4f43-949a-55d5c50d6a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:06.396862 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f499727a-56a7-4c64-9d08-3754ccecc874 None None] MFA Rules not processed for user `8489647547d544a681131dad99e058bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:06.398634 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f499727a-56a7-4c64-9d08-3754ccecc874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:06.510527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 881/1743] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 27 05:06:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:06.512065 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b99720-8827-4aad-8fb0-b40429b65711 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:06.512463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b99720-8827-4aad-8fb0-b40429b65711 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:06.512837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b99720-8827-4aad-8fb0-b40429b65711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:06.542419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269c2f5-8a4e-4f43-949a-55d5c50d6a01 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:06.550727 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a512c-e917-4b03-9a62-5e03b2b65bd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:06.551814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-70b99720-8827-4aad-8fb0-b40429b65711 None None] MFA Rules not processed for user `86f1f7433c86479a88c84b9176bcbb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:06.551950 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a512c-e917-4b03-9a62-5e03b2b65bd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:06.553196 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a512c-e917-4b03-9a62-5e03b2b65bd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:06.553975 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-70b99720-8827-4aad-8fb0-b40429b65711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:06.554777 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a512c-e917-4b03-9a62-5e03b2b65bd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:06.570800 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-df3a512c-e917-4b03-9a62-5e03b2b65bd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:06.688089 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a512c-e917-4b03-9a62-5e03b2b65bd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:06.695292 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a512c-e917-4b03-9a62-5e03b2b65bd2 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:06.723014 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 882/1744] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:06.725747 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b99720-8827-4aad-8fb0-b40429b65711 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:06.729341 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-70b99720-8827-4aad-8fb0-b40429b65711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:06.736559 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 863/1745] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:06.737749 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef54942-1ab8-4609-880d-5a5765b77509 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:06.738039 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef54942-1ab8-4609-880d-5a5765b77509 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:06.738331 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef54942-1ab8-4609-880d-5a5765b77509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:06.791051 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9ef54942-1ab8-4609-880d-5a5765b77509 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:06.791984 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9ef54942-1ab8-4609-880d-5a5765b77509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:06.986551 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b99720-8827-4aad-8fb0-b40429b65711 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:06.993064 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf252d-b477-47af-b971-1e3afa0c30fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:06.993971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf252d-b477-47af-b971-1e3afa0c30fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:06.994249 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf252d-b477-47af-b971-1e3afa0c30fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:06.994519 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf252d-b477-47af-b971-1e3afa0c30fb admin admin] PATH_INFO: `/v3/projects/14e3716c7b944b8db3d6472c53114cf7/users/77f18cc1d797447795c4aea48d50aa76/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:07.042377 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 864/1746] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:07.043855 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dec3d-0662-4540-b187-89073d512697 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:07.044193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dec3d-0662-4540-b187-89073d512697 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:07.044485 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dec3d-0662-4540-b187-89073d512697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:07.054189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf252d-b477-47af-b971-1e3afa0c30fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e3716c7b944b8db3d6472c53114cf7, user_id=77f18cc1d797447795c4aea48d50aa76, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:07.065342 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf252d-b477-47af-b971-1e3afa0c30fb admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:07.084210 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7e0dec3d-0662-4540-b187-89073d512697 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:07.089771 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7e0dec3d-0662-4540-b187-89073d512697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:07.109251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 883/1747] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:06 2022] PUT /identity/v3/projects/14e3716c7b944b8db3d6472c53114cf7/users/77f18cc1d797447795c4aea48d50aa76/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:07.113840 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf252d-b477-47af-b971-1e3afa0c30fb admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:07.118544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-abcf252d-b477-47af-b971-1e3afa0c30fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:07.287742 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 865/1748] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:07.289221 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dec3d-0662-4540-b187-89073d512697 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:07.290580 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7e0dec3d-0662-4540-b187-89073d512697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:07.365861 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf252d-b477-47af-b971-1e3afa0c30fb admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:07.384594 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0624e-587a-4cf1-8fff-36fa5abdeb2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8489647547d544a681131dad99e058bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:07.385623 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0624e-587a-4cf1-8fff-36fa5abdeb2a service placement] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:07.385918 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0624e-587a-4cf1-8fff-36fa5abdeb2a service placement] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:07.386431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0624e-587a-4cf1-8fff-36fa5abdeb2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:07.427316 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0624e-587a-4cf1-8fff-36fa5abdeb2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:07.431575 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0624e-587a-4cf1-8fff-36fa5abdeb2a service placement] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:07.453171 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 884/1749] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:07.453445 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dec3d-0662-4540-b187-89073d512697 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:07.454427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0624e-587a-4cf1-8fff-36fa5abdeb2a service placement] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:07.456889 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8de0624e-587a-4cf1-8fff-36fa5abdeb2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:07.488172 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0624e-587a-4cf1-8fff-36fa5abdeb2a service placement] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:07.494625 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0cb3b-33f4-4578-af8d-b24bcdadce96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:07.495842 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0cb3b-33f4-4578-af8d-b24bcdadce96 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:07.496277 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0cb3b-33f4-4578-af8d-b24bcdadce96 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:07.497161 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0cb3b-33f4-4578-af8d-b24bcdadce96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:07.504887 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaad84e-830a-4693-a45a-cf3b687d0384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:07.506731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-50d0cb3b-33f4-4578-af8d-b24bcdadce96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:07.508097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaad84e-830a-4693-a45a-cf3b687d0384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:07.508425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaad84e-830a-4693-a45a-cf3b687d0384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:07.508814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaad84e-830a-4693-a45a-cf3b687d0384 admin admin] PATH_INFO: `/v3/projects/975400281ea34db0aa36b1d5dc45522f` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:07.511066 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaad84e-830a-4693-a45a-cf3b687d0384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=975400281ea34db0aa36b1d5dc45522f)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:07.519774 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaad84e-830a-4693-a45a-cf3b687d0384 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:07.612431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1eaad84e-830a-4693-a45a-cf3b687d0384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '975400281ea34db0aa36b1d5dc45522f', 'request_id': 'req-1eaad84e-830a-4693-a45a-cf3b687d0384'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:07.624278 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1eaad84e-830a-4693-a45a-cf3b687d0384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '975400281ea34db0aa36b1d5dc45522f', 'request_id': 'req-1eaad84e-830a-4693-a45a-cf3b687d0384'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:07.642353 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1eaad84e-830a-4693-a45a-cf3b687d0384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '975400281ea34db0aa36b1d5dc45522f', 'request_id': 'req-1eaad84e-830a-4693-a45a-cf3b687d0384'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:07.666365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1eaad84e-830a-4693-a45a-cf3b687d0384 admin admin] The token cache is being invalidate because project 975400281ea34db0aa36b1d5dc45522f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:07.666718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1eaad84e-830a-4693-a45a-cf3b687d0384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:07.667602 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1eaad84e-830a-4693-a45a-cf3b687d0384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:07.669497 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0cb3b-33f4-4578-af8d-b24bcdadce96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:07.670137 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 885/1750] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:07 2022] DELETE /identity/v3/projects/975400281ea34db0aa36b1d5dc45522f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:07.671007 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaad84e-830a-4693-a45a-cf3b687d0384 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:07.672361 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1eaad84e-830a-4693-a45a-cf3b687d0384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:07.672460 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0cb3b-33f4-4578-af8d-b24bcdadce96 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:07.706180 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 866/1751] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:07.709522 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0cb3b-33f4-4578-af8d-b24bcdadce96 service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:07.722009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0cb3b-33f4-4578-af8d-b24bcdadce96 service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:07.760874 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaad84e-830a-4693-a45a-cf3b687d0384 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:07.769532 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e0ab9-79d4-4b04-85b7-ef7362c08253 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8489647547d544a681131dad99e058bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:07.769878 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e0ab9-79d4-4b04-85b7-ef7362c08253 service placement] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:07.770161 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e0ab9-79d4-4b04-85b7-ef7362c08253 service placement] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:07.771147 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e0ab9-79d4-4b04-85b7-ef7362c08253 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:07.773608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9b3e0ab9-79d4-4b04-85b7-ef7362c08253 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:07.789819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e0ab9-79d4-4b04-85b7-ef7362c08253 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:07.792355 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e0ab9-79d4-4b04-85b7-ef7362c08253 service placement] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:07.804819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9151e6-b93f-469a-8965-897611976732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:07.805604 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9151e6-b93f-469a-8965-897611976732 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:07.805958 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9151e6-b93f-469a-8965-897611976732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:07.806441 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9151e6-b93f-469a-8965-897611976732 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:07.807250 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9151e6-b93f-469a-8965-897611976732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:07.807680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9151e6-b93f-469a-8965-897611976732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:07.808493 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 886/1752] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:07.809478 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e0ab9-79d4-4b04-85b7-ef7362c08253 service placement] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:07.811022 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9b3e0ab9-79d4-4b04-85b7-ef7362c08253 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:07.825844 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9151e6-b93f-469a-8965-897611976732 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:07.825985 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e0ab9-79d4-4b04-85b7-ef7362c08253 service placement] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:07.831633 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c0b9f-f1ce-453e-b0d4-c673e92801b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:07.832549 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0b9f-f1ce-453e-b0d4-c673e92801b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:07.832922 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0b9f-f1ce-453e-b0d4-c673e92801b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:07.833258 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0b9f-f1ce-453e-b0d4-c673e92801b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:07.834169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c0b9f-f1ce-453e-b0d4-c673e92801b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:07.836549 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c0b9f-f1ce-453e-b0d4-c673e92801b9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:07.848529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 887/1753] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:07.850193 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c0b9f-f1ce-453e-b0d4-c673e92801b9 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:07.852696 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fa8c0b9f-f1ce-453e-b0d4-c673e92801b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:07.868109 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 867/1754] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:07.869310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd256f89-b3dc-4368-ba3e-25c6de614439 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:07.869601 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd256f89-b3dc-4368-ba3e-25c6de614439 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:07.869880 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd256f89-b3dc-4368-ba3e-25c6de614439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:07.871817 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c0b9f-f1ce-453e-b0d4-c673e92801b9 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:07.876968 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ed9c3-e4e9-42fe-a08e-f23472139cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:07.877890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ed9c3-e4e9-42fe-a08e-f23472139cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:07.878168 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ed9c3-e4e9-42fe-a08e-f23472139cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:07.878440 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ed9c3-e4e9-42fe-a08e-f23472139cb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:07.879208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ed9c3-e4e9-42fe-a08e-f23472139cb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:07.879453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ed9c3-e4e9-42fe-a08e-f23472139cb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:07.881985 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ed9c3-e4e9-42fe-a08e-f23472139cb2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:07.914048 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-bd256f89-b3dc-4368-ba3e-25c6de614439 None None] MFA Rules not processed for user `43aeedbf8ef94c969eba750306890f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:07.915460 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bd256f89-b3dc-4368-ba3e-25c6de614439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:07.919716 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 888/1755] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:07.923496 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ed9c3-e4e9-42fe-a08e-f23472139cb2 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:07.927175 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0b4ed9c3-e4e9-42fe-a08e-f23472139cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:08.049746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 868/1756] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:08.055073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd256f89-b3dc-4368-ba3e-25c6de614439 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:08.056636 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bd256f89-b3dc-4368-ba3e-25c6de614439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:08.083896 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd256f89-b3dc-4368-ba3e-25c6de614439 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:08.085285 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ed9c3-e4e9-42fe-a08e-f23472139cb2 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:08.093450 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9066cbe-7271-4318-90d2-e3fac80e5015 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5701febea7a454ab2c3a1ae31102a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f847b04c4094cceb496438b070f38a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:08.095004 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9066cbe-7271-4318-90d2-e3fac80e5015 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:08.095765 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9066cbe-7271-4318-90d2-e3fac80e5015 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:08.096190 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27580126-f005-4123-8277-cfed6fa34737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:08.096565 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9066cbe-7271-4318-90d2-e3fac80e5015 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:08.097606 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27580126-f005-4123-8277-cfed6fa34737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:08.102448 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9066cbe-7271-4318-90d2-e3fac80e5015 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:08.103339 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9066cbe-7271-4318-90d2-e3fac80e5015 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:08.103746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27580126-f005-4123-8277-cfed6fa34737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:08.104235 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27580126-f005-4123-8277-cfed6fa34737 admin admin] PATH_INFO: `/v3/users/661617a587384f2ab360f9a278e61baf` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:08.106129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9066cbe-7271-4318-90d2-e3fac80e5015 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:08.109419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27580126-f005-4123-8277-cfed6fa34737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=661617a587384f2ab360f9a278e61baf)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:08.112010 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27580126-f005-4123-8277-cfed6fa34737 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:08.145050 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 889/1757] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:08.153181 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a281228-c2d7-455d-b595-d5699d7108ec None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:08.153474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a281228-c2d7-455d-b595-d5699d7108ec None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:08.155921 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a281228-c2d7-455d-b595-d5699d7108ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:08.246304 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7a281228-c2d7-455d-b595-d5699d7108ec None None] MFA Rules not processed for user `6a6685057ae24345b4067cffb06b7f63`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:08.247555 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7a281228-c2d7-455d-b595-d5699d7108ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:08.251862 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-27580126-f005-4123-8277-cfed6fa34737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661617a587384f2ab360f9a278e61baf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:08.254347 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-27580126-f005-4123-8277-cfed6fa34737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661617a587384f2ab360f9a278e61baf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:08.255071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-27580126-f005-4123-8277-cfed6fa34737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661617a587384f2ab360f9a278e61baf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:08.274495 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-27580126-f005-4123-8277-cfed6fa34737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661617a587384f2ab360f9a278e61baf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:08.300962 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-27580126-f005-4123-8277-cfed6fa34737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661617a587384f2ab360f9a278e61baf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:08.331351 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 869/1758] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:08 2022] DELETE /identity/v3/users/661617a587384f2ab360f9a278e61baf => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:08.350184 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27580126-f005-4123-8277-cfed6fa34737 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:08.352395 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-27580126-f005-4123-8277-cfed6fa34737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:08.489941 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 890/1759] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:08.500043 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a281228-c2d7-455d-b595-d5699d7108ec None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:08.504897 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7a281228-c2d7-455d-b595-d5699d7108ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:08.522853 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27580126-f005-4123-8277-cfed6fa34737 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:08.539512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926eff4b-f368-4515-9ca0-7511a5ae980e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:08.540359 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926eff4b-f368-4515-9ca0-7511a5ae980e admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:08.540637 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926eff4b-f368-4515-9ca0-7511a5ae980e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:08.545356 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926eff4b-f368-4515-9ca0-7511a5ae980e admin admin] PATH_INFO: `/v3/projects/14e3716c7b944b8db3d6472c53114cf7/users/77f18cc1d797447795c4aea48d50aa76/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:08.546686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a281228-c2d7-455d-b595-d5699d7108ec None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:08.553669 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926eff4b-f368-4515-9ca0-7511a5ae980e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e3716c7b944b8db3d6472c53114cf7, user_id=77f18cc1d797447795c4aea48d50aa76, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:08.555986 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926eff4b-f368-4515-9ca0-7511a5ae980e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:08.559204 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56152d-f801-4efd-9441-c0ccca1c12ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:08.559891 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56152d-f801-4efd-9441-c0ccca1c12ef admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:08.560173 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56152d-f801-4efd-9441-c0ccca1c12ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:08.560449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56152d-f801-4efd-9441-c0ccca1c12ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:08.561261 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56152d-f801-4efd-9441-c0ccca1c12ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:08.565060 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56152d-f801-4efd-9441-c0ccca1c12ef admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:08.600603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 870/1760] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:08 2022] PUT /identity/v3/projects/14e3716c7b944b8db3d6472c53114cf7/users/77f18cc1d797447795c4aea48d50aa76/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:08.601907 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926eff4b-f368-4515-9ca0-7511a5ae980e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:08.612248 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-926eff4b-f368-4515-9ca0-7511a5ae980e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:08.650337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 891/1761] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:08 2022] POST /identity/v3/projects => generated 369 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:08.650337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56152d-f801-4efd-9441-c0ccca1c12ef admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:08.653572 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6a56152d-f801-4efd-9441-c0ccca1c12ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:08.734887 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926eff4b-f368-4515-9ca0-7511a5ae980e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:08.818035 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56152d-f801-4efd-9441-c0ccca1c12ef admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:08.837144 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472dcd0b-7b09-4ca2-86df-f143189684d8 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5701febea7a454ab2c3a1ae31102a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f847b04c4094cceb496438b070f38a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:08.838196 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dcd0b-7b09-4ca2-86df-f143189684d8 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:08.838699 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dcd0b-7b09-4ca2-86df-f143189684d8 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:08.839808 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dcd0b-7b09-4ca2-86df-f143189684d8 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:08.842167 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dcd0b-7b09-4ca2-86df-f143189684d8 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:08.852038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dcd0b-7b09-4ca2-86df-f143189684d8 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:08.912473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d86c0-c186-47c0-baf9-6dd9b6294ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:08.915839 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d86c0-c186-47c0-baf9-6dd9b6294ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:08.915839 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d86c0-c186-47c0-baf9-6dd9b6294ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:08.916082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d86c0-c186-47c0-baf9-6dd9b6294ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:08.919172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d86c0-c186-47c0-baf9-6dd9b6294ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:08.921751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d86c0-c186-47c0-baf9-6dd9b6294ed7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:08.930169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 892/1762] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:08 2022] POST /identity/v3/projects => generated 353 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:08.932243 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a190bf-c92d-4abb-b93a-ccd8c3fb3b23 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:08.932243 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a190bf-c92d-4abb-b93a-ccd8c3fb3b23 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:08.932427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a190bf-c92d-4abb-b93a-ccd8c3fb3b23 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:08.934515 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 893/1763] 10.222.0.27 () {54 vars in 912 bytes} [Tue Sep 27 05:06:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:06:08.935254 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a190bf-c92d-4abb-b93a-ccd8c3fb3b23 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:08.942132 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d8a190bf-c92d-4abb-b93a-ccd8c3fb3b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:08.974813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 871/1764] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:08 2022] POST /identity/v3/projects => generated 365 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:08.976718 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09913aba-37ae-48a5-98df-cbc8851ae0df None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:08.977071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09913aba-37ae-48a5-98df-cbc8851ae0df None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:08.977336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09913aba-37ae-48a5-98df-cbc8851ae0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:09.042588 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-09913aba-37ae-48a5-98df-cbc8851ae0df None None] MFA Rules not processed for user `77f18cc1d797447795c4aea48d50aa76`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:09.043609 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-09913aba-37ae-48a5-98df-cbc8851ae0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:09.088419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a190bf-c92d-4abb-b93a-ccd8c3fb3b23 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:09.167747 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e3d4c-ec01-4347-83b2-f57c3971190d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:09.169104 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e3d4c-ec01-4347-83b2-f57c3971190d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:09.169491 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e3d4c-ec01-4347-83b2-f57c3971190d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:09.169868 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e3d4c-ec01-4347-83b2-f57c3971190d admin admin] PATH_INFO: `/v3/projects/75a914285c094ae0b2611a3967b7c597` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:09.172312 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e3d4c-ec01-4347-83b2-f57c3971190d admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a914285c094ae0b2611a3967b7c597)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:09.175070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e3d4c-ec01-4347-83b2-f57c3971190d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:09.190254 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 872/1765] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:09.191352 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09913aba-37ae-48a5-98df-cbc8851ae0df None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:09.251380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6c3e3d4c-ec01-4347-83b2-f57c3971190d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a914285c094ae0b2611a3967b7c597', 'request_id': 'req-6c3e3d4c-ec01-4347-83b2-f57c3971190d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:09.257218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09913aba-37ae-48a5-98df-cbc8851ae0df None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:09.260520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6c3e3d4c-ec01-4347-83b2-f57c3971190d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a914285c094ae0b2611a3967b7c597', 'request_id': 'req-6c3e3d4c-ec01-4347-83b2-f57c3971190d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:09.277767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6c3e3d4c-ec01-4347-83b2-f57c3971190d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a914285c094ae0b2611a3967b7c597', 'request_id': 'req-6c3e3d4c-ec01-4347-83b2-f57c3971190d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:09.313100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6c3e3d4c-ec01-4347-83b2-f57c3971190d admin admin] The token cache is being invalidate because project 75a914285c094ae0b2611a3967b7c597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:09.313401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6c3e3d4c-ec01-4347-83b2-f57c3971190d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:09.314272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6c3e3d4c-ec01-4347-83b2-f57c3971190d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:09.320031 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 894/1766] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:08 2022] DELETE /identity/v3/projects/75a914285c094ae0b2611a3967b7c597 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:09.321122 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e3d4c-ec01-4347-83b2-f57c3971190d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:09.322762 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6c3e3d4c-ec01-4347-83b2-f57c3971190d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:09.425679 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e3d4c-ec01-4347-83b2-f57c3971190d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:09.431649 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f7235-a41b-4891-a87b-e0d37b5fcdbd tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5701febea7a454ab2c3a1ae31102a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f847b04c4094cceb496438b070f38a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:09.432470 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7235-a41b-4891-a87b-e0d37b5fcdbd tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:09.432846 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7235-a41b-4891-a87b-e0d37b5fcdbd tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:09.433202 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7235-a41b-4891-a87b-e0d37b5fcdbd tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:09.434507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f7235-a41b-4891-a87b-e0d37b5fcdbd tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:09.434507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f7235-a41b-4891-a87b-e0d37b5fcdbd tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:09.436029 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f7235-a41b-4891-a87b-e0d37b5fcdbd tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:09.449883 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 895/1767] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:09.451113 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd13d7-09ff-4242-848f-55f3f78c1d56 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:09.451753 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd13d7-09ff-4242-848f-55f3f78c1d56 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:09.452109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd13d7-09ff-4242-848f-55f3f78c1d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:09.452784 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dfcad-6c42-4912-be7f-b9f3c858a20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:09.454665 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dfcad-6c42-4912-be7f-b9f3c858a20a admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:09.455606 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dfcad-6c42-4912-be7f-b9f3c858a20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:09.456023 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dfcad-6c42-4912-be7f-b9f3c858a20a admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:09.456888 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605dfcad-6c42-4912-be7f-b9f3c858a20a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:09.460656 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605dfcad-6c42-4912-be7f-b9f3c858a20a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:09.472993 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7edd13d7-09ff-4242-848f-55f3f78c1d56 None None] MFA Rules not processed for user `639126e5b13345cda6490073ec57f4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:09.474295 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7edd13d7-09ff-4242-848f-55f3f78c1d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:09.507338 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 873/1768] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:09 2022] POST /identity/v3/users => generated 285 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:09.514266 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dfcad-6c42-4912-be7f-b9f3c858a20a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:09.518317 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-605dfcad-6c42-4912-be7f-b9f3c858a20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:09.536768 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dfcad-6c42-4912-be7f-b9f3c858a20a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:09.548749 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549eebbb-07d7-4a27-883d-6821124a6767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:09.550144 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549eebbb-07d7-4a27-883d-6821124a6767 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:09.553743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549eebbb-07d7-4a27-883d-6821124a6767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:09.554211 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549eebbb-07d7-4a27-883d-6821124a6767 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:09.555188 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549eebbb-07d7-4a27-883d-6821124a6767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:09.557294 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549eebbb-07d7-4a27-883d-6821124a6767 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:09.577366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 896/1769] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 27 05:06:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:09.578249 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd13d7-09ff-4242-848f-55f3f78c1d56 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:09.579717 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7edd13d7-09ff-4242-848f-55f3f78c1d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:09.623965 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 874/1770] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:09 2022] POST /identity/v3/users => generated 283 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:09.638230 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c1634-a06d-437b-a017-4e9c7f8b7e4d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:09.638611 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c1634-a06d-437b-a017-4e9c7f8b7e4d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:09.638907 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c1634-a06d-437b-a017-4e9c7f8b7e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:09.643321 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd13d7-09ff-4242-848f-55f3f78c1d56 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:09.648233 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048cafc-1ffb-434f-9b06-7a67218de21c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:09.648925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048cafc-1ffb-434f-9b06-7a67218de21c service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:09.649209 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048cafc-1ffb-434f-9b06-7a67218de21c service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:09.649499 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048cafc-1ffb-434f-9b06-7a67218de21c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:09.651654 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e048cafc-1ffb-434f-9b06-7a67218de21c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:09.686056 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8f5c1634-a06d-437b-a017-4e9c7f8b7e4d None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:09.691603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8f5c1634-a06d-437b-a017-4e9c7f8b7e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:09.717158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 875/1771] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:09.718178 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c1634-a06d-437b-a017-4e9c7f8b7e4d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:09.719645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8f5c1634-a06d-437b-a017-4e9c7f8b7e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:09.742737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048cafc-1ffb-434f-9b06-7a67218de21c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:09.749374 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048cafc-1ffb-434f-9b06-7a67218de21c service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:09.773216 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 897/1772] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:09.775033 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048cafc-1ffb-434f-9b06-7a67218de21c service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:09.791395 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e048cafc-1ffb-434f-9b06-7a67218de21c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:09.826751 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048cafc-1ffb-434f-9b06-7a67218de21c service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:09.832108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef354f2-e9ea-4ffb-9959-08d116a9369e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:09.833039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef354f2-e9ea-4ffb-9959-08d116a9369e admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:09.833594 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef354f2-e9ea-4ffb-9959-08d116a9369e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:09.834498 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef354f2-e9ea-4ffb-9959-08d116a9369e admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:09.835431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef354f2-e9ea-4ffb-9959-08d116a9369e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:09.837320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef354f2-e9ea-4ffb-9959-08d116a9369e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:09.860396 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 898/1773] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:09.861648 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef354f2-e9ea-4ffb-9959-08d116a9369e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:09.883489 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef354f2-e9ea-4ffb-9959-08d116a9369e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:09.888584 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665ae61-d7f3-4c35-8cab-e727f6603c15 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5701febea7a454ab2c3a1ae31102a61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f847b04c4094cceb496438b070f38a7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:09.889626 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665ae61-d7f3-4c35-8cab-e727f6603c15 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:09.889928 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665ae61-d7f3-4c35-8cab-e727f6603c15 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:09.890214 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665ae61-d7f3-4c35-8cab-e727f6603c15 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] PATH_INFO: `/v3/projects/b7f603c6a9d0461daa578ee234330d9a` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:09.891756 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665ae61-d7f3-4c35-8cab-e727f6603c15 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b7f603c6a9d0461daa578ee234330d9a)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:09.894072 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665ae61-d7f3-4c35-8cab-e727f6603c15 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:09.896383 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c1634-a06d-437b-a017-4e9c7f8b7e4d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:09.909032 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaed980-552c-4e18-83fc-197e48f59594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:09.910949 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaed980-552c-4e18-83fc-197e48f59594 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:09.911244 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaed980-552c-4e18-83fc-197e48f59594 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:09.911598 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaed980-552c-4e18-83fc-197e48f59594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:09.917845 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bfaed980-552c-4e18-83fc-197e48f59594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:10.012739 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f665ae61-d7f3-4c35-8cab-e727f6603c15 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f603c6a9d0461daa578ee234330d9a', 'request_id': 'req-f665ae61-d7f3-4c35-8cab-e727f6603c15'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:10.022495 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f665ae61-d7f3-4c35-8cab-e727f6603c15 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f603c6a9d0461daa578ee234330d9a', 'request_id': 'req-f665ae61-d7f3-4c35-8cab-e727f6603c15'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:10.032049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f665ae61-d7f3-4c35-8cab-e727f6603c15 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f603c6a9d0461daa578ee234330d9a', 'request_id': 'req-f665ae61-d7f3-4c35-8cab-e727f6603c15'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:10.049026 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f665ae61-d7f3-4c35-8cab-e727f6603c15 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] The token cache is being invalidate because project b7f603c6a9d0461daa578ee234330d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:10.050151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f665ae61-d7f3-4c35-8cab-e727f6603c15 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:10.050971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f665ae61-d7f3-4c35-8cab-e727f6603c15 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:10.053873 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 899/1774] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:09 2022] DELETE /identity/v3/projects/b7f603c6a9d0461daa578ee234330d9a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:10.054894 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665ae61-d7f3-4c35-8cab-e727f6603c15 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:10.057280 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f665ae61-d7f3-4c35-8cab-e727f6603c15 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:10.061755 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaed980-552c-4e18-83fc-197e48f59594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:10.063876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaed980-552c-4e18-83fc-197e48f59594 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:10.077861 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 876/1775] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:10.079601 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaed980-552c-4e18-83fc-197e48f59594 service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:10.091751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaed980-552c-4e18-83fc-197e48f59594 service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:10.170330 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca158b9-fba3-4ed0-9871-08fa4df8385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:10.171008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca158b9-fba3-4ed0-9871-08fa4df8385f admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:10.171285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca158b9-fba3-4ed0-9871-08fa4df8385f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:10.172180 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca158b9-fba3-4ed0-9871-08fa4df8385f admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:10.172944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca158b9-fba3-4ed0-9871-08fa4df8385f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:10.174867 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca158b9-fba3-4ed0-9871-08fa4df8385f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:10.183704 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665ae61-d7f3-4c35-8cab-e727f6603c15 tempest-VolumeQuotaClassesTest-1603341406 tempest-VolumeQuotaClassesTest-1603341406-project-admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:10.187193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 877/1776] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:10.188531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf311b-59e1-4c62-8524-00b542905e12 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:10.188862 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf311b-59e1-4c62-8524-00b542905e12 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:10.189115 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf311b-59e1-4c62-8524-00b542905e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:10.191460 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe054a-1586-4b8c-8afe-66f3326b8635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:10.192128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe054a-1586-4b8c-8afe-66f3326b8635 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:10.192408 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe054a-1586-4b8c-8afe-66f3326b8635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:10.192681 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe054a-1586-4b8c-8afe-66f3326b8635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:10.199947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4cbe054a-1586-4b8c-8afe-66f3326b8635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:10.215869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-60cf311b-59e1-4c62-8524-00b542905e12 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:10.217576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-60cf311b-59e1-4c62-8524-00b542905e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:10.228330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe054a-1586-4b8c-8afe-66f3326b8635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:10.230005 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe054a-1586-4b8c-8afe-66f3326b8635 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:10.231414 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 878/1777] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:10.232247 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf311b-59e1-4c62-8524-00b542905e12 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:10.233564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-60cf311b-59e1-4c62-8524-00b542905e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:10.250932 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf311b-59e1-4c62-8524-00b542905e12 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:10.259289 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeca86-319e-4886-9ea3-6ce5e35864a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:10.260054 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeca86-319e-4886-9ea3-6ce5e35864a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:10.260387 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeca86-319e-4886-9ea3-6ce5e35864a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:10.261310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeca86-319e-4886-9ea3-6ce5e35864a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:10.265198 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddeca86-319e-4886-9ea3-6ce5e35864a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:10.267285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddeca86-319e-4886-9ea3-6ce5e35864a0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:10.280223 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 900/1778] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:10.282245 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe054a-1586-4b8c-8afe-66f3326b8635 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:10.293143 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4cbe054a-1586-4b8c-8afe-66f3326b8635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:10.293304 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 879/1779] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:10.295381 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeca86-319e-4886-9ea3-6ce5e35864a0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:10.328905 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeca86-319e-4886-9ea3-6ce5e35864a0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:10.348437 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8681f1d-34fa-4112-a32c-5061a537d40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:10.349233 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8681f1d-34fa-4112-a32c-5061a537d40c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:10.350186 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8681f1d-34fa-4112-a32c-5061a537d40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:10.350533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8681f1d-34fa-4112-a32c-5061a537d40c admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:10.351392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8681f1d-34fa-4112-a32c-5061a537d40c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:10.351755 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8681f1d-34fa-4112-a32c-5061a537d40c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:10.364477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8681f1d-34fa-4112-a32c-5061a537d40c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:10.381997 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe054a-1586-4b8c-8afe-66f3326b8635 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:10.392276 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa9959-e4e9-4101-a5d1-b1efae4b73c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:10.393200 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa9959-e4e9-4101-a5d1-b1efae4b73c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:10.396284 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa9959-e4e9-4101-a5d1-b1efae4b73c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:10.398706 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa9959-e4e9-4101-a5d1-b1efae4b73c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:10.400256 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 880/1780] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:10.400964 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa9959-e4e9-4101-a5d1-b1efae4b73c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:10.401828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8681f1d-34fa-4112-a32c-5061a537d40c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:10.408095 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa9959-e4e9-4101-a5d1-b1efae4b73c5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:10.424544 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8681f1d-34fa-4112-a32c-5061a537d40c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:10.431702 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9230c9-a8ec-4042-adf5-a647ce7ac96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:10.432653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9230c9-a8ec-4042-adf5-a647ce7ac96a admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:10.433004 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9230c9-a8ec-4042-adf5-a647ce7ac96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:10.433317 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9230c9-a8ec-4042-adf5-a647ce7ac96a admin admin] PATH_INFO: `/v3/projects/73d3bdd0a50c405fb8917b1a27dac128/users/728772aaa642407197b6d253462ca1d5/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:10.441253 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 901/1781] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:10.445126 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa9959-e4e9-4101-a5d1-b1efae4b73c5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:10.451731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9230c9-a8ec-4042-adf5-a647ce7ac96a admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d3bdd0a50c405fb8917b1a27dac128, user_id=728772aaa642407197b6d253462ca1d5, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:10.455903 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9230c9-a8ec-4042-adf5-a647ce7ac96a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:10.484678 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa9959-e4e9-4101-a5d1-b1efae4b73c5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:10.490685 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 881/1782] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:10 2022] PUT /identity/v3/projects/73d3bdd0a50c405fb8917b1a27dac128/users/728772aaa642407197b6d253462ca1d5/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:10.503572 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9230c9-a8ec-4042-adf5-a647ce7ac96a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:10.674329 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c2c1d-c968-4e2f-a620-a15fe5c04017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:10.676461 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c2c1d-c968-4e2f-a620-a15fe5c04017 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:10.677201 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c2c1d-c968-4e2f-a620-a15fe5c04017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:10.678476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c2c1d-c968-4e2f-a620-a15fe5c04017 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:10.680474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c2c1d-c968-4e2f-a620-a15fe5c04017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:10.685306 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c2c1d-c968-4e2f-a620-a15fe5c04017 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:10.695572 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9230c9-a8ec-4042-adf5-a647ce7ac96a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:10.709996 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08e68a-92b1-41bc-ac30-126965bc9b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:10.711958 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08e68a-92b1-41bc-ac30-126965bc9b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:10.711958 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08e68a-92b1-41bc-ac30-126965bc9b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:10.712138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08e68a-92b1-41bc-ac30-126965bc9b23 admin admin] PATH_INFO: `/v3/projects/07a25937b89d45668c2f58e6d8bee6cc/users/1e1adab6d96b485797b0c378d01e9792/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:10.740752 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 902/1783] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:10 2022] POST /identity/v3/projects => generated 363 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:10.745221 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd33bd6-fe96-4341-99d8-6390de665023 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:10.745760 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd33bd6-fe96-4341-99d8-6390de665023 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:10.746441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd33bd6-fe96-4341-99d8-6390de665023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:10.754588 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08e68a-92b1-41bc-ac30-126965bc9b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a25937b89d45668c2f58e6d8bee6cc, user_id=1e1adab6d96b485797b0c378d01e9792, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:10.763277 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08e68a-92b1-41bc-ac30-126965bc9b23 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:10.824681 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 882/1784] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:10 2022] PUT /identity/v3/projects/07a25937b89d45668c2f58e6d8bee6cc/users/1e1adab6d96b485797b0c378d01e9792/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:10.826819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9dd33bd6-fe96-4341-99d8-6390de665023 None None] MFA Rules not processed for user `728772aaa642407197b6d253462ca1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:10.828196 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9dd33bd6-fe96-4341-99d8-6390de665023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:10.831350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08e68a-92b1-41bc-ac30-126965bc9b23 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:10.836904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9f08e68a-92b1-41bc-ac30-126965bc9b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:10.936302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 903/1785] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:10.937540 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd33bd6-fe96-4341-99d8-6390de665023 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:11.018710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08e68a-92b1-41bc-ac30-126965bc9b23 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:11.025082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d7559-f99e-45f8-bc79-9f75ba1af1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:11.028199 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d7559-f99e-45f8-bc79-9f75ba1af1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:11.028605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d7559-f99e-45f8-bc79-9f75ba1af1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:11.029095 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d7559-f99e-45f8-bc79-9f75ba1af1c5 admin admin] PATH_INFO: `/v3/users/23f6efe01e814ea8a87183ebe6a0a9ee` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:11.030597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d7559-f99e-45f8-bc79-9f75ba1af1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f6efe01e814ea8a87183ebe6a0a9ee)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:11.032715 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd33bd6-fe96-4341-99d8-6390de665023 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:11.033913 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d7559-f99e-45f8-bc79-9f75ba1af1c5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:11.039375 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504781ab-40a3-4b94-b372-b8fe4dd8ac5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:11.040117 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504781ab-40a3-4b94-b372-b8fe4dd8ac5f admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:11.040400 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504781ab-40a3-4b94-b372-b8fe4dd8ac5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:11.040743 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504781ab-40a3-4b94-b372-b8fe4dd8ac5f admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:11.041472 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504781ab-40a3-4b94-b372-b8fe4dd8ac5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:11.043840 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504781ab-40a3-4b94-b372-b8fe4dd8ac5f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:11.096884 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 904/1786] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:10 2022] POST /identity/v3/users => generated 282 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:11.098992 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e127a7-c6cf-4243-a433-de31878a5e58 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:11.100035 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e127a7-c6cf-4243-a433-de31878a5e58 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:11.110443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e127a7-c6cf-4243-a433-de31878a5e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:11.115803 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c13d7559-f99e-45f8-bc79-9f75ba1af1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f6efe01e814ea8a87183ebe6a0a9ee'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:11.116607 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c13d7559-f99e-45f8-bc79-9f75ba1af1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f6efe01e814ea8a87183ebe6a0a9ee'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:11.117478 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c13d7559-f99e-45f8-bc79-9f75ba1af1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f6efe01e814ea8a87183ebe6a0a9ee'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:11.131803 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c13d7559-f99e-45f8-bc79-9f75ba1af1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f6efe01e814ea8a87183ebe6a0a9ee'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:11.159083 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c13d7559-f99e-45f8-bc79-9f75ba1af1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f6efe01e814ea8a87183ebe6a0a9ee'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:11.173116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-27e127a7-c6cf-4243-a433-de31878a5e58 None None] MFA Rules not processed for user `1e1adab6d96b485797b0c378d01e9792`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:11.174979 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-27e127a7-c6cf-4243-a433-de31878a5e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:11.189894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 883/1787] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:10 2022] DELETE /identity/v3/users/23f6efe01e814ea8a87183ebe6a0a9ee => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:11.190919 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d7559-f99e-45f8-bc79-9f75ba1af1c5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:11.193038 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c13d7559-f99e-45f8-bc79-9f75ba1af1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:11.378151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 905/1788] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:11.379699 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d10a-52d3-44a6-b456-efe9c3271c43 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:11.379996 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d10a-52d3-44a6-b456-efe9c3271c43 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:11.380276 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d10a-52d3-44a6-b456-efe9c3271c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:11.421692 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8ae6d10a-52d3-44a6-b456-efe9c3271c43 None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:11.424429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8ae6d10a-52d3-44a6-b456-efe9c3271c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:11.431753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d7559-f99e-45f8-bc79-9f75ba1af1c5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:11.446413 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744280d3-1bc0-4ffb-b695-4cc45126364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:11.447172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744280d3-1bc0-4ffb-b695-4cc45126364c admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:11.447457 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744280d3-1bc0-4ffb-b695-4cc45126364c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:11.448341 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744280d3-1bc0-4ffb-b695-4cc45126364c admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:11.448626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744280d3-1bc0-4ffb-b695-4cc45126364c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:11.455657 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744280d3-1bc0-4ffb-b695-4cc45126364c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:11.512151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 884/1789] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:11 2022] POST /identity/v3/projects => generated 367 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:11.513060 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744280d3-1bc0-4ffb-b695-4cc45126364c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:11.531742 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-744280d3-1bc0-4ffb-b695-4cc45126364c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:11.583516 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 906/1790] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 27 05:06:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:11.588515 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af5c5d-7d3d-4507-9f13-c9c0a57559b5 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:11.589523 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af5c5d-7d3d-4507-9f13-c9c0a57559b5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:11.591567 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af5c5d-7d3d-4507-9f13-c9c0a57559b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:11.671354 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-35af5c5d-7d3d-4507-9f13-c9c0a57559b5 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:11.672562 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-35af5c5d-7d3d-4507-9f13-c9c0a57559b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:11.687319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744280d3-1bc0-4ffb-b695-4cc45126364c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:11.700105 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704545d-506d-43c7-8ab6-b164cbaad6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:11.701030 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704545d-506d-43c7-8ab6-b164cbaad6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:11.701323 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704545d-506d-43c7-8ab6-b164cbaad6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:11.703369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704545d-506d-43c7-8ab6-b164cbaad6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:11.706270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704545d-506d-43c7-8ab6-b164cbaad6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:11.707540 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 907/1791] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:11.709864 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af5c5d-7d3d-4507-9f13-c9c0a57559b5 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:11.717074 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-35af5c5d-7d3d-4507-9f13-c9c0a57559b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:11.720249 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704545d-506d-43c7-8ab6-b164cbaad6b8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:11.782009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 885/1792] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:11.782009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704545d-506d-43c7-8ab6-b164cbaad6b8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:11.807444 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704545d-506d-43c7-8ab6-b164cbaad6b8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:11.829582 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a35865-ebbb-4c37-8798-fdc155ab5225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:11.830039 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a35865-ebbb-4c37-8798-fdc155ab5225 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:11.830219 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a35865-ebbb-4c37-8798-fdc155ab5225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:11.830517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a35865-ebbb-4c37-8798-fdc155ab5225 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:11.831235 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a35865-ebbb-4c37-8798-fdc155ab5225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:11.833769 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a35865-ebbb-4c37-8798-fdc155ab5225 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:11.894077 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 886/1793] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:11 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:11.907146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af5c5d-7d3d-4507-9f13-c9c0a57559b5 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:11.916996 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a35865-ebbb-4c37-8798-fdc155ab5225 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:11.918342 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eab29f-9bbd-4aae-aaef-7d3f7a1417bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:11.919192 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eab29f-9bbd-4aae-aaef-7d3f7a1417bd service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:11.919373 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-09a35865-ebbb-4c37-8798-fdc155ab5225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:11.919574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eab29f-9bbd-4aae-aaef-7d3f7a1417bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:11.919971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eab29f-9bbd-4aae-aaef-7d3f7a1417bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:12.077411 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eab29f-9bbd-4aae-aaef-7d3f7a1417bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:12.079129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eab29f-9bbd-4aae-aaef-7d3f7a1417bd service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:12.100305 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 908/1794] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:12.101426 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eab29f-9bbd-4aae-aaef-7d3f7a1417bd service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:12.145322 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eab29f-9bbd-4aae-aaef-7d3f7a1417bd service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:12.160172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a35865-ebbb-4c37-8798-fdc155ab5225 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:12.172836 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ad0ae-4b74-408c-8455-3493db377f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:12.173727 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ad0ae-4b74-408c-8455-3493db377f1e service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:12.174112 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ad0ae-4b74-408c-8455-3493db377f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:12.174459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ad0ae-4b74-408c-8455-3493db377f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:12.202016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ad0ae-4b74-408c-8455-3493db377f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:12.203684 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be97e7-acc4-4428-bcc4-01e50f156f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:12.204371 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be97e7-acc4-4428-bcc4-01e50f156f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:12.204661 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be97e7-acc4-4428-bcc4-01e50f156f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:12.206924 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be97e7-acc4-4428-bcc4-01e50f156f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:12.207068 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ad0ae-4b74-408c-8455-3493db377f1e service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:12.207716 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be97e7-acc4-4428-bcc4-01e50f156f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:12.213919 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be97e7-acc4-4428-bcc4-01e50f156f6d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:12.242119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 887/1795] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:12.243807 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ad0ae-4b74-408c-8455-3493db377f1e service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:12.259488 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 909/1796] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:12.260758 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be97e7-acc4-4428-bcc4-01e50f156f6d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:12.264611 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b5be97e7-acc4-4428-bcc4-01e50f156f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:12.279943 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ad0ae-4b74-408c-8455-3493db377f1e service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:12.301579 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afd446-a12b-4815-9327-d276cd2b4bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:12.305777 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afd446-a12b-4815-9327-d276cd2b4bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:12.306262 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afd446-a12b-4815-9327-d276cd2b4bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:12.306709 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afd446-a12b-4815-9327-d276cd2b4bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:12.308693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afd446-a12b-4815-9327-d276cd2b4bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:12.311775 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afd446-a12b-4815-9327-d276cd2b4bb7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:12.331771 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 888/1797] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:12.332759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afd446-a12b-4815-9327-d276cd2b4bb7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:12.353960 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afd446-a12b-4815-9327-d276cd2b4bb7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:12.376778 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf93a00-970e-4f45-966e-24362c13c418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:12.378141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf93a00-970e-4f45-966e-24362c13c418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:12.378425 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf93a00-970e-4f45-966e-24362c13c418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:12.378710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf93a00-970e-4f45-966e-24362c13c418 admin admin] PATH_INFO: `/v3/projects/7956696a38c1414584734a7c71c76eac/users/84eb6cd3985349529d15f0a5f9b18eaf/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:12.428185 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf93a00-970e-4f45-966e-24362c13c418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7956696a38c1414584734a7c71c76eac, user_id=84eb6cd3985349529d15f0a5f9b18eaf, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:12.433016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf93a00-970e-4f45-966e-24362c13c418 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:12.449512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be97e7-acc4-4428-bcc4-01e50f156f6d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:12.478400 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 889/1798] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:12 2022] PUT /identity/v3/projects/7956696a38c1414584734a7c71c76eac/users/84eb6cd3985349529d15f0a5f9b18eaf/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:12.483172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf93a00-970e-4f45-966e-24362c13c418 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:12.573909 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13027de9-58cc-41a2-a836-c146a7cccadc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:12.576912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13027de9-58cc-41a2-a836-c146a7cccadc service swift] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:12.579899 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13027de9-58cc-41a2-a836-c146a7cccadc service swift] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:12.580291 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13027de9-58cc-41a2-a836-c146a7cccadc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:12.651360 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf93a00-970e-4f45-966e-24362c13c418 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:12.658695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acda4e-2159-4cb0-8630-d54b30645361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:12.661079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acda4e-2159-4cb0-8630-d54b30645361 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:12.661920 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acda4e-2159-4cb0-8630-d54b30645361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:12.663053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acda4e-2159-4cb0-8630-d54b30645361 admin admin] PATH_INFO: `/v3/projects/2707f13523f84facb2e413d22a019e4d/users/5406b950a80140dca76beb656369d697/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:12.713686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acda4e-2159-4cb0-8630-d54b30645361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2707f13523f84facb2e413d22a019e4d, user_id=5406b950a80140dca76beb656369d697, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:12.719784 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acda4e-2159-4cb0-8630-d54b30645361 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:12.756653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 890/1799] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:12 2022] PUT /identity/v3/projects/2707f13523f84facb2e413d22a019e4d/users/5406b950a80140dca76beb656369d697/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:12.756653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d777-893e-4332-aa3e-b39e0171cfcd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:12.756653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d777-893e-4332-aa3e-b39e0171cfcd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:12.756653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876d777-893e-4332-aa3e-b39e0171cfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:12.778939 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13027de9-58cc-41a2-a836-c146a7cccadc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:12.784919 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13027de9-58cc-41a2-a836-c146a7cccadc service swift] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:12.807920 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 910/1800] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 05:06:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 05:06:12.809568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13027de9-58cc-41a2-a836-c146a7cccadc service swift] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:12.834354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0876d777-893e-4332-aa3e-b39e0171cfcd None None] MFA Rules not processed for user `84eb6cd3985349529d15f0a5f9b18eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:12.836834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0876d777-893e-4332-aa3e-b39e0171cfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:12.838146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13027de9-58cc-41a2-a836-c146a7cccadc service swift] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:13.059438 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185c193-5a3b-44bb-a091-86b53e106abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:13.062147 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185c193-5a3b-44bb-a091-86b53e106abc admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:13.063835 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185c193-5a3b-44bb-a091-86b53e106abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:13.065289 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185c193-5a3b-44bb-a091-86b53e106abc admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:13.067003 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185c193-5a3b-44bb-a091-86b53e106abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:13.076279 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185c193-5a3b-44bb-a091-86b53e106abc admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:13.092558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 891/1801] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:12 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:13.096606 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876d777-893e-4332-aa3e-b39e0171cfcd None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:13.121047 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 911/1802] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:13.121446 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185c193-5a3b-44bb-a091-86b53e106abc admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:13.122086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876d777-893e-4332-aa3e-b39e0171cfcd None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:13.152968 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe497a2-0f90-447e-a234-0cf807919112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:13.153667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe497a2-0f90-447e-a234-0cf807919112 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:13.153926 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe497a2-0f90-447e-a234-0cf807919112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:13.154508 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe497a2-0f90-447e-a234-0cf807919112 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:13.155218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe497a2-0f90-447e-a234-0cf807919112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:13.159862 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe497a2-0f90-447e-a234-0cf807919112 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:13.161043 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185c193-5a3b-44bb-a091-86b53e106abc admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:13.181340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c4a8f-cc77-4d02-b113-6235bfa3ce42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:13.182506 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c4a8f-cc77-4d02-b113-6235bfa3ce42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:13.184505 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c4a8f-cc77-4d02-b113-6235bfa3ce42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:13.186383 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c4a8f-cc77-4d02-b113-6235bfa3ce42 admin admin] PATH_INFO: `/v3/projects/2707f13523f84facb2e413d22a019e4d/users/5406b950a80140dca76beb656369d697/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:13.194623 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c4a8f-cc77-4d02-b113-6235bfa3ce42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2707f13523f84facb2e413d22a019e4d, user_id=5406b950a80140dca76beb656369d697, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:13.206743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 892/1803] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:13 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:06:13.218435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c4a8f-cc77-4d02-b113-6235bfa3ce42 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:13.220907 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe497a2-0f90-447e-a234-0cf807919112 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:13.252462 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 912/1804] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:13 2022] PUT /identity/v3/projects/2707f13523f84facb2e413d22a019e4d/users/5406b950a80140dca76beb656369d697/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:13.267397 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d968d6a-d07d-4b05-b772-e2f0c26be3c6 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:13.268024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d968d6a-d07d-4b05-b772-e2f0c26be3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:13.268454 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d968d6a-d07d-4b05-b772-e2f0c26be3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:13.353867 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-6d968d6a-d07d-4b05-b772-e2f0c26be3c6 None None] MFA Rules not processed for user `5406b950a80140dca76beb656369d697`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:13.354875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6d968d6a-d07d-4b05-b772-e2f0c26be3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:13.413041 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe497a2-0f90-447e-a234-0cf807919112 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:13.471748 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 913/1805] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:13 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:13.494395 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d968d6a-d07d-4b05-b772-e2f0c26be3c6 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:13.496088 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6d968d6a-d07d-4b05-b772-e2f0c26be3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:13.521313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47157f-5b5a-4625-bdf1-9ef2abf263e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:13.522340 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47157f-5b5a-4625-bdf1-9ef2abf263e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:13.532885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47157f-5b5a-4625-bdf1-9ef2abf263e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:13.533345 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47157f-5b5a-4625-bdf1-9ef2abf263e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:13.534423 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47157f-5b5a-4625-bdf1-9ef2abf263e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:13.538755 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47157f-5b5a-4625-bdf1-9ef2abf263e0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:13.564049 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 893/1806] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:13 2022] POST /identity/v3/users => generated 288 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:13.567908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47157f-5b5a-4625-bdf1-9ef2abf263e0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:13.581868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47157f-5b5a-4625-bdf1-9ef2abf263e0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:13.586879 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d968d6a-d07d-4b05-b772-e2f0c26be3c6 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:13.587469 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e12eb-9800-4d78-aa85-9323e557ac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:13.588179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e12eb-9800-4d78-aa85-9323e557ac36 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:13.588481 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e12eb-9800-4d78-aa85-9323e557ac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:13.588752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e12eb-9800-4d78-aa85-9323e557ac36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:13.589521 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e12eb-9800-4d78-aa85-9323e557ac36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:13.591128 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e12eb-9800-4d78-aa85-9323e557ac36 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:13.592134 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccae6bd-b181-4fea-965e-1e1f64b92198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:13.593009 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccae6bd-b181-4fea-965e-1e1f64b92198 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:13.593453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccae6bd-b181-4fea-965e-1e1f64b92198 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:13.593885 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccae6bd-b181-4fea-965e-1e1f64b92198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:13.602835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 894/1807] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:13.604643 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccae6bd-b181-4fea-965e-1e1f64b92198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:13.606392 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccae6bd-b181-4fea-965e-1e1f64b92198 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:13.606833 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e12eb-9800-4d78-aa85-9323e557ac36 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:13.618422 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 914/1808] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:13 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:06:13.627304 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e12eb-9800-4d78-aa85-9323e557ac36 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:13.633035 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221ead0-fb3e-43da-b1bc-2653aa1f0ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:13.634633 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221ead0-fb3e-43da-b1bc-2653aa1f0ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:13.634920 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221ead0-fb3e-43da-b1bc-2653aa1f0ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:13.635219 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221ead0-fb3e-43da-b1bc-2653aa1f0ff2 admin admin] PATH_INFO: `/v3/projects/51d3b99e16544a34bed2d9e9c66b488d/users/2d7be409290143c0bb62e0b24103b063/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:13.653462 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221ead0-fb3e-43da-b1bc-2653aa1f0ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d3b99e16544a34bed2d9e9c66b488d, user_id=2d7be409290143c0bb62e0b24103b063, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:13.657564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221ead0-fb3e-43da-b1bc-2653aa1f0ff2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:13.676876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 895/1809] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:13 2022] PUT /identity/v3/projects/51d3b99e16544a34bed2d9e9c66b488d/users/2d7be409290143c0bb62e0b24103b063/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:13.679429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccae6bd-b181-4fea-965e-1e1f64b92198 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:13.696250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccae6bd-b181-4fea-965e-1e1f64b92198 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:13.795591 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277cfc2-41a5-48b3-a32e-4e5c5c0f8c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:13.796143 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277cfc2-41a5-48b3-a32e-4e5c5c0f8c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:13.796605 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277cfc2-41a5-48b3-a32e-4e5c5c0f8c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:13.797125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277cfc2-41a5-48b3-a32e-4e5c5c0f8c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:13.799072 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277cfc2-41a5-48b3-a32e-4e5c5c0f8c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:13.800951 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277cfc2-41a5-48b3-a32e-4e5c5c0f8c12 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:13.817316 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 915/1810] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:13.821036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221ead0-fb3e-43da-b1bc-2653aa1f0ff2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:13.832711 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221ead0-fb3e-43da-b1bc-2653aa1f0ff2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:13.838223 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd875830-c5ce-4240-9581-87d31b49d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:13.839429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd875830-c5ce-4240-9581-87d31b49d23d admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:13.839429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd875830-c5ce-4240-9581-87d31b49d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:13.839647 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd875830-c5ce-4240-9581-87d31b49d23d admin admin] PATH_INFO: `/v3/projects/51d3b99e16544a34bed2d9e9c66b488d/users/2d7be409290143c0bb62e0b24103b063/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:13.841855 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd875830-c5ce-4240-9581-87d31b49d23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d3b99e16544a34bed2d9e9c66b488d, user_id=2d7be409290143c0bb62e0b24103b063, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:13.844903 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd875830-c5ce-4240-9581-87d31b49d23d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:13.857795 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 896/1811] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:13 2022] PUT /identity/v3/projects/51d3b99e16544a34bed2d9e9c66b488d/users/2d7be409290143c0bb62e0b24103b063/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:13.871252 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89526d-fb6d-43d5-bf45-2da24a47a5d4 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:13.871552 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89526d-fb6d-43d5-bf45-2da24a47a5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:13.871878 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89526d-fb6d-43d5-bf45-2da24a47a5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:13.915741 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1a89526d-fb6d-43d5-bf45-2da24a47a5d4 None None] MFA Rules not processed for user `2d7be409290143c0bb62e0b24103b063`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:13.915895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd875830-c5ce-4240-9581-87d31b49d23d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:13.917659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1a89526d-fb6d-43d5-bf45-2da24a47a5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:13.917940 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fd875830-c5ce-4240-9581-87d31b49d23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:14.073099 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 916/1812] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:13 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:14.088717 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89526d-fb6d-43d5-bf45-2da24a47a5d4 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:14.123779 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd875830-c5ce-4240-9581-87d31b49d23d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:14.132984 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a706a6-8648-428b-8190-7e80181e488c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:14.134797 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a706a6-8648-428b-8190-7e80181e488c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:14.135288 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a706a6-8648-428b-8190-7e80181e488c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:14.136513 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a706a6-8648-428b-8190-7e80181e488c admin admin] PATH_INFO: `/v3/projects/14268d144b9b43e581c2c4104962c65f` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:14.138966 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a706a6-8648-428b-8190-7e80181e488c admin admin] RBAC: Authorizing `identity:delete_project(project_id=14268d144b9b43e581c2c4104962c65f)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:14.142022 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a706a6-8648-428b-8190-7e80181e488c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:14.227089 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-28a706a6-8648-428b-8190-7e80181e488c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14268d144b9b43e581c2c4104962c65f', 'request_id': 'req-28a706a6-8648-428b-8190-7e80181e488c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:14.233606 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89526d-fb6d-43d5-bf45-2da24a47a5d4 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:14.252118 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-28a706a6-8648-428b-8190-7e80181e488c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14268d144b9b43e581c2c4104962c65f', 'request_id': 'req-28a706a6-8648-428b-8190-7e80181e488c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:14.267944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-28a706a6-8648-428b-8190-7e80181e488c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14268d144b9b43e581c2c4104962c65f', 'request_id': 'req-28a706a6-8648-428b-8190-7e80181e488c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:14.299244 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-28a706a6-8648-428b-8190-7e80181e488c admin admin] The token cache is being invalidate because project 14268d144b9b43e581c2c4104962c65f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:14.301152 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-28a706a6-8648-428b-8190-7e80181e488c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:14.302228 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-28a706a6-8648-428b-8190-7e80181e488c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:14.307932 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa54c68-50ce-46c2-be3e-4f15c61d0cde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:14.308735 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa54c68-50ce-46c2-be3e-4f15c61d0cde service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:14.309112 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa54c68-50ce-46c2-be3e-4f15c61d0cde service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:14.309586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa54c68-50ce-46c2-be3e-4f15c61d0cde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:14.311678 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-baa54c68-50ce-46c2-be3e-4f15c61d0cde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:14.312272 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 897/1813] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:13 2022] DELETE /identity/v3/projects/14268d144b9b43e581c2c4104962c65f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:14.314934 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a706a6-8648-428b-8190-7e80181e488c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:14.320186 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-28a706a6-8648-428b-8190-7e80181e488c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:14.416549 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a706a6-8648-428b-8190-7e80181e488c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:14.422341 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19b002-8fef-4cdc-99eb-3c3223c40845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:14.423368 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19b002-8fef-4cdc-99eb-3c3223c40845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:14.423555 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19b002-8fef-4cdc-99eb-3c3223c40845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:14.423825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19b002-8fef-4cdc-99eb-3c3223c40845 admin admin] PATH_INFO: `/v3/users/e5701febea7a454ab2c3a1ae31102a61` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:14.425149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19b002-8fef-4cdc-99eb-3c3223c40845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5701febea7a454ab2c3a1ae31102a61)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:14.427150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19b002-8fef-4cdc-99eb-3c3223c40845 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:14.434116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa54c68-50ce-46c2-be3e-4f15c61d0cde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:14.435749 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa54c68-50ce-46c2-be3e-4f15c61d0cde service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:14.454203 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 917/1814] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:14 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:06:14.528925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ca19b002-8fef-4cdc-99eb-3c3223c40845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5701febea7a454ab2c3a1ae31102a61'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:14.529750 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ca19b002-8fef-4cdc-99eb-3c3223c40845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5701febea7a454ab2c3a1ae31102a61'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:14.530360 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ca19b002-8fef-4cdc-99eb-3c3223c40845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5701febea7a454ab2c3a1ae31102a61'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:14.545999 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ca19b002-8fef-4cdc-99eb-3c3223c40845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5701febea7a454ab2c3a1ae31102a61'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:14.585414 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ca19b002-8fef-4cdc-99eb-3c3223c40845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5701febea7a454ab2c3a1ae31102a61'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:14.602132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 898/1815] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:14 2022] DELETE /identity/v3/users/e5701febea7a454ab2c3a1ae31102a61 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:14.740302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97179aa-ec85-4f34-a077-6800a13d75d9 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:14.741115 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97179aa-ec85-4f34-a077-6800a13d75d9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:14.741115 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97179aa-ec85-4f34-a077-6800a13d75d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:14.776059 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a97179aa-ec85-4f34-a077-6800a13d75d9 None None] MFA Rules not processed for user `6a6685057ae24345b4067cffb06b7f63`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:14.777340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a97179aa-ec85-4f34-a077-6800a13d75d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:14.909995 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 918/1816] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:15.237323 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56e844-da1a-4d82-99e3-2116293e2463 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:15.237982 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56e844-da1a-4d82-99e3-2116293e2463 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:15.237982 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56e844-da1a-4d82-99e3-2116293e2463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:15.296578 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6c56e844-da1a-4d82-99e3-2116293e2463 None None] MFA Rules not processed for user `639126e5b13345cda6490073ec57f4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:15.317675 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6c56e844-da1a-4d82-99e3-2116293e2463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:15.607842 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97179aa-ec85-4f34-a077-6800a13d75d9 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:15.609590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a97179aa-ec85-4f34-a077-6800a13d75d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:15.651751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 899/1817] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Sep 27 05:06:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:15.703857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56e844-da1a-4d82-99e3-2116293e2463 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:15.705700 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6c56e844-da1a-4d82-99e3-2116293e2463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:15.720313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56e844-da1a-4d82-99e3-2116293e2463 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:15.753237 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b0e56-08b4-4623-9000-20d6dbefb206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:15.754017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b0e56-08b4-4623-9000-20d6dbefb206 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:15.754399 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b0e56-08b4-4623-9000-20d6dbefb206 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:15.760736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b0e56-08b4-4623-9000-20d6dbefb206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:15.770002 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97179aa-ec85-4f34-a077-6800a13d75d9 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:15.784408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b0e56-08b4-4623-9000-20d6dbefb206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:15.785997 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b0e56-08b4-4623-9000-20d6dbefb206 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:15.792781 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3be561-6685-4be6-8785-ac1c0042f47d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:15.793598 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3be561-6685-4be6-8785-ac1c0042f47d service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:15.794143 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3be561-6685-4be6-8785-ac1c0042f47d service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:15.794592 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3be561-6685-4be6-8785-ac1c0042f47d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:15.799796 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8b3be561-6685-4be6-8785-ac1c0042f47d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:15.822244 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 900/1818] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:06:15.953638 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3be561-6685-4be6-8785-ac1c0042f47d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:15.958543 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b0e56-08b4-4623-9000-20d6dbefb206 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:15.960512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b65b0e56-08b4-4623-9000-20d6dbefb206 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:15.979065 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3be561-6685-4be6-8785-ac1c0042f47d service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:16.037615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 919/1819] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:16.156167 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b0e56-08b4-4623-9000-20d6dbefb206 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:16.177695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a0465-9cda-44bb-b0bc-16927caa8e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:16.179458 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a0465-9cda-44bb-b0bc-16927caa8e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:16.180141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a0465-9cda-44bb-b0bc-16927caa8e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:16.180626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a0465-9cda-44bb-b0bc-16927caa8e75 admin admin] PATH_INFO: `/v3/projects/1f847b04c4094cceb496438b070f38a7` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:16.183509 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a0465-9cda-44bb-b0bc-16927caa8e75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f847b04c4094cceb496438b070f38a7)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:16.185829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a0465-9cda-44bb-b0bc-16927caa8e75 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:16.256729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3be561-6685-4be6-8785-ac1c0042f47d service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:16.260336 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8b3be561-6685-4be6-8785-ac1c0042f47d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:16.296766 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3be561-6685-4be6-8785-ac1c0042f47d service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:16.330875 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8f2a0465-9cda-44bb-b0bc-16927caa8e75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f847b04c4094cceb496438b070f38a7', 'request_id': 'req-8f2a0465-9cda-44bb-b0bc-16927caa8e75'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:16.357945 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8f2a0465-9cda-44bb-b0bc-16927caa8e75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f847b04c4094cceb496438b070f38a7', 'request_id': 'req-8f2a0465-9cda-44bb-b0bc-16927caa8e75'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:16.377087 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8f2a0465-9cda-44bb-b0bc-16927caa8e75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f847b04c4094cceb496438b070f38a7', 'request_id': 'req-8f2a0465-9cda-44bb-b0bc-16927caa8e75'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:16.415224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8f2a0465-9cda-44bb-b0bc-16927caa8e75 admin admin] The token cache is being invalidate because project 1f847b04c4094cceb496438b070f38a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:16.416976 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8f2a0465-9cda-44bb-b0bc-16927caa8e75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:16.419073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8f2a0465-9cda-44bb-b0bc-16927caa8e75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:16.429406 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 901/1820] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:15 2022] DELETE /identity/v3/projects/1f847b04c4094cceb496438b070f38a7 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:16.431175 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceac1c-0b37-4cdb-8b4e-b308f00cd5a3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:16.431465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceac1c-0b37-4cdb-8b4e-b308f00cd5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:16.431744 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceac1c-0b37-4cdb-8b4e-b308f00cd5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:16.515285 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a2e9e-73a0-4f6d-b3ee-087f62ac540e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:16.516474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a2e9e-73a0-4f6d-b3ee-087f62ac540e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:16.517004 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a2e9e-73a0-4f6d-b3ee-087f62ac540e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:16.517501 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a2e9e-73a0-4f6d-b3ee-087f62ac540e admin admin] PATH_INFO: `/v3/users/84eb6cd3985349529d15f0a5f9b18eaf` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:16.520753 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a2e9e-73a0-4f6d-b3ee-087f62ac540e admin admin] RBAC: Authorizing `identity:delete_user(user_id=84eb6cd3985349529d15f0a5f9b18eaf)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:16.524235 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a2e9e-73a0-4f6d-b3ee-087f62ac540e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:16.538448 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-fbceac1c-0b37-4cdb-8b4e-b308f00cd5a3 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:16.539679 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fbceac1c-0b37-4cdb-8b4e-b308f00cd5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:16.613843 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 902/1821] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:16.626673 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee833e3-9ebd-497f-83ca-cae2acb64dcf None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:16.635057 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee833e3-9ebd-497f-83ca-cae2acb64dcf None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:16.635057 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee833e3-9ebd-497f-83ca-cae2acb64dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:16.665693 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bd3a2e9e-73a0-4f6d-b3ee-087f62ac540e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84eb6cd3985349529d15f0a5f9b18eaf'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:16.669063 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bd3a2e9e-73a0-4f6d-b3ee-087f62ac540e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84eb6cd3985349529d15f0a5f9b18eaf'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:16.670234 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bd3a2e9e-73a0-4f6d-b3ee-087f62ac540e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84eb6cd3985349529d15f0a5f9b18eaf'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:16.690647 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bd3a2e9e-73a0-4f6d-b3ee-087f62ac540e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84eb6cd3985349529d15f0a5f9b18eaf'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:16.718672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5ee833e3-9ebd-497f-83ca-cae2acb64dcf None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:16.726152 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5ee833e3-9ebd-497f-83ca-cae2acb64dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:16.731624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bd3a2e9e-73a0-4f6d-b3ee-087f62ac540e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84eb6cd3985349529d15f0a5f9b18eaf'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:16.759223 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 903/1822] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:16.765118 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee833e3-9ebd-497f-83ca-cae2acb64dcf None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:16.801589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 920/1823] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:16 2022] DELETE /identity/v3/users/84eb6cd3985349529d15f0a5f9b18eaf => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:16.806118 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e41d7-6278-4418-89fa-6d76e75fe27b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:16.806586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e41d7-6278-4418-89fa-6d76e75fe27b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:16.807025 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e41d7-6278-4418-89fa-6d76e75fe27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:16.810934 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee833e3-9ebd-497f-83ca-cae2acb64dcf None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:16.898250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1d5e41d7-6278-4418-89fa-6d76e75fe27b None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:16.911576 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1d5e41d7-6278-4418-89fa-6d76e75fe27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:17.107679 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f8ed-45a6-4d67-bad2-4676e7376bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:17.108377 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f8ed-45a6-4d67-bad2-4676e7376bef admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:17.112569 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f8ed-45a6-4d67-bad2-4676e7376bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:17.112947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f8ed-45a6-4d67-bad2-4676e7376bef admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:17.113713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178f8ed-45a6-4d67-bad2-4676e7376bef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:17.114019 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178f8ed-45a6-4d67-bad2-4676e7376bef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:17.122546 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178f8ed-45a6-4d67-bad2-4676e7376bef admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:17.179890 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 904/1824] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:17.181152 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f8ed-45a6-4d67-bad2-4676e7376bef admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:17.225750 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 921/1825] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:17.227542 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f8ed-45a6-4d67-bad2-4676e7376bef admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:17.260057 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4c635-095c-4593-8d35-bddcf439765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:17.260830 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4c635-095c-4593-8d35-bddcf439765a admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:17.261022 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4c635-095c-4593-8d35-bddcf439765a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:17.261285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4c635-095c-4593-8d35-bddcf439765a admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:17.262041 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4c635-095c-4593-8d35-bddcf439765a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:17.264011 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4c635-095c-4593-8d35-bddcf439765a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:17.294125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e41d7-6278-4418-89fa-6d76e75fe27b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:17.297147 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1d5e41d7-6278-4418-89fa-6d76e75fe27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:17.388435 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 905/1826] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:17 2022] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:17.389488 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4c635-095c-4593-8d35-bddcf439765a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:17.575740 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e41d7-6278-4418-89fa-6d76e75fe27b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:17.615878 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4c635-095c-4593-8d35-bddcf439765a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:17.621043 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb0e59-a8e1-4582-a091-49da6c66b90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:17.622222 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb0e59-a8e1-4582-a091-49da6c66b90b admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:17.622808 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb0e59-a8e1-4582-a091-49da6c66b90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:17.623258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb0e59-a8e1-4582-a091-49da6c66b90b admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:17.624133 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb0e59-a8e1-4582-a091-49da6c66b90b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:17.627126 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb0e59-a8e1-4582-a091-49da6c66b90b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:17.679997 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 906/1827] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:17 2022] POST /identity/v3/users => generated 283 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:17.681045 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb0e59-a8e1-4582-a091-49da6c66b90b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:17.718363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb0e59-a8e1-4582-a091-49da6c66b90b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:17.739003 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4b1fe-eecf-4eaf-ab00-c9af948e659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:17.744923 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4b1fe-eecf-4eaf-ab00-c9af948e659c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:17.745559 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4b1fe-eecf-4eaf-ab00-c9af948e659c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:17.749364 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4b1fe-eecf-4eaf-ab00-c9af948e659c admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:17.751930 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4b1fe-eecf-4eaf-ab00-c9af948e659c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:17.759020 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172aa111-849c-4732-9c36-45270aa8b7ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:17.759231 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4b1fe-eecf-4eaf-ab00-c9af948e659c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:17.760302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aa111-849c-4732-9c36-45270aa8b7ad service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:17.763160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aa111-849c-4732-9c36-45270aa8b7ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:17.763971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aa111-849c-4732-9c36-45270aa8b7ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:17.799561 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172aa111-849c-4732-9c36-45270aa8b7ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:17.804066 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 907/1828] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:17.805433 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4b1fe-eecf-4eaf-ab00-c9af948e659c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:17.822270 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172aa111-849c-4732-9c36-45270aa8b7ad service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:17.837137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4b1fe-eecf-4eaf-ab00-c9af948e659c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:17.855847 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 922/1829] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:06:17.869146 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bbb80-f29a-4f8f-bae4-3f3f8a5c6833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:17.873472 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bbb80-f29a-4f8f-bae4-3f3f8a5c6833 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:17.876484 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bbb80-f29a-4f8f-bae4-3f3f8a5c6833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:17.876927 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bbb80-f29a-4f8f-bae4-3f3f8a5c6833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:17.878108 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bbb80-f29a-4f8f-bae4-3f3f8a5c6833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:17.883597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bbb80-f29a-4f8f-bae4-3f3f8a5c6833 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:17.919202 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 908/1830] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:17.924001 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172aa111-849c-4732-9c36-45270aa8b7ad service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:17.948636 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172aa111-849c-4732-9c36-45270aa8b7ad service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:17.977470 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab7045-b29d-4b99-a0b4-4255a5e586bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:17.978617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab7045-b29d-4b99-a0b4-4255a5e586bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:17.979135 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab7045-b29d-4b99-a0b4-4255a5e586bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:17.980389 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab7045-b29d-4b99-a0b4-4255a5e586bb admin admin] PATH_INFO: `/v3/projects/4df3ccbaf64146ec9d94a9f74a862af7/users/767ad83f8bbe490697d5af60bbda2ce9/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:18.038658 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab7045-b29d-4b99-a0b4-4255a5e586bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df3ccbaf64146ec9d94a9f74a862af7, user_id=767ad83f8bbe490697d5af60bbda2ce9, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:18.053375 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab7045-b29d-4b99-a0b4-4255a5e586bb admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:18.088406 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 923/1831] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:17 2022] PUT /identity/v3/projects/4df3ccbaf64146ec9d94a9f74a862af7/users/767ad83f8bbe490697d5af60bbda2ce9/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:18.102337 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7fbdc-f90e-4df8-9a42-8d75d4019840 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:18.102688 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7fbdc-f90e-4df8-9a42-8d75d4019840 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:18.103506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7fbdc-f90e-4df8-9a42-8d75d4019840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:18.207216 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-19d7fbdc-f90e-4df8-9a42-8d75d4019840 None None] MFA Rules not processed for user `767ad83f8bbe490697d5af60bbda2ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:18.210447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-19d7fbdc-f90e-4df8-9a42-8d75d4019840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:18.351714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab7045-b29d-4b99-a0b4-4255a5e586bb admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:18.353704 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6bab7045-b29d-4b99-a0b4-4255a5e586bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:18.502482 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 909/1832] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:18.508314 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7fbdc-f90e-4df8-9a42-8d75d4019840 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:18.657518 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab7045-b29d-4b99-a0b4-4255a5e586bb admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:18.696105 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabcd74-3114-42f2-a4bd-5980a01f4d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:18.703866 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabcd74-3114-42f2-a4bd-5980a01f4d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:18.704369 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabcd74-3114-42f2-a4bd-5980a01f4d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:18.705611 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabcd74-3114-42f2-a4bd-5980a01f4d2a admin admin] PATH_INFO: `/v3/users/728772aaa642407197b6d253462ca1d5` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:18.711066 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7fbdc-f90e-4df8-9a42-8d75d4019840 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:18.711618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeabcd74-3114-42f2-a4bd-5980a01f4d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=728772aaa642407197b6d253462ca1d5)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:18.713636 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeabcd74-3114-42f2-a4bd-5980a01f4d2a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:18.728957 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260112e-adb0-48f8-9621-b7cc64c339cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:18.729866 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260112e-adb0-48f8-9621-b7cc64c339cc admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:18.730315 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260112e-adb0-48f8-9621-b7cc64c339cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:18.731208 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260112e-adb0-48f8-9621-b7cc64c339cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:18.732071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260112e-adb0-48f8-9621-b7cc64c339cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:18.734311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260112e-adb0-48f8-9621-b7cc64c339cc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:18.792727 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 910/1833] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:18 2022] POST /identity/v3/projects => generated 367 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:18.796480 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260112e-adb0-48f8-9621-b7cc64c339cc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:18.887427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-aeabcd74-3114-42f2-a4bd-5980a01f4d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728772aaa642407197b6d253462ca1d5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:18.889398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-aeabcd74-3114-42f2-a4bd-5980a01f4d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728772aaa642407197b6d253462ca1d5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:18.892030 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-aeabcd74-3114-42f2-a4bd-5980a01f4d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728772aaa642407197b6d253462ca1d5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:18.915771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-aeabcd74-3114-42f2-a4bd-5980a01f4d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728772aaa642407197b6d253462ca1d5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:18.940160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-aeabcd74-3114-42f2-a4bd-5980a01f4d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728772aaa642407197b6d253462ca1d5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:18.968369 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 924/1834] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:18 2022] DELETE /identity/v3/users/728772aaa642407197b6d253462ca1d5 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:18.971097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260112e-adb0-48f8-9621-b7cc64c339cc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:18.977476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabcd74-3114-42f2-a4bd-5980a01f4d2a admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:18.979312 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-aeabcd74-3114-42f2-a4bd-5980a01f4d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:19.062663 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703c9f6-e89e-421b-9477-8df66b9bf876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:19.063317 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703c9f6-e89e-421b-9477-8df66b9bf876 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:19.063826 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703c9f6-e89e-421b-9477-8df66b9bf876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:19.064086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703c9f6-e89e-421b-9477-8df66b9bf876 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:19.064978 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703c9f6-e89e-421b-9477-8df66b9bf876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:19.066341 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabcd74-3114-42f2-a4bd-5980a01f4d2a admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:19.067332 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703c9f6-e89e-421b-9477-8df66b9bf876 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:19.071958 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:19.072833 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:19.073122 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:19.073396 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1 admin admin] PATH_INFO: `/v3/projects/7956696a38c1414584734a7c71c76eac` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:19.074589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7956696a38c1414584734a7c71c76eac)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:19.076510 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:19.097085 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 911/1835] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:18 2022] POST /identity/v3/users => generated 290 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:06:19.099213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8c382-ce4a-4b27-bfe5-625e2c6481fa None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:19.099605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8c382-ce4a-4b27-bfe5-625e2c6481fa None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:19.100132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8c382-ce4a-4b27-bfe5-625e2c6481fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:19.133402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7956696a38c1414584734a7c71c76eac', 'request_id': 'req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:19.140305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-bcd8c382-ce4a-4b27-bfe5-625e2c6481fa None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:19.141683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bcd8c382-ce4a-4b27-bfe5-625e2c6481fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:19.144172 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7956696a38c1414584734a7c71c76eac', 'request_id': 'req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:19.155251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7956696a38c1414584734a7c71c76eac', 'request_id': 'req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:19.174262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1 admin admin] The token cache is being invalidate because project 7956696a38c1414584734a7c71c76eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:19.174529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:19.175583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:19.183402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 925/1836] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:18 2022] DELETE /identity/v3/projects/7956696a38c1414584734a7c71c76eac => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:19.184501 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:19.187277 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:19.245977 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 912/1837] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:19.247785 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8c382-ce4a-4b27-bfe5-625e2c6481fa None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:19.251107 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bcd8c382-ce4a-4b27-bfe5-625e2c6481fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:19.266971 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8c382-ce4a-4b27-bfe5-625e2c6481fa None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:19.275743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aa31d-a3e3-4295-8a33-f3179cefa536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:19.276948 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aa31d-a3e3-4295-8a33-f3179cefa536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:19.277570 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aa31d-a3e3-4295-8a33-f3179cefa536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:19.277570 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aa31d-a3e3-4295-8a33-f3179cefa536 admin admin] PATH_INFO: `/v3/users/2d7be409290143c0bb62e0b24103b063` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:19.279281 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4aa31d-a3e3-4295-8a33-f3179cefa536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7be409290143c0bb62e0b24103b063)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:19.282494 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4aa31d-a3e3-4295-8a33-f3179cefa536 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:19.313405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ef8bc-01f2-44a6-a792-a4d1265ed7b1 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:19.322939 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08459bd6-f72e-43e4-925c-7ee12a43ef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:19.323864 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08459bd6-f72e-43e4-925c-7ee12a43ef63 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:19.324271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08459bd6-f72e-43e4-925c-7ee12a43ef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:19.324553 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08459bd6-f72e-43e4-925c-7ee12a43ef63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:19.326258 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08459bd6-f72e-43e4-925c-7ee12a43ef63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:19.327931 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08459bd6-f72e-43e4-925c-7ee12a43ef63 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:19.342659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 926/1838] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:19.343723 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08459bd6-f72e-43e4-925c-7ee12a43ef63 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:19.357346 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7f4aa31d-a3e3-4295-8a33-f3179cefa536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7be409290143c0bb62e0b24103b063'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:19.358447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7f4aa31d-a3e3-4295-8a33-f3179cefa536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7be409290143c0bb62e0b24103b063'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:19.359265 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7f4aa31d-a3e3-4295-8a33-f3179cefa536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7be409290143c0bb62e0b24103b063'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:19.360347 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-08459bd6-f72e-43e4-925c-7ee12a43ef63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:19.370667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7f4aa31d-a3e3-4295-8a33-f3179cefa536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7be409290143c0bb62e0b24103b063'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:19.389885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7f4aa31d-a3e3-4295-8a33-f3179cefa536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7be409290143c0bb62e0b24103b063'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:19.427114 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 913/1839] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:19 2022] DELETE /identity/v3/users/2d7be409290143c0bb62e0b24103b063 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:19.430455 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aa31d-a3e3-4295-8a33-f3179cefa536 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:19.433151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7f4aa31d-a3e3-4295-8a33-f3179cefa536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:19.486615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08459bd6-f72e-43e4-925c-7ee12a43ef63 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:19.546932 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aa31d-a3e3-4295-8a33-f3179cefa536 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:19.559762 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b91c7-622e-47e2-9c32-0459ca6f1a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:19.560676 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b91c7-622e-47e2-9c32-0459ca6f1a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:19.560986 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b91c7-622e-47e2-9c32-0459ca6f1a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:19.561265 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b91c7-622e-47e2-9c32-0459ca6f1a6d admin admin] PATH_INFO: `/v3/projects/ea09a70d51ec4eada54ae3f881532c38/users/42c4c29cad41472fa053e22dc6c82c26/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:19.561861 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53496c4c-6e2f-4558-8e6d-cb17eaa7a30c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:19.562640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53496c4c-6e2f-4558-8e6d-cb17eaa7a30c service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:19.562974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53496c4c-6e2f-4558-8e6d-cb17eaa7a30c service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:19.563311 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53496c4c-6e2f-4558-8e6d-cb17eaa7a30c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:19.565494 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-53496c4c-6e2f-4558-8e6d-cb17eaa7a30c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:19.598859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b91c7-622e-47e2-9c32-0459ca6f1a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea09a70d51ec4eada54ae3f881532c38, user_id=42c4c29cad41472fa053e22dc6c82c26, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:19.599677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53496c4c-6e2f-4558-8e6d-cb17eaa7a30c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:19.601658 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53496c4c-6e2f-4558-8e6d-cb17eaa7a30c service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:19.604543 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b91c7-622e-47e2-9c32-0459ca6f1a6d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:19.619923 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 927/1840] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:19.621784 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad42c8-5faf-4e79-bab3-cb758420f78d None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:19.622590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad42c8-5faf-4e79-bab3-cb758420f78d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:19.623136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad42c8-5faf-4e79-bab3-cb758420f78d None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:19.625478 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 928/1841] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 27 05:06:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:06:19.627924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 914/1842] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:19 2022] PUT /identity/v3/projects/ea09a70d51ec4eada54ae3f881532c38/users/42c4c29cad41472fa053e22dc6c82c26/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:19.632821 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad42c8-5faf-4e79-bab3-cb758420f78d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:19.634714 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dce249-e02c-42e9-b33a-fc07b9970db5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:19.635014 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dce249-e02c-42e9-b33a-fc07b9970db5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:19.635538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dce249-e02c-42e9-b33a-fc07b9970db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:19.658175 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-98dce249-e02c-42e9-b33a-fc07b9970db5 None None] MFA Rules not processed for user `faac84ed9d37420c811bbf6ac7df0b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:19.659560 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-98dce249-e02c-42e9-b33a-fc07b9970db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:19.752381 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad42c8-5faf-4e79-bab3-cb758420f78d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:19.759507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faa37e-2233-43cd-9209-487eaadc1ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:19.761015 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faa37e-2233-43cd-9209-487eaadc1ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:19.761536 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faa37e-2233-43cd-9209-487eaadc1ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:19.762137 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faa37e-2233-43cd-9209-487eaadc1ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:19.763561 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 915/1843] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 27 05:06:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:19.764042 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44faa37e-2233-43cd-9209-487eaadc1ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:19.767595 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44faa37e-2233-43cd-9209-487eaadc1ea7 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:19.781255 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dce249-e02c-42e9-b33a-fc07b9970db5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:19.782262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 929/1844] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:19.783199 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-98dce249-e02c-42e9-b33a-fc07b9970db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:19.786357 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faa37e-2233-43cd-9209-487eaadc1ea7 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:19.800762 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dce249-e02c-42e9-b33a-fc07b9970db5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:19.803337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faa37e-2233-43cd-9209-487eaadc1ea7 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:19.806892 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069ea2d-5e10-4c42-b5e8-2bf0dbdc0e1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:19.807596 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069ea2d-5e10-4c42-b5e8-2bf0dbdc0e1f service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:19.807876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069ea2d-5e10-4c42-b5e8-2bf0dbdc0e1f service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:19.808157 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069ea2d-5e10-4c42-b5e8-2bf0dbdc0e1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:19.811027 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb41d78-1f45-486f-a8b7-4708d7fb8687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:19.812679 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb41d78-1f45-486f-a8b7-4708d7fb8687 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:19.813350 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb41d78-1f45-486f-a8b7-4708d7fb8687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:19.813867 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb41d78-1f45-486f-a8b7-4708d7fb8687 admin admin] PATH_INFO: `/v3/projects/ea09a70d51ec4eada54ae3f881532c38/users/42c4c29cad41472fa053e22dc6c82c26/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:19.818706 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb41d78-1f45-486f-a8b7-4708d7fb8687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea09a70d51ec4eada54ae3f881532c38, user_id=42c4c29cad41472fa053e22dc6c82c26, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:19.820119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069ea2d-5e10-4c42-b5e8-2bf0dbdc0e1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:19.822645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069ea2d-5e10-4c42-b5e8-2bf0dbdc0e1f service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:19.823365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb41d78-1f45-486f-a8b7-4708d7fb8687 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:19.843093 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 916/1845] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:19.843809 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 930/1846] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:19 2022] PUT /identity/v3/projects/ea09a70d51ec4eada54ae3f881532c38/users/42c4c29cad41472fa053e22dc6c82c26/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:19.856353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8396f-bfcf-487b-bff4-0716557d867a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:19.856672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8396f-bfcf-487b-bff4-0716557d867a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:19.856933 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8396f-bfcf-487b-bff4-0716557d867a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:19.895197 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb41d78-1f45-486f-a8b7-4708d7fb8687 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:19.897519 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1fb41d78-1f45-486f-a8b7-4708d7fb8687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:19.929092 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-14b8396f-bfcf-487b-bff4-0716557d867a None None] MFA Rules not processed for user `42c4c29cad41472fa053e22dc6c82c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:19.930597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-14b8396f-bfcf-487b-bff4-0716557d867a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:20.044235 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb41d78-1f45-486f-a8b7-4708d7fb8687 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:20.050957 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a12045-9709-4003-afe0-a73195bab49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:20.051848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a12045-9709-4003-afe0-a73195bab49b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:20.052107 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a12045-9709-4003-afe0-a73195bab49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:20.052386 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a12045-9709-4003-afe0-a73195bab49b admin admin] PATH_INFO: `/v3/projects/51d3b99e16544a34bed2d9e9c66b488d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:20.054209 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a12045-9709-4003-afe0-a73195bab49b admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d3b99e16544a34bed2d9e9c66b488d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:20.056412 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a12045-9709-4003-afe0-a73195bab49b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:20.067247 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 917/1847] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:19 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:20.079396 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8396f-bfcf-487b-bff4-0716557d867a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:20.081618 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-14b8396f-bfcf-487b-bff4-0716557d867a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:20.117085 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c1a12045-9709-4003-afe0-a73195bab49b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d3b99e16544a34bed2d9e9c66b488d', 'request_id': 'req-c1a12045-9709-4003-afe0-a73195bab49b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:20.124170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c1a12045-9709-4003-afe0-a73195bab49b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d3b99e16544a34bed2d9e9c66b488d', 'request_id': 'req-c1a12045-9709-4003-afe0-a73195bab49b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:20.134776 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c1a12045-9709-4003-afe0-a73195bab49b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d3b99e16544a34bed2d9e9c66b488d', 'request_id': 'req-c1a12045-9709-4003-afe0-a73195bab49b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:20.155093 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8396f-bfcf-487b-bff4-0716557d867a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:20.156738 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c1a12045-9709-4003-afe0-a73195bab49b admin admin] The token cache is being invalidate because project 51d3b99e16544a34bed2d9e9c66b488d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:20.157234 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c1a12045-9709-4003-afe0-a73195bab49b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:20.157911 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c1a12045-9709-4003-afe0-a73195bab49b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:20.163389 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 931/1848] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:19 2022] DELETE /identity/v3/projects/51d3b99e16544a34bed2d9e9c66b488d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:20.163389 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a12045-9709-4003-afe0-a73195bab49b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:20.163389 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c1a12045-9709-4003-afe0-a73195bab49b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:20.213330 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1a9b8-08c6-4a0d-bb9b-79781245ddb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:20.214175 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1a9b8-08c6-4a0d-bb9b-79781245ddb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:20.214535 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1a9b8-08c6-4a0d-bb9b-79781245ddb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:20.214883 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1a9b8-08c6-4a0d-bb9b-79781245ddb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:20.216849 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b7f1a9b8-08c6-4a0d-bb9b-79781245ddb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:20.239849 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a12045-9709-4003-afe0-a73195bab49b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:20.252397 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9e204-a237-4fc9-aa62-9fe9c141ca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:20.253744 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9e204-a237-4fc9-aa62-9fe9c141ca59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:20.254494 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9e204-a237-4fc9-aa62-9fe9c141ca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:20.254777 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9e204-a237-4fc9-aa62-9fe9c141ca59 admin admin] PATH_INFO: `/v3/projects/73d3bdd0a50c405fb8917b1a27dac128` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:20.256287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9e204-a237-4fc9-aa62-9fe9c141ca59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d3bdd0a50c405fb8917b1a27dac128)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:20.258317 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9e204-a237-4fc9-aa62-9fe9c141ca59 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:20.308930 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1a9b8-08c6-4a0d-bb9b-79781245ddb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:20.310421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1a9b8-08c6-4a0d-bb9b-79781245ddb3 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:20.327580 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 918/1849] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:20 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:06:20.329720 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823e62-5510-4132-a10e-7a5e905fe915 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:20.330172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823e62-5510-4132-a10e-7a5e905fe915 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:20.330670 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823e62-5510-4132-a10e-7a5e905fe915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:20.334924 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86a9e204-a237-4fc9-aa62-9fe9c141ca59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d3bdd0a50c405fb8917b1a27dac128', 'request_id': 'req-86a9e204-a237-4fc9-aa62-9fe9c141ca59'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:20.343329 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86a9e204-a237-4fc9-aa62-9fe9c141ca59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d3bdd0a50c405fb8917b1a27dac128', 'request_id': 'req-86a9e204-a237-4fc9-aa62-9fe9c141ca59'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:20.357609 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-56823e62-5510-4132-a10e-7a5e905fe915 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:20.361378 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-56823e62-5510-4132-a10e-7a5e905fe915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:20.366257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86a9e204-a237-4fc9-aa62-9fe9c141ca59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d3bdd0a50c405fb8917b1a27dac128', 'request_id': 'req-86a9e204-a237-4fc9-aa62-9fe9c141ca59'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:20.396570 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86a9e204-a237-4fc9-aa62-9fe9c141ca59 admin admin] The token cache is being invalidate because project 73d3bdd0a50c405fb8917b1a27dac128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:20.397082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86a9e204-a237-4fc9-aa62-9fe9c141ca59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:20.397891 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-86a9e204-a237-4fc9-aa62-9fe9c141ca59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:20.403914 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 932/1850] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:20 2022] DELETE /identity/v3/projects/73d3bdd0a50c405fb8917b1a27dac128 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:20.405185 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9e204-a237-4fc9-aa62-9fe9c141ca59 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:20.407297 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-86a9e204-a237-4fc9-aa62-9fe9c141ca59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:20.472825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 919/1851] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:20.488919 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576be200-c35b-4d38-9cc3-c54f34c989ac None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:20.489831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576be200-c35b-4d38-9cc3-c54f34c989ac None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:20.491131 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576be200-c35b-4d38-9cc3-c54f34c989ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:20.526938 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-576be200-c35b-4d38-9cc3-c54f34c989ac None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:20.529558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-576be200-c35b-4d38-9cc3-c54f34c989ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:20.548554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 920/1852] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:20.549636 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576be200-c35b-4d38-9cc3-c54f34c989ac None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:20.550975 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-576be200-c35b-4d38-9cc3-c54f34c989ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:20.615819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9e204-a237-4fc9-aa62-9fe9c141ca59 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:20.626471 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd94bb8-3c61-4a5d-9169-404cdcc41f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:20.627877 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd94bb8-3c61-4a5d-9169-404cdcc41f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:20.628164 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd94bb8-3c61-4a5d-9169-404cdcc41f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:20.628459 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd94bb8-3c61-4a5d-9169-404cdcc41f29 admin admin] PATH_INFO: `/v3/users/5406b950a80140dca76beb656369d697` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:20.629819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd94bb8-3c61-4a5d-9169-404cdcc41f29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5406b950a80140dca76beb656369d697)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:20.633182 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd94bb8-3c61-4a5d-9169-404cdcc41f29 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:20.674660 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576be200-c35b-4d38-9cc3-c54f34c989ac None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:20.679038 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf37ec7-d90a-43dc-80c2-88b172444c47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:20.679692 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf37ec7-d90a-43dc-80c2-88b172444c47 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:20.679997 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf37ec7-d90a-43dc-80c2-88b172444c47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:20.680287 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf37ec7-d90a-43dc-80c2-88b172444c47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:20.687690 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4bf37ec7-d90a-43dc-80c2-88b172444c47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:20.692751 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2bd94bb8-3c61-4a5d-9169-404cdcc41f29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5406b950a80140dca76beb656369d697'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:20.693916 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2bd94bb8-3c61-4a5d-9169-404cdcc41f29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5406b950a80140dca76beb656369d697'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:20.695031 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2bd94bb8-3c61-4a5d-9169-404cdcc41f29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5406b950a80140dca76beb656369d697'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:20.703037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2bd94bb8-3c61-4a5d-9169-404cdcc41f29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5406b950a80140dca76beb656369d697'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:20.716455 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-2bd94bb8-3c61-4a5d-9169-404cdcc41f29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5406b950a80140dca76beb656369d697'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:20.731229 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 933/1853] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:20 2022] DELETE /identity/v3/users/5406b950a80140dca76beb656369d697 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:20.735187 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd94bb8-3c61-4a5d-9169-404cdcc41f29 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:20.737362 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2bd94bb8-3c61-4a5d-9169-404cdcc41f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:20.830985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf37ec7-d90a-43dc-80c2-88b172444c47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:20.835809 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf37ec7-d90a-43dc-80c2-88b172444c47 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:20.865243 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd94bb8-3c61-4a5d-9169-404cdcc41f29 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:20.865917 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 921/1854] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:20.899159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c10019-8904-4785-a3c6-eb4873848d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:20.904972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c10019-8904-4785-a3c6-eb4873848d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:20.906656 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c10019-8904-4785-a3c6-eb4873848d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:20.906834 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c10019-8904-4785-a3c6-eb4873848d05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:20.909333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c10019-8904-4785-a3c6-eb4873848d05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:20.909665 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c10019-8904-4785-a3c6-eb4873848d05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:20.917583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c10019-8904-4785-a3c6-eb4873848d05 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:20.935878 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 934/1855] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:20.940344 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf37ec7-d90a-43dc-80c2-88b172444c47 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:20.958011 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf37ec7-d90a-43dc-80c2-88b172444c47 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:20.969609 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c64b13-aa63-4d6f-8e40-2c5eb848ec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:20.970611 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c64b13-aa63-4d6f-8e40-2c5eb848ec49 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:20.970728 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c64b13-aa63-4d6f-8e40-2c5eb848ec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:20.971030 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c64b13-aa63-4d6f-8e40-2c5eb848ec49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:20.972817 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c64b13-aa63-4d6f-8e40-2c5eb848ec49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:20.976839 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c64b13-aa63-4d6f-8e40-2c5eb848ec49 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:21.075488 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 922/1856] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:20 2022] POST /identity/v3/projects => generated 357 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:21.080827 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c10019-8904-4785-a3c6-eb4873848d05 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:21.157326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c10019-8904-4785-a3c6-eb4873848d05 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:21.268072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c64b13-aa63-4d6f-8e40-2c5eb848ec49 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:21.270162 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f2c64b13-aa63-4d6f-8e40-2c5eb848ec49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:21.378244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12c2f0-80fd-4701-9840-d567e7cf68d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:21.379649 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12c2f0-80fd-4701-9840-d567e7cf68d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:21.379939 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12c2f0-80fd-4701-9840-d567e7cf68d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:21.380214 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12c2f0-80fd-4701-9840-d567e7cf68d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:21.384073 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12c2f0-80fd-4701-9840-d567e7cf68d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:21.388294 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12c2f0-80fd-4701-9840-d567e7cf68d0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:21.464366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 935/1857] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:21 2022] POST /identity/v3/users => generated 279 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:21.465546 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12c2f0-80fd-4701-9840-d567e7cf68d0 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:21.471305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c64b13-aa63-4d6f-8e40-2c5eb848ec49 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:21.480535 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c809ac3-0c1b-4221-8f9d-4a1585363cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:21.481459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c809ac3-0c1b-4221-8f9d-4a1585363cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:21.481745 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c809ac3-0c1b-4221-8f9d-4a1585363cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:21.482027 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c809ac3-0c1b-4221-8f9d-4a1585363cbe admin admin] PATH_INFO: `/v3/projects/2707f13523f84facb2e413d22a019e4d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:21.483526 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c809ac3-0c1b-4221-8f9d-4a1585363cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2707f13523f84facb2e413d22a019e4d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:21.485533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c809ac3-0c1b-4221-8f9d-4a1585363cbe admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:21.491700 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12c2f0-80fd-4701-9840-d567e7cf68d0 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:21.505274 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e83900-1a0d-4bb3-b07e-88addbaf837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:21.506848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e83900-1a0d-4bb3-b07e-88addbaf837b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:21.507350 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e83900-1a0d-4bb3-b07e-88addbaf837b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:21.507802 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e83900-1a0d-4bb3-b07e-88addbaf837b admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:21.508679 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e83900-1a0d-4bb3-b07e-88addbaf837b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:21.510339 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e83900-1a0d-4bb3-b07e-88addbaf837b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:21.539723 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 936/1858] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:21.544816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e83900-1a0d-4bb3-b07e-88addbaf837b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:21.574744 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e83900-1a0d-4bb3-b07e-88addbaf837b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:21.577859 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251dbee-789a-4edf-830c-e11ad4bb3b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:21.578541 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251dbee-789a-4edf-830c-e11ad4bb3b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:21.578814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251dbee-789a-4edf-830c-e11ad4bb3b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:21.579085 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251dbee-789a-4edf-830c-e11ad4bb3b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:21.579993 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251dbee-789a-4edf-830c-e11ad4bb3b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:21.582180 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251dbee-789a-4edf-830c-e11ad4bb3b9a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:21.610323 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 937/1859] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:06:21.611684 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251dbee-789a-4edf-830c-e11ad4bb3b9a admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:21.631006 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251dbee-789a-4edf-830c-e11ad4bb3b9a admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:21.643148 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa476e-0168-4ffb-b8fe-4c1b575003b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:21.644046 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa476e-0168-4ffb-b8fe-4c1b575003b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:21.644313 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa476e-0168-4ffb-b8fe-4c1b575003b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:21.647896 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa476e-0168-4ffb-b8fe-4c1b575003b4 admin admin] PATH_INFO: `/v3/projects/5dcfb0971c2a415e9a3a4b3be5d858bd/users/8d72f0a3fe72443e90c39de21e5d15a2/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:21.711027 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa476e-0168-4ffb-b8fe-4c1b575003b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dcfb0971c2a415e9a3a4b3be5d858bd, user_id=8d72f0a3fe72443e90c39de21e5d15a2, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:21.720997 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa476e-0168-4ffb-b8fe-4c1b575003b4 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:21.751859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6c809ac3-0c1b-4221-8f9d-4a1585363cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2707f13523f84facb2e413d22a019e4d', 'request_id': 'req-6c809ac3-0c1b-4221-8f9d-4a1585363cbe'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:21.754629 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 938/1860] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:21 2022] PUT /identity/v3/projects/5dcfb0971c2a415e9a3a4b3be5d858bd/users/8d72f0a3fe72443e90c39de21e5d15a2/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:21.770969 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aec1c9-42aa-49cc-9351-857090556fd1 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:21.771895 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aec1c9-42aa-49cc-9351-857090556fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:21.772326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aec1c9-42aa-49cc-9351-857090556fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:21.777765 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6c809ac3-0c1b-4221-8f9d-4a1585363cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2707f13523f84facb2e413d22a019e4d', 'request_id': 'req-6c809ac3-0c1b-4221-8f9d-4a1585363cbe'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:21.803109 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6c809ac3-0c1b-4221-8f9d-4a1585363cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2707f13523f84facb2e413d22a019e4d', 'request_id': 'req-6c809ac3-0c1b-4221-8f9d-4a1585363cbe'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:21.836655 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6c809ac3-0c1b-4221-8f9d-4a1585363cbe admin admin] The token cache is being invalidate because project 2707f13523f84facb2e413d22a019e4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:21.852899 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6c809ac3-0c1b-4221-8f9d-4a1585363cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:21.853548 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-40aec1c9-42aa-49cc-9351-857090556fd1 None None] MFA Rules not processed for user `8d72f0a3fe72443e90c39de21e5d15a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:21.854471 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-40aec1c9-42aa-49cc-9351-857090556fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:21.854775 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6c809ac3-0c1b-4221-8f9d-4a1585363cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:21.860072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 923/1861] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:21 2022] DELETE /identity/v3/projects/2707f13523f84facb2e413d22a019e4d => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:21.866387 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14dfa90-b552-43aa-a7d9-1a72816d6d2a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:21.866808 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14dfa90-b552-43aa-a7d9-1a72816d6d2a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:21.867000 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14dfa90-b552-43aa-a7d9-1a72816d6d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:21.939206 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f14dfa90-b552-43aa-a7d9-1a72816d6d2a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:21.940654 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f14dfa90-b552-43aa-a7d9-1a72816d6d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:21.956846 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 939/1862] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:21 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:21.960675 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aec1c9-42aa-49cc-9351-857090556fd1 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:21.964663 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-40aec1c9-42aa-49cc-9351-857090556fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:22.128494 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 924/1863] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:22.139490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fcd47-77c1-4658-8993-210934886c54 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:22.149313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fcd47-77c1-4658-8993-210934886c54 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:22.149916 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fcd47-77c1-4658-8993-210934886c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:22.163122 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aec1c9-42aa-49cc-9351-857090556fd1 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:22.179323 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a44c37-afc9-444b-90e4-1c42f12784e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:22.179638 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a44c37-afc9-444b-90e4-1c42f12784e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:22.180049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a44c37-afc9-444b-90e4-1c42f12784e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:22.180382 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a44c37-afc9-444b-90e4-1c42f12784e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:22.181208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a44c37-afc9-444b-90e4-1c42f12784e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:22.186530 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a44c37-afc9-444b-90e4-1c42f12784e6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:22.225820 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a95fcd47-77c1-4658-8993-210934886c54 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:22.229729 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a95fcd47-77c1-4658-8993-210934886c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:22.244396 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 940/1864] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:21 2022] POST /identity/v3/projects => generated 355 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:22.248003 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a44c37-afc9-444b-90e4-1c42f12784e6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:22.381100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 925/1865] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:22.382404 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fcd47-77c1-4658-8993-210934886c54 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:22.402137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fcd47-77c1-4658-8993-210934886c54 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:22.415416 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ccabc-77f8-4911-9741-20aad8418a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:22.416096 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ccabc-77f8-4911-9741-20aad8418a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:22.416387 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ccabc-77f8-4911-9741-20aad8418a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:22.416687 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ccabc-77f8-4911-9741-20aad8418a49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:22.417451 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ccabc-77f8-4911-9741-20aad8418a49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:22.417761 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ccabc-77f8-4911-9741-20aad8418a49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:22.419453 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ccabc-77f8-4911-9741-20aad8418a49 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:22.421989 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a44c37-afc9-444b-90e4-1c42f12784e6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:22.465840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 926/1866] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 05:06:22.471321 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ccabc-77f8-4911-9741-20aad8418a49 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:22.472588 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102a19a-b740-47d3-a64d-8d8d4decfdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:22.479746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102a19a-b740-47d3-a64d-8d8d4decfdc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:22.480212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102a19a-b740-47d3-a64d-8d8d4decfdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:22.480825 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102a19a-b740-47d3-a64d-8d8d4decfdc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:22.483136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102a19a-b740-47d3-a64d-8d8d4decfdc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:22.492066 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102a19a-b740-47d3-a64d-8d8d4decfdc6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:22.512811 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ccabc-77f8-4911-9741-20aad8418a49 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:22.518526 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d770b-0099-4b7b-9613-1ef6437a0689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:22.519534 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d770b-0099-4b7b-9613-1ef6437a0689 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:22.519964 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d770b-0099-4b7b-9613-1ef6437a0689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:22.526014 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d770b-0099-4b7b-9613-1ef6437a0689 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:22.527061 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d770b-0099-4b7b-9613-1ef6437a0689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:22.529223 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d770b-0099-4b7b-9613-1ef6437a0689 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:22.567363 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 941/1867] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:22 2022] POST /identity/v3/users => generated 284 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:22.572652 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102a19a-b740-47d3-a64d-8d8d4decfdc6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:22.601103 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102a19a-b740-47d3-a64d-8d8d4decfdc6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:22.618923 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 927/1868] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:22 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:22.620413 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d770b-0099-4b7b-9613-1ef6437a0689 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:22.635867 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c503fa9-1efa-4b76-84fc-8d3da39326e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:22.637907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c503fa9-1efa-4b76-84fc-8d3da39326e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:22.638330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c503fa9-1efa-4b76-84fc-8d3da39326e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:22.639899 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c503fa9-1efa-4b76-84fc-8d3da39326e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:22.646508 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c503fa9-1efa-4b76-84fc-8d3da39326e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:22.648350 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c503fa9-1efa-4b76-84fc-8d3da39326e6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:22.705956 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 942/1869] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:22.706906 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c503fa9-1efa-4b76-84fc-8d3da39326e6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:22.747913 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c503fa9-1efa-4b76-84fc-8d3da39326e6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:22.900172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d770b-0099-4b7b-9613-1ef6437a0689 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:22.914082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3c60e-7df9-4600-b9c5-c2adf8db5de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:22.914872 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3c60e-7df9-4600-b9c5-c2adf8db5de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:22.915492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3c60e-7df9-4600-b9c5-c2adf8db5de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:22.917126 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3c60e-7df9-4600-b9c5-c2adf8db5de9 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:22.917943 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3c60e-7df9-4600-b9c5-c2adf8db5de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:22.932883 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3c60e-7df9-4600-b9c5-c2adf8db5de9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:22.945922 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ea906-ab27-4385-902a-9c7da5838359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:22.946954 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ea906-ab27-4385-902a-9c7da5838359 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:22.951878 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ea906-ab27-4385-902a-9c7da5838359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:22.966265 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ea906-ab27-4385-902a-9c7da5838359 admin admin] PATH_INFO: `/v3/projects/ee5eb12180dd471babfdf3cb0585b93b/users/d84f6a83bae24201b479373df6930eb9/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:22.971809 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ea906-ab27-4385-902a-9c7da5838359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5eb12180dd471babfdf3cb0585b93b, user_id=d84f6a83bae24201b479373df6930eb9, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:22.975362 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ea906-ab27-4385-902a-9c7da5838359 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:22.991236 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 928/1870] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:22 2022] POST /identity/v3/users => generated 294 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:22.992365 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3c60e-7df9-4600-b9c5-c2adf8db5de9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:23.004713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3c60e-7df9-4600-b9c5-c2adf8db5de9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:23.006539 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 943/1871] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:22 2022] PUT /identity/v3/projects/ee5eb12180dd471babfdf3cb0585b93b/users/d84f6a83bae24201b479373df6930eb9/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:23.025190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ea906-ab27-4385-902a-9c7da5838359 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:23.211984 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07cbc2-0e37-4f48-ab84-63f76c9455b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:23.212687 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07cbc2-0e37-4f48-ab84-63f76c9455b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:23.212981 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07cbc2-0e37-4f48-ab84-63f76c9455b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:23.213249 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07cbc2-0e37-4f48-ab84-63f76c9455b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:23.216156 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07cbc2-0e37-4f48-ab84-63f76c9455b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:23.218045 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07cbc2-0e37-4f48-ab84-63f76c9455b6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:23.227274 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ea906-ab27-4385-902a-9c7da5838359 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:23.244468 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 929/1872] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:23.247861 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64dbf4-e626-4f81-8fdc-82bfb9a99184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:23.248895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07cbc2-0e37-4f48-ab84-63f76c9455b6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:23.249193 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64dbf4-e626-4f81-8fdc-82bfb9a99184 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:23.249473 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64dbf4-e626-4f81-8fdc-82bfb9a99184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:23.249799 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64dbf4-e626-4f81-8fdc-82bfb9a99184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:23.250782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64dbf4-e626-4f81-8fdc-82bfb9a99184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:23.253231 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64dbf4-e626-4f81-8fdc-82bfb9a99184 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:23.264666 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07cbc2-0e37-4f48-ab84-63f76c9455b6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:23.267804 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 944/1873] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:23.272567 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64dbf4-e626-4f81-8fdc-82bfb9a99184 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:23.273841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963ee2b-c716-450a-a8de-10839ce4ae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:23.274586 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963ee2b-c716-450a-a8de-10839ce4ae3a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:23.274933 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963ee2b-c716-450a-a8de-10839ce4ae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:23.275274 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963ee2b-c716-450a-a8de-10839ce4ae3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:23.276076 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963ee2b-c716-450a-a8de-10839ce4ae3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:23.277869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963ee2b-c716-450a-a8de-10839ce4ae3a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:23.293417 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64dbf4-e626-4f81-8fdc-82bfb9a99184 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:23.294058 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 930/1874] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:23.295156 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963ee2b-c716-450a-a8de-10839ce4ae3a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:23.300852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f90f50-0f0e-4fc8-9a61-22172e517491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:23.303129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f90f50-0f0e-4fc8-9a61-22172e517491 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:23.303759 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f90f50-0f0e-4fc8-9a61-22172e517491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:23.304248 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f90f50-0f0e-4fc8-9a61-22172e517491 admin admin] PATH_INFO: `/v3/projects/ee5eb12180dd471babfdf3cb0585b93b/users/d84f6a83bae24201b479373df6930eb9/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:23.306156 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963ee2b-c716-450a-a8de-10839ce4ae3a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:23.306571 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f90f50-0f0e-4fc8-9a61-22172e517491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5eb12180dd471babfdf3cb0585b93b, user_id=d84f6a83bae24201b479373df6930eb9, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:23.310318 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f90f50-0f0e-4fc8-9a61-22172e517491 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:23.311156 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00376b6c-87b5-4d74-ae4f-1ce326f40a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:23.312026 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00376b6c-87b5-4d74-ae4f-1ce326f40a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:23.312421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00376b6c-87b5-4d74-ae4f-1ce326f40a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:23.313006 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00376b6c-87b5-4d74-ae4f-1ce326f40a6b admin admin] PATH_INFO: `/v3/projects/84d9f0db4d6148f2bfc4da5a572fa39b/users/df7863ee2a4e4c77a5d8b64964a93ed9/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:23.325264 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 945/1875] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:23 2022] PUT /identity/v3/projects/ee5eb12180dd471babfdf3cb0585b93b/users/d84f6a83bae24201b479373df6930eb9/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:23.336402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae811b-fd3f-4d23-9393-cef5aee015b7 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:23.336783 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae811b-fd3f-4d23-9393-cef5aee015b7 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:23.337171 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae811b-fd3f-4d23-9393-cef5aee015b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:23.346787 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00376b6c-87b5-4d74-ae4f-1ce326f40a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d9f0db4d6148f2bfc4da5a572fa39b, user_id=df7863ee2a4e4c77a5d8b64964a93ed9, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:23.351665 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00376b6c-87b5-4d74-ae4f-1ce326f40a6b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:23.368645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 931/1876] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:23 2022] PUT /identity/v3/projects/84d9f0db4d6148f2bfc4da5a572fa39b/users/df7863ee2a4e4c77a5d8b64964a93ed9/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:23.381238 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4c43a-1339-45cf-af92-fddc8f8d882f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:23.381722 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4c43a-1339-45cf-af92-fddc8f8d882f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:23.382042 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4c43a-1339-45cf-af92-fddc8f8d882f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:23.386513 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-34ae811b-fd3f-4d23-9393-cef5aee015b7 None None] MFA Rules not processed for user `d84f6a83bae24201b479373df6930eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:23.387875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-34ae811b-fd3f-4d23-9393-cef5aee015b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:23.419815 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8ba4c43a-1339-45cf-af92-fddc8f8d882f None None] MFA Rules not processed for user `df7863ee2a4e4c77a5d8b64964a93ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:23.421179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8ba4c43a-1339-45cf-af92-fddc8f8d882f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:23.471149 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 946/1877] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:23 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:23.483295 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae811b-fd3f-4d23-9393-cef5aee015b7 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:23.484771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-34ae811b-fd3f-4d23-9393-cef5aee015b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:23.493802 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 932/1878] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:23.498083 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4c43a-1339-45cf-af92-fddc8f8d882f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:23.551228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae811b-fd3f-4d23-9393-cef5aee015b7 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:23.559515 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bcc58-07c0-47f3-8b80-f3481ec3cbfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:23.561396 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bcc58-07c0-47f3-8b80-f3481ec3cbfc service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:23.562466 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bcc58-07c0-47f3-8b80-f3481ec3cbfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:23.562893 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bcc58-07c0-47f3-8b80-f3481ec3cbfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:23.574340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bcc58-07c0-47f3-8b80-f3481ec3cbfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:23.575173 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4c43a-1339-45cf-af92-fddc8f8d882f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:23.576286 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bcc58-07c0-47f3-8b80-f3481ec3cbfc service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:23.580490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799df11-650f-4ce3-8243-8ef7c06a4bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:23.581183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799df11-650f-4ce3-8243-8ef7c06a4bdb admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:23.582171 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799df11-650f-4ce3-8243-8ef7c06a4bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:23.582171 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799df11-650f-4ce3-8243-8ef7c06a4bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:23.582386 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799df11-650f-4ce3-8243-8ef7c06a4bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:23.584963 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799df11-650f-4ce3-8243-8ef7c06a4bdb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:23.588599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 947/1879] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:23 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:06:23.614648 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 933/1880] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:23 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:06:23.618691 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bcc58-07c0-47f3-8b80-f3481ec3cbfc service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:23.631618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bcc58-07c0-47f3-8b80-f3481ec3cbfc service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:23.713886 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799df11-650f-4ce3-8243-8ef7c06a4bdb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:23.721404 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed018ea-dd9e-49b1-a311-fbeff415cbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:23.722278 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed018ea-dd9e-49b1-a311-fbeff415cbe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:23.722613 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed018ea-dd9e-49b1-a311-fbeff415cbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:23.722890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed018ea-dd9e-49b1-a311-fbeff415cbe9 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:23.723697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed018ea-dd9e-49b1-a311-fbeff415cbe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:23.726268 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed018ea-dd9e-49b1-a311-fbeff415cbe9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:23.750727 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 948/1881] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:23 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:23.754955 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed018ea-dd9e-49b1-a311-fbeff415cbe9 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:23.766189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed018ea-dd9e-49b1-a311-fbeff415cbe9 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:23.771059 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874bdfe-8c2f-4d42-b622-9478ca7345db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:23.771863 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874bdfe-8c2f-4d42-b622-9478ca7345db admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:23.772217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874bdfe-8c2f-4d42-b622-9478ca7345db admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:23.772586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874bdfe-8c2f-4d42-b622-9478ca7345db admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:23.773420 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874bdfe-8c2f-4d42-b622-9478ca7345db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:23.775234 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874bdfe-8c2f-4d42-b622-9478ca7345db admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:23.776945 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799df11-650f-4ce3-8243-8ef7c06a4bdb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:23.780828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc3e65-5d17-4d74-a2ab-da6088eaed98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:23.781555 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3e65-5d17-4d74-a2ab-da6088eaed98 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:23.781847 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3e65-5d17-4d74-a2ab-da6088eaed98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:23.782330 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc3e65-5d17-4d74-a2ab-da6088eaed98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:23.785977 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 949/1882] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:06:23.790531 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874bdfe-8c2f-4d42-b622-9478ca7345db admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:23.800496 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874bdfe-8c2f-4d42-b622-9478ca7345db admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:23.806732 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbfac8-2748-4bbb-82ba-6a1f46d3c370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:23.807615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbfac8-2748-4bbb-82ba-6a1f46d3c370 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:23.807894 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbfac8-2748-4bbb-82ba-6a1f46d3c370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:23.808167 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbfac8-2748-4bbb-82ba-6a1f46d3c370 admin admin] PATH_INFO: `/v3/projects/898a75769ac1445889c393ec8b6f8daf/users/35b63936f2fe4dcc8babdb9f84d2a526/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:23.824361 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbfac8-2748-4bbb-82ba-6a1f46d3c370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=898a75769ac1445889c393ec8b6f8daf, user_id=35b63936f2fe4dcc8babdb9f84d2a526, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:23.827095 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbfac8-2748-4bbb-82ba-6a1f46d3c370 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:23.841314 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 950/1883] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:23 2022] PUT /identity/v3/projects/898a75769ac1445889c393ec8b6f8daf/users/35b63936f2fe4dcc8babdb9f84d2a526/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:23.844933 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbfac8-2748-4bbb-82ba-6a1f46d3c370 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:23.846391 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc3e65-5d17-4d74-a2ab-da6088eaed98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:23.848046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc3e65-5d17-4d74-a2ab-da6088eaed98 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:23.859445 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 934/1884] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:23 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:23.913265 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbfac8-2748-4bbb-82ba-6a1f46d3c370 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:23.919174 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc635eb-4b3a-41d1-8b05-b1d7bd25c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:23.919974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc635eb-4b3a-41d1-8b05-b1d7bd25c932 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:23.920395 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc635eb-4b3a-41d1-8b05-b1d7bd25c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:23.920714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc635eb-4b3a-41d1-8b05-b1d7bd25c932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:23.921671 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc635eb-4b3a-41d1-8b05-b1d7bd25c932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:23.923602 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc635eb-4b3a-41d1-8b05-b1d7bd25c932 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:23.936841 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 951/1885] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:06:23.941295 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc3e65-5d17-4d74-a2ab-da6088eaed98 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:23.959502 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc3e65-5d17-4d74-a2ab-da6088eaed98 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:23.965751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20733332-bf68-4543-895b-91d80d60c67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:23.966814 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20733332-bf68-4543-895b-91d80d60c67c admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:23.967030 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20733332-bf68-4543-895b-91d80d60c67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:23.967537 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20733332-bf68-4543-895b-91d80d60c67c admin admin] PATH_INFO: `/v3/projects/898a75769ac1445889c393ec8b6f8daf/users/35b63936f2fe4dcc8babdb9f84d2a526/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:23.969838 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20733332-bf68-4543-895b-91d80d60c67c admin admin] RBAC: Authorizing `identity:create_grant(project_id=898a75769ac1445889c393ec8b6f8daf, user_id=35b63936f2fe4dcc8babdb9f84d2a526, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:23.976561 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20733332-bf68-4543-895b-91d80d60c67c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:23.986482 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 935/1886] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:23 2022] PUT /identity/v3/projects/898a75769ac1445889c393ec8b6f8daf/users/35b63936f2fe4dcc8babdb9f84d2a526/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:23.999427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818e949-fa25-4148-95ae-7eb0b5353e3d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:24.000021 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818e949-fa25-4148-95ae-7eb0b5353e3d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:24.000459 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818e949-fa25-4148-95ae-7eb0b5353e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:24.051284 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a818e949-fa25-4148-95ae-7eb0b5353e3d None None] MFA Rules not processed for user `35b63936f2fe4dcc8babdb9f84d2a526`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:24.053737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a818e949-fa25-4148-95ae-7eb0b5353e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:24.173482 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 952/1887] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:24.185955 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20733332-bf68-4543-895b-91d80d60c67c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:24.327815 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20733332-bf68-4543-895b-91d80d60c67c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:24.333036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba372c3-97de-48e7-8098-7b0e7bf4f6ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:24.333922 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba372c3-97de-48e7-8098-7b0e7bf4f6ff service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:24.334205 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba372c3-97de-48e7-8098-7b0e7bf4f6ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:24.334484 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba372c3-97de-48e7-8098-7b0e7bf4f6ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:24.359204 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba372c3-97de-48e7-8098-7b0e7bf4f6ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:24.360716 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba372c3-97de-48e7-8098-7b0e7bf4f6ff service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:24.375114 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 936/1888] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:24.564578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818e949-fa25-4148-95ae-7eb0b5353e3d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:24.628519 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818e949-fa25-4148-95ae-7eb0b5353e3d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:24.634008 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc938c5-c5cd-4afc-98cb-70b5eba46c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:24.634924 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc938c5-c5cd-4afc-98cb-70b5eba46c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:24.635185 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc938c5-c5cd-4afc-98cb-70b5eba46c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:24.635455 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc938c5-c5cd-4afc-98cb-70b5eba46c2d admin admin] PATH_INFO: `/v3/users/df7863ee2a4e4c77a5d8b64964a93ed9` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:24.636741 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc938c5-c5cd-4afc-98cb-70b5eba46c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=df7863ee2a4e4c77a5d8b64964a93ed9)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:24.638739 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc938c5-c5cd-4afc-98cb-70b5eba46c2d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:24.690141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7dc938c5-c5cd-4afc-98cb-70b5eba46c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df7863ee2a4e4c77a5d8b64964a93ed9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:24.690813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7dc938c5-c5cd-4afc-98cb-70b5eba46c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df7863ee2a4e4c77a5d8b64964a93ed9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:24.691420 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7dc938c5-c5cd-4afc-98cb-70b5eba46c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df7863ee2a4e4c77a5d8b64964a93ed9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:24.700259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7dc938c5-c5cd-4afc-98cb-70b5eba46c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df7863ee2a4e4c77a5d8b64964a93ed9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:24.714743 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7dc938c5-c5cd-4afc-98cb-70b5eba46c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df7863ee2a4e4c77a5d8b64964a93ed9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:24.729792 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 953/1889] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:24 2022] DELETE /identity/v3/users/df7863ee2a4e4c77a5d8b64964a93ed9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:24.734769 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c716e6-a713-4b8e-b8ba-73880b7ccc99 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:24.735067 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c716e6-a713-4b8e-b8ba-73880b7ccc99 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:24.735355 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c716e6-a713-4b8e-b8ba-73880b7ccc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:24.757630 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-50c716e6-a713-4b8e-b8ba-73880b7ccc99 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:24.759760 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-50c716e6-a713-4b8e-b8ba-73880b7ccc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:24.827091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 937/1890] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:24.836950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc938c5-c5cd-4afc-98cb-70b5eba46c2d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:24.838451 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7dc938c5-c5cd-4afc-98cb-70b5eba46c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:24.899118 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc938c5-c5cd-4afc-98cb-70b5eba46c2d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:24.902882 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b66ed-974a-41d5-9b1a-be433d83cb45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:24.903454 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b66ed-974a-41d5-9b1a-be433d83cb45 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:24.903737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b66ed-974a-41d5-9b1a-be433d83cb45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:24.904014 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b66ed-974a-41d5-9b1a-be433d83cb45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:24.913809 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b66ed-974a-41d5-9b1a-be433d83cb45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:24.915235 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b66ed-974a-41d5-9b1a-be433d83cb45 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:24.924615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 954/1891] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:25.215606 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c716e6-a713-4b8e-b8ba-73880b7ccc99 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:25.218136 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-50c716e6-a713-4b8e-b8ba-73880b7ccc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:25.236834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c716e6-a713-4b8e-b8ba-73880b7ccc99 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:25.249565 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fa431-3147-429f-8313-d58c20893613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:25.250509 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fa431-3147-429f-8313-d58c20893613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:25.250711 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fa431-3147-429f-8313-d58c20893613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:25.250992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fa431-3147-429f-8313-d58c20893613 admin admin] PATH_INFO: `/v3/projects/84d9f0db4d6148f2bfc4da5a572fa39b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:25.252208 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fa431-3147-429f-8313-d58c20893613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84d9f0db4d6148f2bfc4da5a572fa39b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:25.254661 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fa431-3147-429f-8313-d58c20893613 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:25.316874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-164fa431-3147-429f-8313-d58c20893613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84d9f0db4d6148f2bfc4da5a572fa39b', 'request_id': 'req-164fa431-3147-429f-8313-d58c20893613'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:25.345194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-164fa431-3147-429f-8313-d58c20893613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84d9f0db4d6148f2bfc4da5a572fa39b', 'request_id': 'req-164fa431-3147-429f-8313-d58c20893613'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:25.358146 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-164fa431-3147-429f-8313-d58c20893613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84d9f0db4d6148f2bfc4da5a572fa39b', 'request_id': 'req-164fa431-3147-429f-8313-d58c20893613'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:25.374190 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-164fa431-3147-429f-8313-d58c20893613 admin admin] The token cache is being invalidate because project 84d9f0db4d6148f2bfc4da5a572fa39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:25.374722 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-164fa431-3147-429f-8313-d58c20893613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:25.375505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-164fa431-3147-429f-8313-d58c20893613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:25.380626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 938/1892] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:25 2022] DELETE /identity/v3/projects/84d9f0db4d6148f2bfc4da5a572fa39b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:25.381967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b66ed-974a-41d5-9b1a-be433d83cb45 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:25.392412 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b66ed-974a-41d5-9b1a-be433d83cb45 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:25.515150 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f629b7-a90d-47d4-abe3-fe23c0f4abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:25.516245 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f629b7-a90d-47d4-abe3-fe23c0f4abac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:25.516536 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f629b7-a90d-47d4-abe3-fe23c0f4abac admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:25.517017 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f629b7-a90d-47d4-abe3-fe23c0f4abac admin admin] PATH_INFO: `/v3/users/35b63936f2fe4dcc8babdb9f84d2a526` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:25.518493 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f629b7-a90d-47d4-abe3-fe23c0f4abac admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b63936f2fe4dcc8babdb9f84d2a526)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:25.520515 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f629b7-a90d-47d4-abe3-fe23c0f4abac admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:25.601595 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81f629b7-a90d-47d4-abe3-fe23c0f4abac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b63936f2fe4dcc8babdb9f84d2a526'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:25.629502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81f629b7-a90d-47d4-abe3-fe23c0f4abac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b63936f2fe4dcc8babdb9f84d2a526'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:25.634046 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81f629b7-a90d-47d4-abe3-fe23c0f4abac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b63936f2fe4dcc8babdb9f84d2a526'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:25.664091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81f629b7-a90d-47d4-abe3-fe23c0f4abac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b63936f2fe4dcc8babdb9f84d2a526'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:25.704826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81f629b7-a90d-47d4-abe3-fe23c0f4abac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b63936f2fe4dcc8babdb9f84d2a526'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:25.747949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 955/1893] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:25 2022] DELETE /identity/v3/users/35b63936f2fe4dcc8babdb9f84d2a526 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:26.172454 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fa431-3147-429f-8313-d58c20893613 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:26.174774 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-164fa431-3147-429f-8313-d58c20893613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:26.189384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fa431-3147-429f-8313-d58c20893613 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:26.312765 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c0e33-37e1-47e3-9f2f-e12af1318916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:26.314417 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c0e33-37e1-47e3-9f2f-e12af1318916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:26.314840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c0e33-37e1-47e3-9f2f-e12af1318916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:26.315359 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c0e33-37e1-47e3-9f2f-e12af1318916 admin admin] PATH_INFO: `/v3/projects/898a75769ac1445889c393ec8b6f8daf` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:26.316959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c0e33-37e1-47e3-9f2f-e12af1318916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=898a75769ac1445889c393ec8b6f8daf)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:26.319722 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c0e33-37e1-47e3-9f2f-e12af1318916 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:26.396670 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-126c0e33-37e1-47e3-9f2f-e12af1318916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898a75769ac1445889c393ec8b6f8daf', 'request_id': 'req-126c0e33-37e1-47e3-9f2f-e12af1318916'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:26.427209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-126c0e33-37e1-47e3-9f2f-e12af1318916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898a75769ac1445889c393ec8b6f8daf', 'request_id': 'req-126c0e33-37e1-47e3-9f2f-e12af1318916'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:26.452713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-126c0e33-37e1-47e3-9f2f-e12af1318916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898a75769ac1445889c393ec8b6f8daf', 'request_id': 'req-126c0e33-37e1-47e3-9f2f-e12af1318916'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:26.467715 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-126c0e33-37e1-47e3-9f2f-e12af1318916 admin admin] The token cache is being invalidate because project 898a75769ac1445889c393ec8b6f8daf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:26.468029 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-126c0e33-37e1-47e3-9f2f-e12af1318916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:26.468698 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-126c0e33-37e1-47e3-9f2f-e12af1318916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:26.470311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 939/1894] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:26 2022] DELETE /identity/v3/projects/898a75769ac1445889c393ec8b6f8daf => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:26.475282 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2efb25-1373-4d95-b6c9-884331f0cdd4 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:26.475810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2efb25-1373-4d95-b6c9-884331f0cdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:26.475810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2efb25-1373-4d95-b6c9-884331f0cdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:26.506766 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ac2efb25-1373-4d95-b6c9-884331f0cdd4 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:26.507970 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ac2efb25-1373-4d95-b6c9-884331f0cdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:26.581026 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 956/1895] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:26.590372 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5ea6f-7a1b-4920-8fb2-b1b89e62e21f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:26.590572 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5ea6f-7a1b-4920-8fb2-b1b89e62e21f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:26.590827 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5ea6f-7a1b-4920-8fb2-b1b89e62e21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:26.614937 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f2d5ea6f-7a1b-4920-8fb2-b1b89e62e21f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:26.616591 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f2d5ea6f-7a1b-4920-8fb2-b1b89e62e21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:26.625197 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 940/1896] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:26.629602 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2efb25-1373-4d95-b6c9-884331f0cdd4 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:26.639853 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2efb25-1373-4d95-b6c9-884331f0cdd4 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:26.645205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c732e-c74e-417a-bac5-73200a64a4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:26.645969 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c732e-c74e-417a-bac5-73200a64a4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:26.646303 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c732e-c74e-417a-bac5-73200a64a4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:26.648528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c732e-c74e-417a-bac5-73200a64a4a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:26.648528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c732e-c74e-417a-bac5-73200a64a4a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:26.648528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c732e-c74e-417a-bac5-73200a64a4a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:26.649873 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c732e-c74e-417a-bac5-73200a64a4a6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:26.667183 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 957/1897] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:26.678456 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5ea6f-7a1b-4920-8fb2-b1b89e62e21f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:26.689849 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5ea6f-7a1b-4920-8fb2-b1b89e62e21f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:26.695386 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adf145-340b-4661-b98e-0aea7fb3a2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:26.696059 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adf145-340b-4661-b98e-0aea7fb3a2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:26.696357 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adf145-340b-4661-b98e-0aea7fb3a2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:26.696603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adf145-340b-4661-b98e-0aea7fb3a2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:26.697332 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adf145-340b-4661-b98e-0aea7fb3a2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:26.699260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adf145-340b-4661-b98e-0aea7fb3a2c4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:26.740825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 941/1898] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:26 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:26.741832 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c732e-c74e-417a-bac5-73200a64a4a6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:26.764352 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c732e-c74e-417a-bac5-73200a64a4a6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:26.914626 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1011c85-d056-45f8-a764-5998cb685b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:26.915325 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1011c85-d056-45f8-a764-5998cb685b7e admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:26.915605 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1011c85-d056-45f8-a764-5998cb685b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:26.915883 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1011c85-d056-45f8-a764-5998cb685b7e admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:26.916606 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1011c85-d056-45f8-a764-5998cb685b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:26.918568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1011c85-d056-45f8-a764-5998cb685b7e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:26.969518 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 958/1899] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:26 2022] POST /identity/v3/users => generated 290 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:26.973643 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adf145-340b-4661-b98e-0aea7fb3a2c4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:27.001438 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adf145-340b-4661-b98e-0aea7fb3a2c4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:27.008255 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea041f30-0ccd-477f-951e-430db2b6ce51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:27.009275 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea041f30-0ccd-477f-951e-430db2b6ce51 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:27.010514 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea041f30-0ccd-477f-951e-430db2b6ce51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:27.011359 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea041f30-0ccd-477f-951e-430db2b6ce51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:27.014074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea041f30-0ccd-477f-951e-430db2b6ce51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:27.018653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea041f30-0ccd-477f-951e-430db2b6ce51 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:27.048543 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 942/1900] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:27.053518 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1011c85-d056-45f8-a764-5998cb685b7e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:27.063741 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1011c85-d056-45f8-a764-5998cb685b7e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:27.075613 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1800f10-0b80-43bb-8b66-02bb510f76ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:27.078163 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1800f10-0b80-43bb-8b66-02bb510f76ed admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:27.078649 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1800f10-0b80-43bb-8b66-02bb510f76ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:27.079099 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1800f10-0b80-43bb-8b66-02bb510f76ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:27.081904 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1800f10-0b80-43bb-8b66-02bb510f76ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:27.084187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea041f30-0ccd-477f-951e-430db2b6ce51 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:27.086488 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1800f10-0b80-43bb-8b66-02bb510f76ed admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:27.087118 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ea041f30-0ccd-477f-951e-430db2b6ce51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:27.106919 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea041f30-0ccd-477f-951e-430db2b6ce51 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:27.121176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83618c03-afb5-4442-b12d-474607802d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:27.122435 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83618c03-afb5-4442-b12d-474607802d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:27.123456 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83618c03-afb5-4442-b12d-474607802d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:27.136816 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83618c03-afb5-4442-b12d-474607802d94 admin admin] PATH_INFO: `/v3/users/767ad83f8bbe490697d5af60bbda2ce9` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:27.137172 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 959/1901] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:27.137172 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1800f10-0b80-43bb-8b66-02bb510f76ed admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:27.137330 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83618c03-afb5-4442-b12d-474607802d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=767ad83f8bbe490697d5af60bbda2ce9)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:27.137330 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83618c03-afb5-4442-b12d-474607802d94 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:27.149363 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1800f10-0b80-43bb-8b66-02bb510f76ed admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:27.163826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99954d8b-e62c-4781-9a76-c9b5ff176ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:27.165992 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99954d8b-e62c-4781-9a76-c9b5ff176ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:27.166306 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99954d8b-e62c-4781-9a76-c9b5ff176ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:27.166561 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99954d8b-e62c-4781-9a76-c9b5ff176ab1 admin admin] PATH_INFO: `/v3/projects/edec18df25fa4c429eebf37964a5f354/users/25d13d8f266f4702bbb5d97ec44ad8b4/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:27.207212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99954d8b-e62c-4781-9a76-c9b5ff176ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edec18df25fa4c429eebf37964a5f354, user_id=25d13d8f266f4702bbb5d97ec44ad8b4, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:27.214131 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99954d8b-e62c-4781-9a76-c9b5ff176ab1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:27.247573 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 960/1902] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:27 2022] PUT /identity/v3/projects/edec18df25fa4c429eebf37964a5f354/users/25d13d8f266f4702bbb5d97ec44ad8b4/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:27.259014 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0db40d-f5e8-498d-bd5c-e2ce7db9564f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:27.259302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0db40d-f5e8-498d-bd5c-e2ce7db9564f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:27.259617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0db40d-f5e8-498d-bd5c-e2ce7db9564f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:27.262866 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-83618c03-afb5-4442-b12d-474607802d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '767ad83f8bbe490697d5af60bbda2ce9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:27.264129 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-83618c03-afb5-4442-b12d-474607802d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '767ad83f8bbe490697d5af60bbda2ce9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:27.265123 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-83618c03-afb5-4442-b12d-474607802d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '767ad83f8bbe490697d5af60bbda2ce9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:27.278457 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-83618c03-afb5-4442-b12d-474607802d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '767ad83f8bbe490697d5af60bbda2ce9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:27.300651 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-83618c03-afb5-4442-b12d-474607802d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '767ad83f8bbe490697d5af60bbda2ce9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:27.303295 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8e0db40d-f5e8-498d-bd5c-e2ce7db9564f None None] MFA Rules not processed for user `25d13d8f266f4702bbb5d97ec44ad8b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:27.305117 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8e0db40d-f5e8-498d-bd5c-e2ce7db9564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:27.345547 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 943/1903] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:27 2022] DELETE /identity/v3/users/767ad83f8bbe490697d5af60bbda2ce9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:27.347064 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21314c-62e6-4449-b21a-0e0335c10c65 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:27.347357 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21314c-62e6-4449-b21a-0e0335c10c65 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:27.347637 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21314c-62e6-4449-b21a-0e0335c10c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:27.370580 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-cb21314c-62e6-4449-b21a-0e0335c10c65 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:27.372263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cb21314c-62e6-4449-b21a-0e0335c10c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:27.424283 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 961/1904] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:27.429740 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0db40d-f5e8-498d-bd5c-e2ce7db9564f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:27.442697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8e0db40d-f5e8-498d-bd5c-e2ce7db9564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:27.503383 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 944/1905] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:27.515631 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21314c-62e6-4449-b21a-0e0335c10c65 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:27.525028 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cb21314c-62e6-4449-b21a-0e0335c10c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:27.597158 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0db40d-f5e8-498d-bd5c-e2ce7db9564f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:27.603909 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e05fa-965a-4e8f-a3ae-6ab2a9ad6c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:27.607927 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e05fa-965a-4e8f-a3ae-6ab2a9ad6c0d admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:27.607927 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e05fa-965a-4e8f-a3ae-6ab2a9ad6c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:27.607927 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e05fa-965a-4e8f-a3ae-6ab2a9ad6c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:27.607927 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e05fa-965a-4e8f-a3ae-6ab2a9ad6c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:27.611676 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e05fa-965a-4e8f-a3ae-6ab2a9ad6c0d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:27.669107 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21314c-62e6-4449-b21a-0e0335c10c65 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:27.683221 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8ea3b-b234-410d-be7f-8ec0680eeedf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:27.683895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8ea3b-b234-410d-be7f-8ec0680eeedf service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:27.684180 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8ea3b-b234-410d-be7f-8ec0680eeedf service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:27.684460 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8ea3b-b234-410d-be7f-8ec0680eeedf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:27.688763 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 962/1906] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:27 2022] POST /identity/v3/projects => generated 379 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:27.693129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e05fa-965a-4e8f-a3ae-6ab2a9ad6c0d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:27.712530 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8ea3b-b234-410d-be7f-8ec0680eeedf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:27.714399 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8ea3b-b234-410d-be7f-8ec0680eeedf service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:27.727725 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 945/1907] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:06:27.786373 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e05fa-965a-4e8f-a3ae-6ab2a9ad6c0d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:27.792757 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b77327-1b88-4dc6-a21b-b4dce03c4645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:27.793582 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b77327-1b88-4dc6-a21b-b4dce03c4645 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:27.793841 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b77327-1b88-4dc6-a21b-b4dce03c4645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:27.794303 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b77327-1b88-4dc6-a21b-b4dce03c4645 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:27.795043 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b77327-1b88-4dc6-a21b-b4dce03c4645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:27.797240 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b77327-1b88-4dc6-a21b-b4dce03c4645 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:27.823007 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 963/1908] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:27 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:27.827136 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8ea3b-b234-410d-be7f-8ec0680eeedf service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:27.839691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8ea3b-b234-410d-be7f-8ec0680eeedf service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:27.845982 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e2edc-e80d-4a4b-9727-7e91f2d9b9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:27.846799 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e2edc-e80d-4a4b-9727-7e91f2d9b9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:27.847297 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e2edc-e80d-4a4b-9727-7e91f2d9b9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:27.848189 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e2edc-e80d-4a4b-9727-7e91f2d9b9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:27.849049 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e2edc-e80d-4a4b-9727-7e91f2d9b9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:27.851369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e2edc-e80d-4a4b-9727-7e91f2d9b9f5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:27.867015 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 946/1909] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:06:27.876348 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b77327-1b88-4dc6-a21b-b4dce03c4645 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:27.897728 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b77327-1b88-4dc6-a21b-b4dce03c4645 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:27.902778 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de978c4f-7da9-4439-aeac-fc92c1c738c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:27.903531 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de978c4f-7da9-4439-aeac-fc92c1c738c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:27.903878 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de978c4f-7da9-4439-aeac-fc92c1c738c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:27.904221 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de978c4f-7da9-4439-aeac-fc92c1c738c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:27.905327 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de978c4f-7da9-4439-aeac-fc92c1c738c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:27.907238 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de978c4f-7da9-4439-aeac-fc92c1c738c7 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:27.934735 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e2edc-e80d-4a4b-9727-7e91f2d9b9f5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:27.935151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 964/1910] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:27.947949 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e2edc-e80d-4a4b-9727-7e91f2d9b9f5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:27.959181 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6fbc0-d8c7-4086-b793-c3ac792a18f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:27.960368 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6fbc0-d8c7-4086-b793-c3ac792a18f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:27.960645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6fbc0-d8c7-4086-b793-c3ac792a18f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:27.960948 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6fbc0-d8c7-4086-b793-c3ac792a18f2 admin admin] PATH_INFO: `/v3/projects/90a1d67eb5934b6bb3aff8c4000d0a22/users/b4b6ecc708b6426790291fcf8de8eb64/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:28.038353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6fbc0-d8c7-4086-b793-c3ac792a18f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a1d67eb5934b6bb3aff8c4000d0a22, user_id=b4b6ecc708b6426790291fcf8de8eb64, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:28.043723 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6fbc0-d8c7-4086-b793-c3ac792a18f2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:28.073963 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 947/1911] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:27 2022] PUT /identity/v3/projects/90a1d67eb5934b6bb3aff8c4000d0a22/users/b4b6ecc708b6426790291fcf8de8eb64/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:28.087341 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a040c23-3a69-4a52-8926-d8b64701e02c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:28.087586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a040c23-3a69-4a52-8926-d8b64701e02c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:28.087870 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a040c23-3a69-4a52-8926-d8b64701e02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:28.170509 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2a040c23-3a69-4a52-8926-d8b64701e02c None None] MFA Rules not processed for user `b4b6ecc708b6426790291fcf8de8eb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:28.171934 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2a040c23-3a69-4a52-8926-d8b64701e02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:28.344339 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 965/1912] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:28.348463 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6fbc0-d8c7-4086-b793-c3ac792a18f2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:28.438554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6fbc0-d8c7-4086-b793-c3ac792a18f2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:28.443935 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403edb8c-dbf9-4b66-9303-d21b6dd4057f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:28.444764 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403edb8c-dbf9-4b66-9303-d21b6dd4057f admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:28.445254 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403edb8c-dbf9-4b66-9303-d21b6dd4057f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:28.445569 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403edb8c-dbf9-4b66-9303-d21b6dd4057f admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:28.446499 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403edb8c-dbf9-4b66-9303-d21b6dd4057f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:28.448380 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403edb8c-dbf9-4b66-9303-d21b6dd4057f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:28.475687 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 948/1913] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:28 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:06:28.479978 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a040c23-3a69-4a52-8926-d8b64701e02c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:28.491544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a040c23-3a69-4a52-8926-d8b64701e02c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:28.564746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a932-1193-480f-83a1-e83ba9c03f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:28.565566 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a932-1193-480f-83a1-e83ba9c03f8e admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:28.565907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a932-1193-480f-83a1-e83ba9c03f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:28.566251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a932-1193-480f-83a1-e83ba9c03f8e admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:28.567046 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691a932-1193-480f-83a1-e83ba9c03f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:28.569540 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691a932-1193-480f-83a1-e83ba9c03f8e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:28.610065 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 966/1914] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:28 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:28.614059 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403edb8c-dbf9-4b66-9303-d21b6dd4057f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:28.632744 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403edb8c-dbf9-4b66-9303-d21b6dd4057f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:28.638439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6242d-6098-4e39-a55c-a119f382defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:28.639117 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6242d-6098-4e39-a55c-a119f382defc admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:28.639459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6242d-6098-4e39-a55c-a119f382defc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:28.639745 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6242d-6098-4e39-a55c-a119f382defc admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:28.640755 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6242d-6098-4e39-a55c-a119f382defc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:28.669025 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6242d-6098-4e39-a55c-a119f382defc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:28.678617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a932-1193-480f-83a1-e83ba9c03f8e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:28.680477 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c691a932-1193-480f-83a1-e83ba9c03f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:28.689772 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 949/1915] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:28.690993 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6242d-6098-4e39-a55c-a119f382defc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:28.701027 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a932-1193-480f-83a1-e83ba9c03f8e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:28.711985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6242d-6098-4e39-a55c-a119f382defc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:28.714358 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a7449-62c5-4174-87e6-48ac8219dcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:28.715251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7449-62c5-4174-87e6-48ac8219dcf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:28.715521 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7449-62c5-4174-87e6-48ac8219dcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:28.715860 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7449-62c5-4174-87e6-48ac8219dcf3 admin admin] PATH_INFO: `/v3/projects/4df3ccbaf64146ec9d94a9f74a862af7` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:28.717176 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a7449-62c5-4174-87e6-48ac8219dcf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4df3ccbaf64146ec9d94a9f74a862af7)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:28.719355 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a7449-62c5-4174-87e6-48ac8219dcf3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:28.726312 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28f1ba-0837-46d6-b081-ecc892692448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:28.727461 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f1ba-0837-46d6-b081-ecc892692448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:28.727883 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f1ba-0837-46d6-b081-ecc892692448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:28.728168 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28f1ba-0837-46d6-b081-ecc892692448 admin admin] PATH_INFO: `/v3/projects/ed6d82a99bd843ea8dffbc3fd7d3b1c8/users/bb3bf6f141a74fafa60892ff47dd7045/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:28.759370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28f1ba-0837-46d6-b081-ecc892692448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6d82a99bd843ea8dffbc3fd7d3b1c8, user_id=bb3bf6f141a74fafa60892ff47dd7045, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:28.762164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28f1ba-0837-46d6-b081-ecc892692448 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:28.785377 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 950/1916] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:28 2022] PUT /identity/v3/projects/ed6d82a99bd843ea8dffbc3fd7d3b1c8/users/bb3bf6f141a74fafa60892ff47dd7045/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:28.790952 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28f1ba-0837-46d6-b081-ecc892692448 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:28.815262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e88a7449-62c5-4174-87e6-48ac8219dcf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df3ccbaf64146ec9d94a9f74a862af7', 'request_id': 'req-e88a7449-62c5-4174-87e6-48ac8219dcf3'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:28.824814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e88a7449-62c5-4174-87e6-48ac8219dcf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df3ccbaf64146ec9d94a9f74a862af7', 'request_id': 'req-e88a7449-62c5-4174-87e6-48ac8219dcf3'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:28.834593 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e88a7449-62c5-4174-87e6-48ac8219dcf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df3ccbaf64146ec9d94a9f74a862af7', 'request_id': 'req-e88a7449-62c5-4174-87e6-48ac8219dcf3'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:28.849998 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e88a7449-62c5-4174-87e6-48ac8219dcf3 admin admin] The token cache is being invalidate because project 4df3ccbaf64146ec9d94a9f74a862af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:28.850694 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e88a7449-62c5-4174-87e6-48ac8219dcf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:28.851650 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e88a7449-62c5-4174-87e6-48ac8219dcf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:28.854181 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 967/1917] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:28 2022] DELETE /identity/v3/projects/4df3ccbaf64146ec9d94a9f74a862af7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:28.859537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a7449-62c5-4174-87e6-48ac8219dcf3 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:28.861572 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e88a7449-62c5-4174-87e6-48ac8219dcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:28.926737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28f1ba-0837-46d6-b081-ecc892692448 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:28.954863 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a7449-62c5-4174-87e6-48ac8219dcf3 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:28.966373 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4359f-45d6-4adb-ba0f-72247a9b7605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:28.967268 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4359f-45d6-4adb-ba0f-72247a9b7605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:28.967543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4359f-45d6-4adb-ba0f-72247a9b7605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:28.967812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4359f-45d6-4adb-ba0f-72247a9b7605 admin admin] PATH_INFO: `/v3/users/42c4c29cad41472fa053e22dc6c82c26` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:28.978180 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4359f-45d6-4adb-ba0f-72247a9b7605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42c4c29cad41472fa053e22dc6c82c26)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:28.978180 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4359f-45d6-4adb-ba0f-72247a9b7605 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:29.011335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b3c1a-f4b9-4633-b143-3e49da44ce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:29.012080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b3c1a-f4b9-4633-b143-3e49da44ce3b admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:29.012454 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b3c1a-f4b9-4633-b143-3e49da44ce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:29.012856 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b3c1a-f4b9-4633-b143-3e49da44ce3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:29.013668 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b3c1a-f4b9-4633-b143-3e49da44ce3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:29.015428 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b3c1a-f4b9-4633-b143-3e49da44ce3b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:29.026223 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 951/1918] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:29.028085 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-13f4359f-45d6-4adb-ba0f-72247a9b7605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42c4c29cad41472fa053e22dc6c82c26'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:29.028760 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-13f4359f-45d6-4adb-ba0f-72247a9b7605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42c4c29cad41472fa053e22dc6c82c26'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:29.029520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-13f4359f-45d6-4adb-ba0f-72247a9b7605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42c4c29cad41472fa053e22dc6c82c26'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:29.030524 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b3c1a-f4b9-4633-b143-3e49da44ce3b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:29.032163 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a22b3c1a-f4b9-4633-b143-3e49da44ce3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:29.037187 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-13f4359f-45d6-4adb-ba0f-72247a9b7605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42c4c29cad41472fa053e22dc6c82c26'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:29.044594 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b3c1a-f4b9-4633-b143-3e49da44ce3b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:29.055682 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-13f4359f-45d6-4adb-ba0f-72247a9b7605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42c4c29cad41472fa053e22dc6c82c26'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:29.061350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6cf7d-828c-47ed-85a1-a25771d54eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:29.062286 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6cf7d-828c-47ed-85a1-a25771d54eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:29.062556 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6cf7d-828c-47ed-85a1-a25771d54eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:29.062828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6cf7d-828c-47ed-85a1-a25771d54eaf admin admin] PATH_INFO: `/v3/projects/ed6d82a99bd843ea8dffbc3fd7d3b1c8/users/bb3bf6f141a74fafa60892ff47dd7045/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:29.065449 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6cf7d-828c-47ed-85a1-a25771d54eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6d82a99bd843ea8dffbc3fd7d3b1c8, user_id=bb3bf6f141a74fafa60892ff47dd7045, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:29.068839 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6cf7d-828c-47ed-85a1-a25771d54eaf admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:29.073539 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 968/1919] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:28 2022] DELETE /identity/v3/users/42c4c29cad41472fa053e22dc6c82c26 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:29.081608 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 952/1920] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:29 2022] PUT /identity/v3/projects/ed6d82a99bd843ea8dffbc3fd7d3b1c8/users/bb3bf6f141a74fafa60892ff47dd7045/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:29.092866 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa3c6b-98b8-4246-8650-b0411d4ca388 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:29.093227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa3c6b-98b8-4246-8650-b0411d4ca388 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:29.093509 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa3c6b-98b8-4246-8650-b0411d4ca388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:29.132981 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-41fa3c6b-98b8-4246-8650-b0411d4ca388 None None] MFA Rules not processed for user `bb3bf6f141a74fafa60892ff47dd7045`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:29.134710 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-41fa3c6b-98b8-4246-8650-b0411d4ca388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:29.302782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 969/1921] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:29.334574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6cf7d-828c-47ed-85a1-a25771d54eaf admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:29.336780 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-08f6cf7d-828c-47ed-85a1-a25771d54eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:29.427853 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6cf7d-828c-47ed-85a1-a25771d54eaf admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:29.434105 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e05512-4898-4435-a337-6c7076392583 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:29.434777 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e05512-4898-4435-a337-6c7076392583 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:29.435061 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e05512-4898-4435-a337-6c7076392583 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:29.435341 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e05512-4898-4435-a337-6c7076392583 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:29.446860 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e05512-4898-4435-a337-6c7076392583 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:29.448332 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e05512-4898-4435-a337-6c7076392583 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:29.459531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 953/1922] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:29.487641 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa3c6b-98b8-4246-8650-b0411d4ca388 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:29.489322 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-41fa3c6b-98b8-4246-8650-b0411d4ca388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:29.506537 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e05512-4898-4435-a337-6c7076392583 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:29.508493 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b8e05512-4898-4435-a337-6c7076392583 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:29.520483 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e05512-4898-4435-a337-6c7076392583 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:29.525466 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f914e-c167-4d7a-a898-12084409e8e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:29.526417 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f914e-c167-4d7a-a898-12084409e8e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:29.526712 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f914e-c167-4d7a-a898-12084409e8e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:29.527057 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f914e-c167-4d7a-a898-12084409e8e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:29.528913 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-235f914e-c167-4d7a-a898-12084409e8e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:29.575857 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa3c6b-98b8-4246-8650-b0411d4ca388 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:29.586027 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddec12-30f6-4607-a256-dcc6e6c95800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:29.587157 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddec12-30f6-4607-a256-dcc6e6c95800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:29.587831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddec12-30f6-4607-a256-dcc6e6c95800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:29.587831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddec12-30f6-4607-a256-dcc6e6c95800 admin admin] PATH_INFO: `/v3/projects/ea09a70d51ec4eada54ae3f881532c38` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:29.589182 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddec12-30f6-4607-a256-dcc6e6c95800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea09a70d51ec4eada54ae3f881532c38)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:29.591380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddec12-30f6-4607-a256-dcc6e6c95800 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:29.602366 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f914e-c167-4d7a-a898-12084409e8e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:29.604525 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f914e-c167-4d7a-a898-12084409e8e6 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:29.619314 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 954/1923] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:29.644422 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-56ddec12-30f6-4607-a256-dcc6e6c95800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea09a70d51ec4eada54ae3f881532c38', 'request_id': 'req-56ddec12-30f6-4607-a256-dcc6e6c95800'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:29.651413 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-56ddec12-30f6-4607-a256-dcc6e6c95800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea09a70d51ec4eada54ae3f881532c38', 'request_id': 'req-56ddec12-30f6-4607-a256-dcc6e6c95800'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:29.661218 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-56ddec12-30f6-4607-a256-dcc6e6c95800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea09a70d51ec4eada54ae3f881532c38', 'request_id': 'req-56ddec12-30f6-4607-a256-dcc6e6c95800'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:29.675429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-56ddec12-30f6-4607-a256-dcc6e6c95800 admin admin] The token cache is being invalidate because project ea09a70d51ec4eada54ae3f881532c38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:29.675729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-56ddec12-30f6-4607-a256-dcc6e6c95800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:29.676607 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-56ddec12-30f6-4607-a256-dcc6e6c95800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:29.682132 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 970/1924] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:29 2022] DELETE /identity/v3/projects/ea09a70d51ec4eada54ae3f881532c38 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:29.683778 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae70b9b-d9c7-42a7-b36f-3eb20e28c0ac None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:29.684196 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae70b9b-d9c7-42a7-b36f-3eb20e28c0ac None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:29.684539 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae70b9b-d9c7-42a7-b36f-3eb20e28c0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:29.706250 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-eae70b9b-d9c7-42a7-b36f-3eb20e28c0ac None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:29.707738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-eae70b9b-d9c7-42a7-b36f-3eb20e28c0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:29.791063 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 955/1925] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:29.793875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0e30c-ff62-408a-8a7c-2d17dfe392e4 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:29.794168 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0e30c-ff62-408a-8a7c-2d17dfe392e4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:29.794532 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0e30c-ff62-408a-8a7c-2d17dfe392e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:29.813649 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-80e0e30c-ff62-408a-8a7c-2d17dfe392e4 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:29.814871 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-80e0e30c-ff62-408a-8a7c-2d17dfe392e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:29.829604 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 971/1926] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:29.834496 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae70b9b-d9c7-42a7-b36f-3eb20e28c0ac None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:29.844626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae70b9b-d9c7-42a7-b36f-3eb20e28c0ac None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:29.849557 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e0b88-c82e-4283-9055-3c72c5453d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:29.850222 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e0b88-c82e-4283-9055-3c72c5453d59 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:29.850503 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e0b88-c82e-4283-9055-3c72c5453d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:29.850871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e0b88-c82e-4283-9055-3c72c5453d59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:29.851517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e0b88-c82e-4283-9055-3c72c5453d59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:29.851819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e0b88-c82e-4283-9055-3c72c5453d59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:29.853478 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e0b88-c82e-4283-9055-3c72c5453d59 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:29.868985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 956/1927] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:29.871158 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0e30c-ff62-408a-8a7c-2d17dfe392e4 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:29.880840 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0e30c-ff62-408a-8a7c-2d17dfe392e4 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:29.887134 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35e620-73ab-45cf-9b14-e0e610ea6e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:29.888125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35e620-73ab-45cf-9b14-e0e610ea6e4f admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:29.888533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35e620-73ab-45cf-9b14-e0e610ea6e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:29.888942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35e620-73ab-45cf-9b14-e0e610ea6e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:29.889893 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35e620-73ab-45cf-9b14-e0e610ea6e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:29.892054 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35e620-73ab-45cf-9b14-e0e610ea6e4f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:29.946227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 972/1928] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:29 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:29.950252 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e0b88-c82e-4283-9055-3c72c5453d59 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:29.961947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e0b88-c82e-4283-9055-3c72c5453d59 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:30.081973 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df178ee-47a7-457e-a95f-81b6e029a17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:30.082686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df178ee-47a7-457e-a95f-81b6e029a17c admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:30.082968 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df178ee-47a7-457e-a95f-81b6e029a17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:30.083244 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df178ee-47a7-457e-a95f-81b6e029a17c admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:30.084399 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df178ee-47a7-457e-a95f-81b6e029a17c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:30.086400 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df178ee-47a7-457e-a95f-81b6e029a17c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:30.105450 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 957/1929] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:29 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:30.109609 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35e620-73ab-45cf-9b14-e0e610ea6e4f admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:30.120054 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35e620-73ab-45cf-9b14-e0e610ea6e4f admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:30.124659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0fb61-28bf-4e58-a5a2-2507aef0778d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:30.125343 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0fb61-28bf-4e58-a5a2-2507aef0778d admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:30.125626 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0fb61-28bf-4e58-a5a2-2507aef0778d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:30.125905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0fb61-28bf-4e58-a5a2-2507aef0778d admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:30.126624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0fb61-28bf-4e58-a5a2-2507aef0778d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:30.128468 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0fb61-28bf-4e58-a5a2-2507aef0778d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:30.139440 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 973/1930] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:30.143165 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df178ee-47a7-457e-a95f-81b6e029a17c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:30.153204 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df178ee-47a7-457e-a95f-81b6e029a17c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:30.157826 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0bc3d-233c-46df-be5d-38bce64fcfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:30.158473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0bc3d-233c-46df-be5d-38bce64fcfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:30.158752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0bc3d-233c-46df-be5d-38bce64fcfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:30.159028 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0bc3d-233c-46df-be5d-38bce64fcfa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:30.159749 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0bc3d-233c-46df-be5d-38bce64fcfa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:30.161370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0bc3d-233c-46df-be5d-38bce64fcfa6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:30.170978 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 958/1931] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:30.175013 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0fb61-28bf-4e58-a5a2-2507aef0778d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:30.185619 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0fb61-28bf-4e58-a5a2-2507aef0778d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:30.190224 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b65d1-4007-458c-8de9-fdae86db759a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:30.191110 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b65d1-4007-458c-8de9-fdae86db759a admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:30.191368 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b65d1-4007-458c-8de9-fdae86db759a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:30.191638 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b65d1-4007-458c-8de9-fdae86db759a admin admin] PATH_INFO: `/v3/projects/c376e961d6c348799b3aaa6cbc3265a3/users/05e75b45ae3a41b8ac090b1e4c89174f/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:30.206063 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b65d1-4007-458c-8de9-fdae86db759a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c376e961d6c348799b3aaa6cbc3265a3, user_id=05e75b45ae3a41b8ac090b1e4c89174f, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:30.208956 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b65d1-4007-458c-8de9-fdae86db759a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:30.221970 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 974/1932] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:30 2022] PUT /identity/v3/projects/c376e961d6c348799b3aaa6cbc3265a3/users/05e75b45ae3a41b8ac090b1e4c89174f/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:30.232079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11cb7e-e6e6-47a5-a123-69b10c6a5eef None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:30.232384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11cb7e-e6e6-47a5-a123-69b10c6a5eef None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:30.232672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11cb7e-e6e6-47a5-a123-69b10c6a5eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:30.259431 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5b11cb7e-e6e6-47a5-a123-69b10c6a5eef None None] MFA Rules not processed for user `05e75b45ae3a41b8ac090b1e4c89174f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:30.260620 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5b11cb7e-e6e6-47a5-a123-69b10c6a5eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:30.328004 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 959/1933] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:30.341344 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b65d1-4007-458c-8de9-fdae86db759a admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:30.343109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-825b65d1-4007-458c-8de9-fdae86db759a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:30.400309 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b65d1-4007-458c-8de9-fdae86db759a admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:30.403846 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739eadf-6ba6-49ba-9626-93f19f3898aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:30.404492 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739eadf-6ba6-49ba-9626-93f19f3898aa service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:30.404775 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739eadf-6ba6-49ba-9626-93f19f3898aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:30.405094 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739eadf-6ba6-49ba-9626-93f19f3898aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:30.413695 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739eadf-6ba6-49ba-9626-93f19f3898aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:30.415131 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739eadf-6ba6-49ba-9626-93f19f3898aa service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:30.423741 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 975/1934] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:31.441224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11cb7e-e6e6-47a5-a123-69b10c6a5eef None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:31.445298 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5b11cb7e-e6e6-47a5-a123-69b10c6a5eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:31.554573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11cb7e-e6e6-47a5-a123-69b10c6a5eef None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:31.559803 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d3cfe-9197-465a-84a1-6482d28797ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:31.560632 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d3cfe-9197-465a-84a1-6482d28797ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:31.560944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d3cfe-9197-465a-84a1-6482d28797ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:31.561413 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d3cfe-9197-465a-84a1-6482d28797ed admin admin] PATH_INFO: `/v3/users/1e1adab6d96b485797b0c378d01e9792` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:31.562673 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d3cfe-9197-465a-84a1-6482d28797ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e1adab6d96b485797b0c378d01e9792)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:31.564684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d3cfe-9197-465a-84a1-6482d28797ed admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:31.631733 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-372d3cfe-9197-465a-84a1-6482d28797ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e1adab6d96b485797b0c378d01e9792'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:31.632644 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-372d3cfe-9197-465a-84a1-6482d28797ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e1adab6d96b485797b0c378d01e9792'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:31.633743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-372d3cfe-9197-465a-84a1-6482d28797ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e1adab6d96b485797b0c378d01e9792'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:31.643712 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-372d3cfe-9197-465a-84a1-6482d28797ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e1adab6d96b485797b0c378d01e9792'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:31.681426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-372d3cfe-9197-465a-84a1-6482d28797ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e1adab6d96b485797b0c378d01e9792'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:31.695870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 960/1935] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:31 2022] DELETE /identity/v3/users/1e1adab6d96b485797b0c378d01e9792 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:31.702303 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5416703-04f0-4f6c-9de6-9db5c3c4e515 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:31.702748 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5416703-04f0-4f6c-9de6-9db5c3c4e515 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:31.703162 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5416703-04f0-4f6c-9de6-9db5c3c4e515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:31.744455 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d5416703-04f0-4f6c-9de6-9db5c3c4e515 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:31.746236 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d5416703-04f0-4f6c-9de6-9db5c3c4e515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:31.893679 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 976/1936] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:31.912776 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d3cfe-9197-465a-84a1-6482d28797ed admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:31.914561 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-372d3cfe-9197-465a-84a1-6482d28797ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:32.070293 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d3cfe-9197-465a-84a1-6482d28797ed admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:32.076755 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd88318-0d3c-48af-bccd-9dd52350dda6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:32.077915 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd88318-0d3c-48af-bccd-9dd52350dda6 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:32.078734 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd88318-0d3c-48af-bccd-9dd52350dda6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:32.078734 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd88318-0d3c-48af-bccd-9dd52350dda6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:32.091430 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd88318-0d3c-48af-bccd-9dd52350dda6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:32.093076 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd88318-0d3c-48af-bccd-9dd52350dda6 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:32.107547 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 961/1937] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:32.855280 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5416703-04f0-4f6c-9de6-9db5c3c4e515 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:32.860821 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d5416703-04f0-4f6c-9de6-9db5c3c4e515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:32.876312 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5416703-04f0-4f6c-9de6-9db5c3c4e515 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:32.882004 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538a8d1-64dc-4244-9cf6-460dbdcfd23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:32.882900 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a8d1-64dc-4244-9cf6-460dbdcfd23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:32.883574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a8d1-64dc-4244-9cf6-460dbdcfd23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:32.883857 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a8d1-64dc-4244-9cf6-460dbdcfd23f admin admin] PATH_INFO: `/v3/projects/07a25937b89d45668c2f58e6d8bee6cc` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:32.885142 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538a8d1-64dc-4244-9cf6-460dbdcfd23f admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a25937b89d45668c2f58e6d8bee6cc)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:32.887301 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538a8d1-64dc-4244-9cf6-460dbdcfd23f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:32.937491 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-9538a8d1-64dc-4244-9cf6-460dbdcfd23f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a25937b89d45668c2f58e6d8bee6cc', 'request_id': 'req-9538a8d1-64dc-4244-9cf6-460dbdcfd23f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:32.944312 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-9538a8d1-64dc-4244-9cf6-460dbdcfd23f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a25937b89d45668c2f58e6d8bee6cc', 'request_id': 'req-9538a8d1-64dc-4244-9cf6-460dbdcfd23f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:32.952614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-9538a8d1-64dc-4244-9cf6-460dbdcfd23f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a25937b89d45668c2f58e6d8bee6cc', 'request_id': 'req-9538a8d1-64dc-4244-9cf6-460dbdcfd23f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:32.962926 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-9538a8d1-64dc-4244-9cf6-460dbdcfd23f admin admin] The token cache is being invalidate because project 07a25937b89d45668c2f58e6d8bee6cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:32.963242 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-9538a8d1-64dc-4244-9cf6-460dbdcfd23f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:32.964082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-9538a8d1-64dc-4244-9cf6-460dbdcfd23f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:32.965696 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 977/1938] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:32 2022] DELETE /identity/v3/projects/07a25937b89d45668c2f58e6d8bee6cc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:32.971008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4775a-17ea-4092-acfe-24d20fb110f5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:32.971517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4775a-17ea-4092-acfe-24d20fb110f5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:32.971799 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4775a-17ea-4092-acfe-24d20fb110f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:32.993702 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a7f4775a-17ea-4092-acfe-24d20fb110f5 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:32.994919 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a7f4775a-17ea-4092-acfe-24d20fb110f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:33.059291 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 962/1939] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:33.067099 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364ed39-0edc-4a53-8568-70148f145c18 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:33.067388 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364ed39-0edc-4a53-8568-70148f145c18 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:33.067660 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364ed39-0edc-4a53-8568-70148f145c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:33.089934 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-5364ed39-0edc-4a53-8568-70148f145c18 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:33.091361 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5364ed39-0edc-4a53-8568-70148f145c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:33.112543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 978/1940] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:33.117924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4775a-17ea-4092-acfe-24d20fb110f5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:33.129691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4775a-17ea-4092-acfe-24d20fb110f5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:33.136067 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9225b-1b34-420e-9464-e4f02bc48841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:33.136839 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9225b-1b34-420e-9464-e4f02bc48841 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:33.137134 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9225b-1b34-420e-9464-e4f02bc48841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:33.137410 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9225b-1b34-420e-9464-e4f02bc48841 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:33.138140 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9225b-1b34-420e-9464-e4f02bc48841 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:33.138443 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9225b-1b34-420e-9464-e4f02bc48841 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:33.140067 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9225b-1b34-420e-9464-e4f02bc48841 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:33.152005 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 963/1941] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 05:06:33.156402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364ed39-0edc-4a53-8568-70148f145c18 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:33.165788 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364ed39-0edc-4a53-8568-70148f145c18 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:33.170691 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256bccb-441c-447d-9683-1eeab89e97ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:33.171430 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256bccb-441c-447d-9683-1eeab89e97ec admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:33.171520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256bccb-441c-447d-9683-1eeab89e97ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:33.171776 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256bccb-441c-447d-9683-1eeab89e97ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:33.172480 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256bccb-441c-447d-9683-1eeab89e97ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:33.174597 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256bccb-441c-447d-9683-1eeab89e97ec admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:33.205258 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 979/1942] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:33 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:33.209405 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9225b-1b34-420e-9464-e4f02bc48841 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:33.220927 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9225b-1b34-420e-9464-e4f02bc48841 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:33.307661 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc2632-895b-41e7-bade-7b49fb6d48ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:33.308392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc2632-895b-41e7-bade-7b49fb6d48ab admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:33.308676 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc2632-895b-41e7-bade-7b49fb6d48ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:33.309492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc2632-895b-41e7-bade-7b49fb6d48ab admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:33.311658 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc2632-895b-41e7-bade-7b49fb6d48ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:33.313800 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc2632-895b-41e7-bade-7b49fb6d48ab admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:33.346414 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 964/1943] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:33 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:06:33.347348 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256bccb-441c-447d-9683-1eeab89e97ec admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:33.359451 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256bccb-441c-447d-9683-1eeab89e97ec admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:33.369082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcef47-faac-4dee-b388-6973b7f522e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:33.369770 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcef47-faac-4dee-b388-6973b7f522e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:33.370054 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcef47-faac-4dee-b388-6973b7f522e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:33.370499 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcef47-faac-4dee-b388-6973b7f522e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:33.371253 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcef47-faac-4dee-b388-6973b7f522e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:33.374670 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9701d-6c85-4c49-939a-95e85ffd9b46 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:33.374966 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9701d-6c85-4c49-939a-95e85ffd9b46 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:33.375245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9701d-6c85-4c49-939a-95e85ffd9b46 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:33.377203 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffcef47-faac-4dee-b388-6973b7f522e4 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:33.377321 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 965/1944] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 27 05:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 27 05:06:33.387591 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970b660-9135-4beb-8a73-42c5225af765 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:33.387972 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970b660-9135-4beb-8a73-42c5225af765 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:33.388329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970b660-9135-4beb-8a73-42c5225af765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:33.398009 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 980/1945] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:33.399918 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcef47-faac-4dee-b388-6973b7f522e4 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:33.410902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcef47-faac-4dee-b388-6973b7f522e4 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:33.413976 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6970b660-9135-4beb-8a73-42c5225af765 None None] MFA Rules not processed for user `faac84ed9d37420c811bbf6ac7df0b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:33.416302 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6970b660-9135-4beb-8a73-42c5225af765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:33.417077 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5e2b9-2d48-4092-901c-d107d2f3bef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:33.418397 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5e2b9-2d48-4092-901c-d107d2f3bef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:33.421609 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5e2b9-2d48-4092-901c-d107d2f3bef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:33.422092 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5e2b9-2d48-4092-901c-d107d2f3bef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:33.422892 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5e2b9-2d48-4092-901c-d107d2f3bef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:33.424740 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5e2b9-2d48-4092-901c-d107d2f3bef4 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:33.436818 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 981/1946] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:33.440902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5e2b9-2d48-4092-901c-d107d2f3bef4 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:33.451412 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5e2b9-2d48-4092-901c-d107d2f3bef4 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:33.457229 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a242c-9512-4567-8dbc-0fcb04847523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:33.458310 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a242c-9512-4567-8dbc-0fcb04847523 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:33.458802 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a242c-9512-4567-8dbc-0fcb04847523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:33.459197 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a242c-9512-4567-8dbc-0fcb04847523 admin admin] PATH_INFO: `/v3/projects/b2ff915f630e4a4ebc98c0f86c7b932d/users/10a3d33a78104e49b54196884d86a32a/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:33.480586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a242c-9512-4567-8dbc-0fcb04847523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ff915f630e4a4ebc98c0f86c7b932d, user_id=10a3d33a78104e49b54196884d86a32a, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:33.484956 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a242c-9512-4567-8dbc-0fcb04847523 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:33.503412 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 982/1947] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:33 2022] PUT /identity/v3/projects/b2ff915f630e4a4ebc98c0f86c7b932d/users/10a3d33a78104e49b54196884d86a32a/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:33.509532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 966/1948] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 27 05:06:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:33.515497 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0892110-2e70-4ff8-971d-6574b46d1f16 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:33.515797 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0892110-2e70-4ff8-971d-6574b46d1f16 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:33.516078 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0892110-2e70-4ff8-971d-6574b46d1f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:33.529751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970b660-9135-4beb-8a73-42c5225af765 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:33.531322 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6970b660-9135-4beb-8a73-42c5225af765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:33.547915 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970b660-9135-4beb-8a73-42c5225af765 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:33.561165 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b0892110-2e70-4ff8-971d-6574b46d1f16 None None] MFA Rules not processed for user `10a3d33a78104e49b54196884d86a32a`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:33.562382 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b0892110-2e70-4ff8-971d-6574b46d1f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:33.616612 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4405ba-3783-4e5f-9c28-2e0e64feb647 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:33.617791 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4405ba-3783-4e5f-9c28-2e0e64feb647 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:33.618263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4405ba-3783-4e5f-9c28-2e0e64feb647 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:33.618722 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4405ba-3783-4e5f-9c28-2e0e64feb647 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:33.626298 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 983/1949] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:33.633534 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4405ba-3783-4e5f-9c28-2e0e64feb647 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:33.635141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4405ba-3783-4e5f-9c28-2e0e64feb647 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:33.638235 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0892110-2e70-4ff8-971d-6574b46d1f16 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:33.639747 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b0892110-2e70-4ff8-971d-6574b46d1f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:33.645786 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 967/1950] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:33.656143 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0892110-2e70-4ff8-971d-6574b46d1f16 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:33.661793 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce7bff-c02c-4402-a903-8377afaa5946 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:33.662433 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce7bff-c02c-4402-a903-8377afaa5946 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:33.662709 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce7bff-c02c-4402-a903-8377afaa5946 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:33.662978 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce7bff-c02c-4402-a903-8377afaa5946 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:33.671447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce7bff-c02c-4402-a903-8377afaa5946 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:33.673098 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce7bff-c02c-4402-a903-8377afaa5946 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:33.684573 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 984/1951] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:06:33.859636 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4405ba-3783-4e5f-9c28-2e0e64feb647 service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:33.920903 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4405ba-3783-4e5f-9c28-2e0e64feb647 service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:33.925337 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416eb7b3-7b09-4dc3-9b70-231d36ee5c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:33.926196 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416eb7b3-7b09-4dc3-9b70-231d36ee5c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:33.926471 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416eb7b3-7b09-4dc3-9b70-231d36ee5c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:33.926738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416eb7b3-7b09-4dc3-9b70-231d36ee5c0d admin admin] PATH_INFO: `/v3/users/10a3d33a78104e49b54196884d86a32a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:33.928698 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416eb7b3-7b09-4dc3-9b70-231d36ee5c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=10a3d33a78104e49b54196884d86a32a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:33.930652 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416eb7b3-7b09-4dc3-9b70-231d36ee5c0d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:33.975146 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-416eb7b3-7b09-4dc3-9b70-231d36ee5c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10a3d33a78104e49b54196884d86a32a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:33.975828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-416eb7b3-7b09-4dc3-9b70-231d36ee5c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10a3d33a78104e49b54196884d86a32a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:33.976428 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-416eb7b3-7b09-4dc3-9b70-231d36ee5c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10a3d33a78104e49b54196884d86a32a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:33.983428 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-416eb7b3-7b09-4dc3-9b70-231d36ee5c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10a3d33a78104e49b54196884d86a32a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:33.998137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-416eb7b3-7b09-4dc3-9b70-231d36ee5c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10a3d33a78104e49b54196884d86a32a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:34.011473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 968/1952] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:33 2022] DELETE /identity/v3/users/10a3d33a78104e49b54196884d86a32a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:34.016122 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91d588-576b-4720-9f9d-c0733900ced0 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:34.016588 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91d588-576b-4720-9f9d-c0733900ced0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:34.016697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91d588-576b-4720-9f9d-c0733900ced0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:34.035861 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0e91d588-576b-4720-9f9d-c0733900ced0 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:34.037648 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0e91d588-576b-4720-9f9d-c0733900ced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:34.097169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 985/1953] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:34.107548 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416eb7b3-7b09-4dc3-9b70-231d36ee5c0d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:34.108999 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-416eb7b3-7b09-4dc3-9b70-231d36ee5c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:34.169057 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416eb7b3-7b09-4dc3-9b70-231d36ee5c0d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:34.172675 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1115b46-b782-42de-9429-c6ba89f3c2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:34.173357 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1115b46-b782-42de-9429-c6ba89f3c2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:34.173635 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1115b46-b782-42de-9429-c6ba89f3c2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:34.173911 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1115b46-b782-42de-9429-c6ba89f3c2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:34.183919 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1115b46-b782-42de-9429-c6ba89f3c2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:34.185400 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1115b46-b782-42de-9429-c6ba89f3c2a1 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:34.195226 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 969/1954] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:34.480278 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91d588-576b-4720-9f9d-c0733900ced0 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:34.481762 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0e91d588-576b-4720-9f9d-c0733900ced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:34.494321 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91d588-576b-4720-9f9d-c0733900ced0 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:34.499009 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74174d-7c66-4bc2-804f-2adf652c9848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:34.499860 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74174d-7c66-4bc2-804f-2adf652c9848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:34.500137 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74174d-7c66-4bc2-804f-2adf652c9848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:34.500413 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74174d-7c66-4bc2-804f-2adf652c9848 admin admin] PATH_INFO: `/v3/projects/b2ff915f630e4a4ebc98c0f86c7b932d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:34.501799 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74174d-7c66-4bc2-804f-2adf652c9848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2ff915f630e4a4ebc98c0f86c7b932d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:34.504046 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74174d-7c66-4bc2-804f-2adf652c9848 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:34.556484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ef74174d-7c66-4bc2-804f-2adf652c9848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2ff915f630e4a4ebc98c0f86c7b932d', 'request_id': 'req-ef74174d-7c66-4bc2-804f-2adf652c9848'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:34.562439 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ef74174d-7c66-4bc2-804f-2adf652c9848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2ff915f630e4a4ebc98c0f86c7b932d', 'request_id': 'req-ef74174d-7c66-4bc2-804f-2adf652c9848'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:34.575261 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ef74174d-7c66-4bc2-804f-2adf652c9848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2ff915f630e4a4ebc98c0f86c7b932d', 'request_id': 'req-ef74174d-7c66-4bc2-804f-2adf652c9848'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:34.586815 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ef74174d-7c66-4bc2-804f-2adf652c9848 admin admin] The token cache is being invalidate because project b2ff915f630e4a4ebc98c0f86c7b932d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:34.587094 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ef74174d-7c66-4bc2-804f-2adf652c9848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:34.587773 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ef74174d-7c66-4bc2-804f-2adf652c9848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:34.589434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 986/1955] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:34 2022] DELETE /identity/v3/projects/b2ff915f630e4a4ebc98c0f86c7b932d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:34.594300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cea13-0aa6-402f-b64e-2831facb7f26 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:34.594594 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cea13-0aa6-402f-b64e-2831facb7f26 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:34.594877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cea13-0aa6-402f-b64e-2831facb7f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:34.612392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a49cea13-0aa6-402f-b64e-2831facb7f26 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:34.613760 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a49cea13-0aa6-402f-b64e-2831facb7f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:34.672013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 970/1956] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:34.681855 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ac51f-0fc0-4b64-b01c-0cf6913d3976 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:34.682147 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ac51f-0fc0-4b64-b01c-0cf6913d3976 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:34.682431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ac51f-0fc0-4b64-b01c-0cf6913d3976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:34.701277 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-378ac51f-0fc0-4b64-b01c-0cf6913d3976 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:34.702477 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-378ac51f-0fc0-4b64-b01c-0cf6913d3976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:34.710845 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 987/1957] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:34.715175 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cea13-0aa6-402f-b64e-2831facb7f26 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:34.724739 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cea13-0aa6-402f-b64e-2831facb7f26 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:34.729387 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c749d09-2397-406f-976a-90a50942d551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:34.730036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c749d09-2397-406f-976a-90a50942d551 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:34.730315 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c749d09-2397-406f-976a-90a50942d551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:34.730587 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c749d09-2397-406f-976a-90a50942d551 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:34.731301 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c749d09-2397-406f-976a-90a50942d551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:34.731602 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c749d09-2397-406f-976a-90a50942d551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:34.733221 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c749d09-2397-406f-976a-90a50942d551 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:34.745103 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 971/1958] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:34.749476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ac51f-0fc0-4b64-b01c-0cf6913d3976 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:34.759586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ac51f-0fc0-4b64-b01c-0cf6913d3976 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:34.764250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df06781-f189-40c4-bd63-e65577ec63fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:34.764946 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df06781-f189-40c4-bd63-e65577ec63fd admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:34.765226 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df06781-f189-40c4-bd63-e65577ec63fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:34.765493 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df06781-f189-40c4-bd63-e65577ec63fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:34.766210 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df06781-f189-40c4-bd63-e65577ec63fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:34.768210 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df06781-f189-40c4-bd63-e65577ec63fd admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:34.793821 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 988/1959] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:34 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:06:34.797954 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c749d09-2397-406f-976a-90a50942d551 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:34.807977 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c749d09-2397-406f-976a-90a50942d551 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:34.861583 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22bbfa-d510-49d2-9b54-ebaa50ee39c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:34.862244 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22bbfa-d510-49d2-9b54-ebaa50ee39c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:34.862528 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22bbfa-d510-49d2-9b54-ebaa50ee39c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:34.862806 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22bbfa-d510-49d2-9b54-ebaa50ee39c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:34.863494 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22bbfa-d510-49d2-9b54-ebaa50ee39c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:34.865455 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22bbfa-d510-49d2-9b54-ebaa50ee39c8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:34.885314 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 972/1960] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:34 2022] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:34.889464 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df06781-f189-40c4-bd63-e65577ec63fd admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:34.900421 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df06781-f189-40c4-bd63-e65577ec63fd admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:34.905182 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e493c-60ba-4be5-8925-adf282efe2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:34.905924 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e493c-60ba-4be5-8925-adf282efe2be admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:34.906200 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e493c-60ba-4be5-8925-adf282efe2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:34.906475 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e493c-60ba-4be5-8925-adf282efe2be admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:34.907198 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e493c-60ba-4be5-8925-adf282efe2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:34.908806 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e493c-60ba-4be5-8925-adf282efe2be admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:34.938001 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 989/1961] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:34.942519 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22bbfa-d510-49d2-9b54-ebaa50ee39c8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:34.953595 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22bbfa-d510-49d2-9b54-ebaa50ee39c8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:34.984083 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff02083-6f23-4514-8202-eb5ead329fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:34.984808 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff02083-6f23-4514-8202-eb5ead329fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:34.985100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff02083-6f23-4514-8202-eb5ead329fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:34.985375 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff02083-6f23-4514-8202-eb5ead329fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:34.986132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff02083-6f23-4514-8202-eb5ead329fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:34.987735 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff02083-6f23-4514-8202-eb5ead329fb9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:35.002806 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 973/1962] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:06:35.010619 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e493c-60ba-4be5-8925-adf282efe2be admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:35.023030 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e493c-60ba-4be5-8925-adf282efe2be admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:35.028948 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a8c67-13ea-4b37-b363-79987ca7d6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:35.030036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a8c67-13ea-4b37-b363-79987ca7d6bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:35.030810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a8c67-13ea-4b37-b363-79987ca7d6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:35.031078 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a8c67-13ea-4b37-b363-79987ca7d6bd admin admin] PATH_INFO: `/v3/projects/a8d8c32d17ae43efa60c6cea55799c2a/users/a3d8582efcac4b3aab072618f153469c/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:35.047399 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a8c67-13ea-4b37-b363-79987ca7d6bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d8c32d17ae43efa60c6cea55799c2a, user_id=a3d8582efcac4b3aab072618f153469c, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:35.050168 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a8c67-13ea-4b37-b363-79987ca7d6bd admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:35.066650 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 990/1963] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:35 2022] PUT /identity/v3/projects/a8d8c32d17ae43efa60c6cea55799c2a/users/a3d8582efcac4b3aab072618f153469c/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:35.078361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c4589-82f1-4ea8-8150-a2bce735fdb0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:35.078664 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c4589-82f1-4ea8-8150-a2bce735fdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:35.078991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c4589-82f1-4ea8-8150-a2bce735fdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:35.109643 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b80c4589-82f1-4ea8-8150-a2bce735fdb0 None None] MFA Rules not processed for user `a3d8582efcac4b3aab072618f153469c`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:35.111091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b80c4589-82f1-4ea8-8150-a2bce735fdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:35.191194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 974/1964] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:35.196164 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a8c67-13ea-4b37-b363-79987ca7d6bd admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:35.291592 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a8c67-13ea-4b37-b363-79987ca7d6bd admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:35.297952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d42cb8-7bcc-46f8-9f42-69668713968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:35.299111 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d42cb8-7bcc-46f8-9f42-69668713968a admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:35.299593 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d42cb8-7bcc-46f8-9f42-69668713968a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:35.299988 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d42cb8-7bcc-46f8-9f42-69668713968a admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:35.300965 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d42cb8-7bcc-46f8-9f42-69668713968a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:35.303938 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d42cb8-7bcc-46f8-9f42-69668713968a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:35.336023 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 991/1965] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:35 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:35.340001 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c4589-82f1-4ea8-8150-a2bce735fdb0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:35.353856 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c4589-82f1-4ea8-8150-a2bce735fdb0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:35.419768 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad60d28-f096-4cbe-aa82-a9302d561d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:35.420643 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad60d28-f096-4cbe-aa82-a9302d561d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:35.420988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad60d28-f096-4cbe-aa82-a9302d561d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:35.421259 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad60d28-f096-4cbe-aa82-a9302d561d2e admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:35.422051 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad60d28-f096-4cbe-aa82-a9302d561d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:35.424162 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad60d28-f096-4cbe-aa82-a9302d561d2e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:35.454111 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 975/1966] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:35 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:35.455194 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d42cb8-7bcc-46f8-9f42-69668713968a admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:35.467721 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d42cb8-7bcc-46f8-9f42-69668713968a admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:35.473826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c011549-aba0-41fd-a18d-ce96e7c8b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:35.475000 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c011549-aba0-41fd-a18d-ce96e7c8b5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:35.475294 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c011549-aba0-41fd-a18d-ce96e7c8b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:35.475571 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c011549-aba0-41fd-a18d-ce96e7c8b5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:35.476373 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c011549-aba0-41fd-a18d-ce96e7c8b5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:35.478137 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c011549-aba0-41fd-a18d-ce96e7c8b5d2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:35.492002 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 992/1967] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:06:35.496477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad60d28-f096-4cbe-aa82-a9302d561d2e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:35.507266 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad60d28-f096-4cbe-aa82-a9302d561d2e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:35.512619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34599a80-dc7d-49d3-8e6f-d5ecc2fb6ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:35.513568 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34599a80-dc7d-49d3-8e6f-d5ecc2fb6ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:35.513901 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34599a80-dc7d-49d3-8e6f-d5ecc2fb6ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:35.514120 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34599a80-dc7d-49d3-8e6f-d5ecc2fb6ea8 admin admin] PATH_INFO: `/v3/projects/ba3af35e9ee449349f40359a72f24ab3/users/8118649ffa884e2ba258771cf65c1238/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:35.540918 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34599a80-dc7d-49d3-8e6f-d5ecc2fb6ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3af35e9ee449349f40359a72f24ab3, user_id=8118649ffa884e2ba258771cf65c1238, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:35.543715 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34599a80-dc7d-49d3-8e6f-d5ecc2fb6ea8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:35.559468 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 976/1968] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:35 2022] PUT /identity/v3/projects/ba3af35e9ee449349f40359a72f24ab3/users/8118649ffa884e2ba258771cf65c1238/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:35.563286 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c011549-aba0-41fd-a18d-ce96e7c8b5d2 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:35.575085 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c011549-aba0-41fd-a18d-ce96e7c8b5d2 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:35.658257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f14210-375a-40a9-8a3c-100c24348a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:35.659084 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f14210-375a-40a9-8a3c-100c24348a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:35.659442 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f14210-375a-40a9-8a3c-100c24348a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:35.659785 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f14210-375a-40a9-8a3c-100c24348a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:35.660590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f14210-375a-40a9-8a3c-100c24348a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:35.663014 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f14210-375a-40a9-8a3c-100c24348a05 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:35.679624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 993/1969] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:06:35.684301 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34599a80-dc7d-49d3-8e6f-d5ecc2fb6ea8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:35.700023 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34599a80-dc7d-49d3-8e6f-d5ecc2fb6ea8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:35.705353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54ed89-9d6b-4df7-b487-a56612e8c76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:35.706258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54ed89-9d6b-4df7-b487-a56612e8c76b admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:35.706850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54ed89-9d6b-4df7-b487-a56612e8c76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:35.707173 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54ed89-9d6b-4df7-b487-a56612e8c76b admin admin] PATH_INFO: `/v3/projects/ba3af35e9ee449349f40359a72f24ab3/users/8118649ffa884e2ba258771cf65c1238/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:35.709490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54ed89-9d6b-4df7-b487-a56612e8c76b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3af35e9ee449349f40359a72f24ab3, user_id=8118649ffa884e2ba258771cf65c1238, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:35.712465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54ed89-9d6b-4df7-b487-a56612e8c76b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:35.727060 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 977/1970] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:35 2022] PUT /identity/v3/projects/ba3af35e9ee449349f40359a72f24ab3/users/8118649ffa884e2ba258771cf65c1238/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:35.738382 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebaf0f-ef70-40e4-9241-bf23f37fc659 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:35.738998 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebaf0f-ef70-40e4-9241-bf23f37fc659 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:35.739307 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebaf0f-ef70-40e4-9241-bf23f37fc659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:35.782200 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a3ebaf0f-ef70-40e4-9241-bf23f37fc659 None None] MFA Rules not processed for user `8118649ffa884e2ba258771cf65c1238`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:35.783505 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a3ebaf0f-ef70-40e4-9241-bf23f37fc659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:35.862198 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 994/1971] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:35 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:35.874623 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54ed89-9d6b-4df7-b487-a56612e8c76b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:35.876680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2e54ed89-9d6b-4df7-b487-a56612e8c76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:35.940066 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54ed89-9d6b-4df7-b487-a56612e8c76b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:35.943753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362e980-f2db-438f-b089-e24664eee241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:35.944399 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362e980-f2db-438f-b089-e24664eee241 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:35.944683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362e980-f2db-438f-b089-e24664eee241 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:35.944992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362e980-f2db-438f-b089-e24664eee241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:35.954640 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362e980-f2db-438f-b089-e24664eee241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:35.956158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362e980-f2db-438f-b089-e24664eee241 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:35.966656 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 978/1972] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:35 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:36.041261 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebaf0f-ef70-40e4-9241-bf23f37fc659 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:36.050969 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebaf0f-ef70-40e4-9241-bf23f37fc659 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:36.055015 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5aa12-74d7-45a1-9842-16c0096b74f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:36.055663 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5aa12-74d7-45a1-9842-16c0096b74f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:36.055945 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5aa12-74d7-45a1-9842-16c0096b74f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:36.056220 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5aa12-74d7-45a1-9842-16c0096b74f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:36.116494 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5aa12-74d7-45a1-9842-16c0096b74f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:36.117966 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5aa12-74d7-45a1-9842-16c0096b74f0 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:36.127306 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 995/1973] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:39.307969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362e980-f2db-438f-b089-e24664eee241 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:39.309786 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b362e980-f2db-438f-b089-e24664eee241 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:39.441056 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362e980-f2db-438f-b089-e24664eee241 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:39.448460 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517bc48-c8fa-4376-92e8-1e0946293e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:39.449381 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517bc48-c8fa-4376-92e8-1e0946293e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:39.449669 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517bc48-c8fa-4376-92e8-1e0946293e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:39.449964 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517bc48-c8fa-4376-92e8-1e0946293e0a admin admin] PATH_INFO: `/v3/users/25d13d8f266f4702bbb5d97ec44ad8b4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:39.451206 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517bc48-c8fa-4376-92e8-1e0946293e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d13d8f266f4702bbb5d97ec44ad8b4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:39.457034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517bc48-c8fa-4376-92e8-1e0946293e0a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:39.517227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5aa12-74d7-45a1-9842-16c0096b74f0 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:39.531484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5aa12-74d7-45a1-9842-16c0096b74f0 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:39.545078 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7517bc48-c8fa-4376-92e8-1e0946293e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d13d8f266f4702bbb5d97ec44ad8b4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:39.545078 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7517bc48-c8fa-4376-92e8-1e0946293e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d13d8f266f4702bbb5d97ec44ad8b4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:39.545078 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7517bc48-c8fa-4376-92e8-1e0946293e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d13d8f266f4702bbb5d97ec44ad8b4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:39.545300 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b21df-d0ac-44e8-ac17-a1811409cd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:39.545300 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b21df-d0ac-44e8-ac17-a1811409cd7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:39.545300 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b21df-d0ac-44e8-ac17-a1811409cd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:39.545300 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b21df-d0ac-44e8-ac17-a1811409cd7a admin admin] PATH_INFO: `/v3/users/a3d8582efcac4b3aab072618f153469c` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:39.545563 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b21df-d0ac-44e8-ac17-a1811409cd7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d8582efcac4b3aab072618f153469c)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:39.545563 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b21df-d0ac-44e8-ac17-a1811409cd7a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:39.551426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7517bc48-c8fa-4376-92e8-1e0946293e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d13d8f266f4702bbb5d97ec44ad8b4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:39.565532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7517bc48-c8fa-4376-92e8-1e0946293e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d13d8f266f4702bbb5d97ec44ad8b4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:39.584304 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 979/1974] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:39 2022] DELETE /identity/v3/users/25d13d8f266f4702bbb5d97ec44ad8b4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:39.588546 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66556fb6-bbab-4bdc-a6d7-6652b9330650 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:39.588879 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66556fb6-bbab-4bdc-a6d7-6652b9330650 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:39.589154 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66556fb6-bbab-4bdc-a6d7-6652b9330650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:39.611087 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-66556fb6-bbab-4bdc-a6d7-6652b9330650 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:39.612033 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0a7b21df-d0ac-44e8-ac17-a1811409cd7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d8582efcac4b3aab072618f153469c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:39.612906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-66556fb6-bbab-4bdc-a6d7-6652b9330650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:39.613039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0a7b21df-d0ac-44e8-ac17-a1811409cd7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d8582efcac4b3aab072618f153469c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:39.613664 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0a7b21df-d0ac-44e8-ac17-a1811409cd7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d8582efcac4b3aab072618f153469c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:39.621130 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0a7b21df-d0ac-44e8-ac17-a1811409cd7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d8582efcac4b3aab072618f153469c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:39.633220 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0a7b21df-d0ac-44e8-ac17-a1811409cd7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d8582efcac4b3aab072618f153469c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:39.645463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 996/1975] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:39 2022] DELETE /identity/v3/users/a3d8582efcac4b3aab072618f153469c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:39.650634 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9087001-22dd-4735-881e-d74a874188d8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:39.650925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9087001-22dd-4735-881e-d74a874188d8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:39.651209 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9087001-22dd-4735-881e-d74a874188d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:39.668324 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e9087001-22dd-4735-881e-d74a874188d8 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:39.669565 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e9087001-22dd-4735-881e-d74a874188d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:39.683511 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 980/1976] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:39.694746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66556fb6-bbab-4bdc-a6d7-6652b9330650 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:39.696619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-66556fb6-bbab-4bdc-a6d7-6652b9330650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:39.734192 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 997/1977] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:39.740709 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9087001-22dd-4735-881e-d74a874188d8 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:39.742433 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e9087001-22dd-4735-881e-d74a874188d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:39.759875 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66556fb6-bbab-4bdc-a6d7-6652b9330650 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:39.811929 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4914e-ca25-4f89-abcd-784518f1a606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:39.812594 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4914e-ca25-4f89-abcd-784518f1a606 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:39.812911 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4914e-ca25-4f89-abcd-784518f1a606 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:39.813195 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4914e-ca25-4f89-abcd-784518f1a606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:39.820696 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9087001-22dd-4735-881e-d74a874188d8 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:39.824128 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4914e-ca25-4f89-abcd-784518f1a606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:39.825622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4914e-ca25-4f89-abcd-784518f1a606 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:39.826144 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40059919-e73b-4f40-b6a3-d6af9510ae97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:39.827211 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40059919-e73b-4f40-b6a3-d6af9510ae97 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:39.828037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40059919-e73b-4f40-b6a3-d6af9510ae97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:39.828235 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40059919-e73b-4f40-b6a3-d6af9510ae97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:39.836209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 981/1978] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:06:39.841935 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40059919-e73b-4f40-b6a3-d6af9510ae97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:39.844024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40059919-e73b-4f40-b6a3-d6af9510ae97 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:39.861315 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 998/1979] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:40.183560 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4914e-ca25-4f89-abcd-784518f1a606 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:40.184000 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3fe4914e-ca25-4f89-abcd-784518f1a606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:40.185978 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40059919-e73b-4f40-b6a3-d6af9510ae97 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:40.188526 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-40059919-e73b-4f40-b6a3-d6af9510ae97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:40.211678 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40059919-e73b-4f40-b6a3-d6af9510ae97 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:40.218934 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4914e-ca25-4f89-abcd-784518f1a606 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:40.224553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069a815-55ff-42bb-b649-7392dfdcf096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:40.225538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069a815-55ff-42bb-b649-7392dfdcf096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:40.225829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069a815-55ff-42bb-b649-7392dfdcf096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:40.226108 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069a815-55ff-42bb-b649-7392dfdcf096 admin admin] PATH_INFO: `/v3/projects/edec18df25fa4c429eebf37964a5f354` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:40.227318 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069a815-55ff-42bb-b649-7392dfdcf096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edec18df25fa4c429eebf37964a5f354)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:40.229705 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069a815-55ff-42bb-b649-7392dfdcf096 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:40.236045 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96721dd3-6be5-4b62-99b9-7018dc7b4920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:40.237208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96721dd3-6be5-4b62-99b9-7018dc7b4920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:40.237493 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96721dd3-6be5-4b62-99b9-7018dc7b4920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:40.237783 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96721dd3-6be5-4b62-99b9-7018dc7b4920 admin admin] PATH_INFO: `/v3/projects/a8d8c32d17ae43efa60c6cea55799c2a` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:40.243693 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96721dd3-6be5-4b62-99b9-7018dc7b4920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8d8c32d17ae43efa60c6cea55799c2a)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:40.249944 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96721dd3-6be5-4b62-99b9-7018dc7b4920 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:40.325495 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3069a815-55ff-42bb-b649-7392dfdcf096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edec18df25fa4c429eebf37964a5f354', 'request_id': 'req-3069a815-55ff-42bb-b649-7392dfdcf096'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.336280 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3069a815-55ff-42bb-b649-7392dfdcf096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edec18df25fa4c429eebf37964a5f354', 'request_id': 'req-3069a815-55ff-42bb-b649-7392dfdcf096'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.344288 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3069a815-55ff-42bb-b649-7392dfdcf096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edec18df25fa4c429eebf37964a5f354', 'request_id': 'req-3069a815-55ff-42bb-b649-7392dfdcf096'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.359672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3069a815-55ff-42bb-b649-7392dfdcf096 admin admin] The token cache is being invalidate because project edec18df25fa4c429eebf37964a5f354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:40.360126 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3069a815-55ff-42bb-b649-7392dfdcf096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.361243 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3069a815-55ff-42bb-b649-7392dfdcf096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.365835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 982/1980] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:40 2022] DELETE /identity/v3/projects/edec18df25fa4c429eebf37964a5f354 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:40.370068 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069a815-55ff-42bb-b649-7392dfdcf096 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:40.370617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-96721dd3-6be5-4b62-99b9-7018dc7b4920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d8c32d17ae43efa60c6cea55799c2a', 'request_id': 'req-96721dd3-6be5-4b62-99b9-7018dc7b4920'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.372019 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3069a815-55ff-42bb-b649-7392dfdcf096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:40.381631 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-96721dd3-6be5-4b62-99b9-7018dc7b4920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d8c32d17ae43efa60c6cea55799c2a', 'request_id': 'req-96721dd3-6be5-4b62-99b9-7018dc7b4920'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.392527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-96721dd3-6be5-4b62-99b9-7018dc7b4920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d8c32d17ae43efa60c6cea55799c2a', 'request_id': 'req-96721dd3-6be5-4b62-99b9-7018dc7b4920'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.412543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-96721dd3-6be5-4b62-99b9-7018dc7b4920 admin admin] The token cache is being invalidate because project a8d8c32d17ae43efa60c6cea55799c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:40.412896 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-96721dd3-6be5-4b62-99b9-7018dc7b4920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.413699 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-96721dd3-6be5-4b62-99b9-7018dc7b4920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.416689 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 999/1981] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:40 2022] DELETE /identity/v3/projects/a8d8c32d17ae43efa60c6cea55799c2a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:40.420427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96721dd3-6be5-4b62-99b9-7018dc7b4920 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:40.429052 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-96721dd3-6be5-4b62-99b9-7018dc7b4920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:40.539710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069a815-55ff-42bb-b649-7392dfdcf096 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:40.597823 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96721dd3-6be5-4b62-99b9-7018dc7b4920 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:40.623365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082354f-1485-4a0a-a0ec-c7bc2cfe67ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:40.624714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082354f-1485-4a0a-a0ec-c7bc2cfe67ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:40.625037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082354f-1485-4a0a-a0ec-c7bc2cfe67ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:40.625326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082354f-1485-4a0a-a0ec-c7bc2cfe67ca admin admin] PATH_INFO: `/v3/users/8118649ffa884e2ba258771cf65c1238` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:40.626694 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082354f-1485-4a0a-a0ec-c7bc2cfe67ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=8118649ffa884e2ba258771cf65c1238)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:40.629361 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082354f-1485-4a0a-a0ec-c7bc2cfe67ca admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:40.682459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd268b9-aeda-403b-bf09-b6bab7abfbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:40.683553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd268b9-aeda-403b-bf09-b6bab7abfbec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:40.684386 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd268b9-aeda-403b-bf09-b6bab7abfbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:40.684601 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd268b9-aeda-403b-bf09-b6bab7abfbec admin admin] PATH_INFO: `/v3/users/b4b6ecc708b6426790291fcf8de8eb64` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:40.685969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd268b9-aeda-403b-bf09-b6bab7abfbec admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b6ecc708b6426790291fcf8de8eb64)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:40.688553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd268b9-aeda-403b-bf09-b6bab7abfbec admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:40.764629 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6082354f-1485-4a0a-a0ec-c7bc2cfe67ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8118649ffa884e2ba258771cf65c1238'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.765787 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6082354f-1485-4a0a-a0ec-c7bc2cfe67ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8118649ffa884e2ba258771cf65c1238'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.766613 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6082354f-1485-4a0a-a0ec-c7bc2cfe67ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8118649ffa884e2ba258771cf65c1238'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.782801 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6082354f-1485-4a0a-a0ec-c7bc2cfe67ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8118649ffa884e2ba258771cf65c1238'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.791496 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1cd268b9-aeda-403b-bf09-b6bab7abfbec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b6ecc708b6426790291fcf8de8eb64'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.791976 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1cd268b9-aeda-403b-bf09-b6bab7abfbec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b6ecc708b6426790291fcf8de8eb64'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.792766 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1cd268b9-aeda-403b-bf09-b6bab7abfbec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b6ecc708b6426790291fcf8de8eb64'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.806425 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1cd268b9-aeda-403b-bf09-b6bab7abfbec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b6ecc708b6426790291fcf8de8eb64'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.811245 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6082354f-1485-4a0a-a0ec-c7bc2cfe67ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8118649ffa884e2ba258771cf65c1238'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.833639 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1000/1982] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:40 2022] DELETE /identity/v3/users/8118649ffa884e2ba258771cf65c1238 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:40.835188 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082354f-1485-4a0a-a0ec-c7bc2cfe67ca admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:40.837397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1cd268b9-aeda-403b-bf09-b6bab7abfbec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b6ecc708b6426790291fcf8de8eb64'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:40.837581 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6082354f-1485-4a0a-a0ec-c7bc2cfe67ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:40.855518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 983/1983] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:40 2022] DELETE /identity/v3/users/b4b6ecc708b6426790291fcf8de8eb64 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:41.006860 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082354f-1485-4a0a-a0ec-c7bc2cfe67ca admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:41.132720 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09669837-1507-4644-8123-63617df07801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:41.134616 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09669837-1507-4644-8123-63617df07801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:41.135123 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09669837-1507-4644-8123-63617df07801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:41.135406 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09669837-1507-4644-8123-63617df07801 admin admin] PATH_INFO: `/v3/users/05e75b45ae3a41b8ac090b1e4c89174f` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:41.136724 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09669837-1507-4644-8123-63617df07801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e75b45ae3a41b8ac090b1e4c89174f)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:41.139315 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09669837-1507-4644-8123-63617df07801 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:41.210417 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-09669837-1507-4644-8123-63617df07801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e75b45ae3a41b8ac090b1e4c89174f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.211456 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-09669837-1507-4644-8123-63617df07801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e75b45ae3a41b8ac090b1e4c89174f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.214556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-09669837-1507-4644-8123-63617df07801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e75b45ae3a41b8ac090b1e4c89174f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.231127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-09669837-1507-4644-8123-63617df07801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e75b45ae3a41b8ac090b1e4c89174f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.250087 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-09669837-1507-4644-8123-63617df07801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e75b45ae3a41b8ac090b1e4c89174f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.269697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1001/1984] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:40 2022] DELETE /identity/v3/users/05e75b45ae3a41b8ac090b1e4c89174f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:41.274644 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba9bae-b55d-4bcf-913c-f257a4a57d8b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:41.274932 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba9bae-b55d-4bcf-913c-f257a4a57d8b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:41.275221 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba9bae-b55d-4bcf-913c-f257a4a57d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:41.296359 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-fdba9bae-b55d-4bcf-913c-f257a4a57d8b None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:41.297694 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fdba9bae-b55d-4bcf-913c-f257a4a57d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:41.363523 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 984/1985] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:41.374525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09669837-1507-4644-8123-63617df07801 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:41.377163 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-09669837-1507-4644-8123-63617df07801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:41.399035 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba9bae-b55d-4bcf-913c-f257a4a57d8b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:41.400481 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fdba9bae-b55d-4bcf-913c-f257a4a57d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:41.412830 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba9bae-b55d-4bcf-913c-f257a4a57d8b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:41.418127 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6995f9-eda7-4ae3-bea5-d789095522f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:41.419202 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6995f9-eda7-4ae3-bea5-d789095522f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:41.419631 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6995f9-eda7-4ae3-bea5-d789095522f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:41.420133 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6995f9-eda7-4ae3-bea5-d789095522f5 admin admin] PATH_INFO: `/v3/projects/ba3af35e9ee449349f40359a72f24ab3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:41.421639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6995f9-eda7-4ae3-bea5-d789095522f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3af35e9ee449349f40359a72f24ab3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:41.424724 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6995f9-eda7-4ae3-bea5-d789095522f5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:41.460729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09669837-1507-4644-8123-63617df07801 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:41.465511 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c0d88-3524-4b2e-bede-0155de0864b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:41.466176 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c0d88-3524-4b2e-bede-0155de0864b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:41.466510 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c0d88-3524-4b2e-bede-0155de0864b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:41.466787 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c0d88-3524-4b2e-bede-0155de0864b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:41.478246 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c0d88-3524-4b2e-bede-0155de0864b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:41.479702 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c0d88-3524-4b2e-bede-0155de0864b1 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:41.490693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9f6995f9-eda7-4ae3-bea5-d789095522f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3af35e9ee449349f40359a72f24ab3', 'request_id': 'req-9f6995f9-eda7-4ae3-bea5-d789095522f5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.491683 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1002/1986] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:41.492315 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c0d88-3524-4b2e-bede-0155de0864b1 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:41.493990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-241c0d88-3524-4b2e-bede-0155de0864b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:41.501022 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9f6995f9-eda7-4ae3-bea5-d789095522f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3af35e9ee449349f40359a72f24ab3', 'request_id': 'req-9f6995f9-eda7-4ae3-bea5-d789095522f5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.508834 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c0d88-3524-4b2e-bede-0155de0864b1 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:41.522951 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9f6995f9-eda7-4ae3-bea5-d789095522f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3af35e9ee449349f40359a72f24ab3', 'request_id': 'req-9f6995f9-eda7-4ae3-bea5-d789095522f5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.535772 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9f6995f9-eda7-4ae3-bea5-d789095522f5 admin admin] The token cache is being invalidate because project ba3af35e9ee449349f40359a72f24ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:41.536069 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9f6995f9-eda7-4ae3-bea5-d789095522f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.538034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9f6995f9-eda7-4ae3-bea5-d789095522f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.540704 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 985/1987] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:41 2022] DELETE /identity/v3/projects/ba3af35e9ee449349f40359a72f24ab3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:41.547475 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d0ba2-ded9-43b3-afcc-82a7aa446268 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:41.547774 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d0ba2-ded9-43b3-afcc-82a7aa446268 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:41.548503 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d0ba2-ded9-43b3-afcc-82a7aa446268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:41.570874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-960d0ba2-ded9-43b3-afcc-82a7aa446268 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:41.572701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-960d0ba2-ded9-43b3-afcc-82a7aa446268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:41.591141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc642f-548d-4151-b86f-d400eb0964ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:41.592864 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc642f-548d-4151-b86f-d400eb0964ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:41.597395 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc642f-548d-4151-b86f-d400eb0964ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:41.597801 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc642f-548d-4151-b86f-d400eb0964ca admin admin] PATH_INFO: `/v3/projects/90a1d67eb5934b6bb3aff8c4000d0a22` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:41.600619 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc642f-548d-4151-b86f-d400eb0964ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a1d67eb5934b6bb3aff8c4000d0a22)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:41.602905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc642f-548d-4151-b86f-d400eb0964ca admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:41.645670 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 986/1988] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:41.656239 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e308cd-b112-40d6-98bf-328de3fd7d8d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:41.657123 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e308cd-b112-40d6-98bf-328de3fd7d8d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:41.657722 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e308cd-b112-40d6-98bf-328de3fd7d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:41.676460 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c3bc642f-548d-4151-b86f-d400eb0964ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a1d67eb5934b6bb3aff8c4000d0a22', 'request_id': 'req-c3bc642f-548d-4151-b86f-d400eb0964ca'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.679113 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-30e308cd-b112-40d6-98bf-328de3fd7d8d None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:41.680339 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-30e308cd-b112-40d6-98bf-328de3fd7d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:41.684969 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c3bc642f-548d-4151-b86f-d400eb0964ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a1d67eb5934b6bb3aff8c4000d0a22', 'request_id': 'req-c3bc642f-548d-4151-b86f-d400eb0964ca'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.698888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c3bc642f-548d-4151-b86f-d400eb0964ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a1d67eb5934b6bb3aff8c4000d0a22', 'request_id': 'req-c3bc642f-548d-4151-b86f-d400eb0964ca'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.722064 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c3bc642f-548d-4151-b86f-d400eb0964ca admin admin] The token cache is being invalidate because project 90a1d67eb5934b6bb3aff8c4000d0a22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:41.725821 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c3bc642f-548d-4151-b86f-d400eb0964ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.727889 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-c3bc642f-548d-4151-b86f-d400eb0964ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.732392 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1003/1989] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:41 2022] DELETE /identity/v3/projects/90a1d67eb5934b6bb3aff8c4000d0a22 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:41.734380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc642f-548d-4151-b86f-d400eb0964ca admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:41.738077 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c3bc642f-548d-4151-b86f-d400eb0964ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:41.784828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 987/1990] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:41.789477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e308cd-b112-40d6-98bf-328de3fd7d8d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:41.809824 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e308cd-b112-40d6-98bf-328de3fd7d8d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:41.823115 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3de34-292c-46b8-8853-66c5ec17c19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:41.824080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3de34-292c-46b8-8853-66c5ec17c19d admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:41.824635 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3de34-292c-46b8-8853-66c5ec17c19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:41.825114 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c3de34-292c-46b8-8853-66c5ec17c19d admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:41.826391 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3de34-292c-46b8-8853-66c5ec17c19d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:41.827583 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3de34-292c-46b8-8853-66c5ec17c19d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:41.832351 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c3de34-292c-46b8-8853-66c5ec17c19d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:41.860364 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 988/1991] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:41.862441 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3de34-292c-46b8-8853-66c5ec17c19d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:41.883196 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc642f-548d-4151-b86f-d400eb0964ca admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:41.895615 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c3de34-292c-46b8-8853-66c5ec17c19d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:41.897781 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be3c68-6c6a-4c3d-865d-de0f2f83c0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:41.899708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be3c68-6c6a-4c3d-865d-de0f2f83c0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:41.900371 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be3c68-6c6a-4c3d-865d-de0f2f83c0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:41.900904 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be3c68-6c6a-4c3d-865d-de0f2f83c0c2 admin admin] PATH_INFO: `/v3/users/bb3bf6f141a74fafa60892ff47dd7045` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:41.901950 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c6030-01a5-4059-a375-5bb238ecc2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:41.902584 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be3c68-6c6a-4c3d-865d-de0f2f83c0c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb3bf6f141a74fafa60892ff47dd7045)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:41.902704 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c6030-01a5-4059-a375-5bb238ecc2cc admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:41.902902 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c6030-01a5-4059-a375-5bb238ecc2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:41.903178 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c6030-01a5-4059-a375-5bb238ecc2cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:41.903914 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c6030-01a5-4059-a375-5bb238ecc2cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:41.905881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c6030-01a5-4059-a375-5bb238ecc2cc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:41.906503 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be3c68-6c6a-4c3d-865d-de0f2f83c0c2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:41.961195 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 989/1992] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:41 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:41.962579 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c6030-01a5-4059-a375-5bb238ecc2cc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:41.968148 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e34c6030-01a5-4059-a375-5bb238ecc2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:41.982114 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-03be3c68-6c6a-4c3d-865d-de0f2f83c0c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb3bf6f141a74fafa60892ff47dd7045'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.985940 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-03be3c68-6c6a-4c3d-865d-de0f2f83c0c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb3bf6f141a74fafa60892ff47dd7045'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:41.987283 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-03be3c68-6c6a-4c3d-865d-de0f2f83c0c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb3bf6f141a74fafa60892ff47dd7045'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:42.004036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-03be3c68-6c6a-4c3d-865d-de0f2f83c0c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb3bf6f141a74fafa60892ff47dd7045'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:42.030326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-03be3c68-6c6a-4c3d-865d-de0f2f83c0c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb3bf6f141a74fafa60892ff47dd7045'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:42.084671 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1004/1993] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:41 2022] DELETE /identity/v3/users/bb3bf6f141a74fafa60892ff47dd7045 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:42.084671 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be3c68-6c6a-4c3d-865d-de0f2f83c0c2 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:42.089031 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-03be3c68-6c6a-4c3d-865d-de0f2f83c0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:42.142119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c6030-01a5-4059-a375-5bb238ecc2cc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:42.255571 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be3c68-6c6a-4c3d-865d-de0f2f83c0c2 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:42.260703 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabbfa3-8622-4e55-a266-e413f3cbbd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:42.261491 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabbfa3-8622-4e55-a266-e413f3cbbd29 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:42.261842 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabbfa3-8622-4e55-a266-e413f3cbbd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:42.262049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabbfa3-8622-4e55-a266-e413f3cbbd29 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:42.262751 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabbfa3-8622-4e55-a266-e413f3cbbd29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:42.263434 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ceffa-2e94-46d4-b03f-811aeb6e87f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:42.264549 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ceffa-2e94-46d4-b03f-811aeb6e87f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:42.264695 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabbfa3-8622-4e55-a266-e413f3cbbd29 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:42.265533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ceffa-2e94-46d4-b03f-811aeb6e87f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:42.266014 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ceffa-2e94-46d4-b03f-811aeb6e87f2 admin admin] PATH_INFO: `/v3/projects/c376e961d6c348799b3aaa6cbc3265a3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:42.268732 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ceffa-2e94-46d4-b03f-811aeb6e87f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c376e961d6c348799b3aaa6cbc3265a3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:42.272139 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ceffa-2e94-46d4-b03f-811aeb6e87f2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:42.306795 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1005/1994] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:42 2022] POST /identity/v3/users => generated 301 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:42.310798 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabbfa3-8622-4e55-a266-e413f3cbbd29 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:42.330083 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabbfa3-8622-4e55-a266-e413f3cbbd29 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:42.347208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb67e9f-36ff-48ad-a075-fba9e7660be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:42.348265 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb67e9f-36ff-48ad-a075-fba9e7660be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:42.349365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb67e9f-36ff-48ad-a075-fba9e7660be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:42.349960 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb67e9f-36ff-48ad-a075-fba9e7660be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:42.350909 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb67e9f-36ff-48ad-a075-fba9e7660be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:42.352736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb67e9f-36ff-48ad-a075-fba9e7660be2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:42.355319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-331ceffa-2e94-46d4-b03f-811aeb6e87f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c376e961d6c348799b3aaa6cbc3265a3', 'request_id': 'req-331ceffa-2e94-46d4-b03f-811aeb6e87f2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:42.371950 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-331ceffa-2e94-46d4-b03f-811aeb6e87f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c376e961d6c348799b3aaa6cbc3265a3', 'request_id': 'req-331ceffa-2e94-46d4-b03f-811aeb6e87f2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:42.372923 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1006/1995] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:06:42.378301 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb67e9f-36ff-48ad-a075-fba9e7660be2 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:42.402365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb67e9f-36ff-48ad-a075-fba9e7660be2 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:42.406166 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-331ceffa-2e94-46d4-b03f-811aeb6e87f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c376e961d6c348799b3aaa6cbc3265a3', 'request_id': 'req-331ceffa-2e94-46d4-b03f-811aeb6e87f2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:42.437327 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-331ceffa-2e94-46d4-b03f-811aeb6e87f2 admin admin] The token cache is being invalidate because project c376e961d6c348799b3aaa6cbc3265a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:42.437630 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-331ceffa-2e94-46d4-b03f-811aeb6e87f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:42.442658 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-331ceffa-2e94-46d4-b03f-811aeb6e87f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:42.446235 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 990/1996] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:41 2022] DELETE /identity/v3/projects/c376e961d6c348799b3aaa6cbc3265a3 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:42.457738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3769be7-bc3e-43b8-b408-be8d5a9b300a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:42.459167 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3769be7-bc3e-43b8-b408-be8d5a9b300a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:42.459708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3769be7-bc3e-43b8-b408-be8d5a9b300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:42.536035 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e3769be7-bc3e-43b8-b408-be8d5a9b300a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:42.538603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e3769be7-bc3e-43b8-b408-be8d5a9b300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:42.547696 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e9846-0dd6-465f-a37f-44fdd03a81e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:42.548884 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e9846-0dd6-465f-a37f-44fdd03a81e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:42.549358 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e9846-0dd6-465f-a37f-44fdd03a81e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:42.549780 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e9846-0dd6-465f-a37f-44fdd03a81e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:42.550955 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e9846-0dd6-465f-a37f-44fdd03a81e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:42.555149 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e9846-0dd6-465f-a37f-44fdd03a81e2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:42.563964 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 991/1997] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:42.575434 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f78040-5ba2-4152-b480-fec5cc69553a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:42.575748 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f78040-5ba2-4152-b480-fec5cc69553a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:42.576134 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f78040-5ba2-4152-b480-fec5cc69553a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:42.577436 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1007/1998] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:06:42.581808 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e9846-0dd6-465f-a37f-44fdd03a81e2 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:42.583852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f28e9846-0dd6-465f-a37f-44fdd03a81e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:42.605349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-33f78040-5ba2-4152-b480-fec5cc69553a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:42.607346 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-33f78040-5ba2-4152-b480-fec5cc69553a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:42.618382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 992/1999] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:42.622845 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f78040-5ba2-4152-b480-fec5cc69553a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:42.623856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e9846-0dd6-465f-a37f-44fdd03a81e2 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:42.631704 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c4212-bf1d-4b69-a264-113cb9d6f18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:42.633749 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c4212-bf1d-4b69-a264-113cb9d6f18b admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:42.634250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c4212-bf1d-4b69-a264-113cb9d6f18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:42.635184 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c4212-bf1d-4b69-a264-113cb9d6f18b admin admin] PATH_INFO: `/v3/projects/393543e8bbf240bfba97544cef518bfa/users/e467bb243de34fffb5f4aa3f7d27ac0f/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:42.635717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f78040-5ba2-4152-b480-fec5cc69553a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:42.643060 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6377e-a4b3-403f-bc90-cd8df2541d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:42.643994 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6377e-a4b3-403f-bc90-cd8df2541d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:42.644455 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6377e-a4b3-403f-bc90-cd8df2541d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:42.644924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6377e-a4b3-403f-bc90-cd8df2541d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:42.645656 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6377e-a4b3-403f-bc90-cd8df2541d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:42.646737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6377e-a4b3-403f-bc90-cd8df2541d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:42.649384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6377e-a4b3-403f-bc90-cd8df2541d06 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:42.666130 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c4212-bf1d-4b69-a264-113cb9d6f18b admin admin] RBAC: Authorizing `identity:create_grant(project_id=393543e8bbf240bfba97544cef518bfa, user_id=e467bb243de34fffb5f4aa3f7d27ac0f, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:42.671897 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c4212-bf1d-4b69-a264-113cb9d6f18b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:42.675370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 993/2000] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:42.682711 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6377e-a4b3-403f-bc90-cd8df2541d06 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:42.700477 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1008/2001] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:42 2022] PUT /identity/v3/projects/393543e8bbf240bfba97544cef518bfa/users/e467bb243de34fffb5f4aa3f7d27ac0f/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:42.713398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb631df-6088-4343-94d4-192e83813339 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:42.713786 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb631df-6088-4343-94d4-192e83813339 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:42.714376 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb631df-6088-4343-94d4-192e83813339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:42.716897 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6377e-a4b3-403f-bc90-cd8df2541d06 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:42.805457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2fb631df-6088-4343-94d4-192e83813339 None None] MFA Rules not processed for user `e467bb243de34fffb5f4aa3f7d27ac0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:42.807052 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2fb631df-6088-4343-94d4-192e83813339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:42.908241 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe5b35-0b10-4bc9-aa73-b2aa5e9e1734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:42.909577 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe5b35-0b10-4bc9-aa73-b2aa5e9e1734 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:42.909872 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe5b35-0b10-4bc9-aa73-b2aa5e9e1734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:42.910150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe5b35-0b10-4bc9-aa73-b2aa5e9e1734 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:42.910867 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe5b35-0b10-4bc9-aa73-b2aa5e9e1734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:42.913393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe5b35-0b10-4bc9-aa73-b2aa5e9e1734 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:42.954614 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 994/2002] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:42 2022] POST /identity/v3/projects => generated 375 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:42.955971 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fc096-c7ab-4404-8fb4-4ee59e27783c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:42.956259 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fc096-c7ab-4404-8fb4-4ee59e27783c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:42.956540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fc096-c7ab-4404-8fb4-4ee59e27783c None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:42.959023 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 995/2003] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 27 05:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:06:42.959754 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fc096-c7ab-4404-8fb4-4ee59e27783c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:42.970727 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1d0fc096-c7ab-4404-8fb4-4ee59e27783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:43.004146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1009/2004] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:43.006117 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb631df-6088-4343-94d4-192e83813339 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:43.007985 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2fb631df-6088-4343-94d4-192e83813339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:43.022702 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb631df-6088-4343-94d4-192e83813339 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:43.070503 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fc096-c7ab-4404-8fb4-4ee59e27783c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:43.076210 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c428c37-fef3-4c6d-b938-69ff18be5515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:43.077122 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c428c37-fef3-4c6d-b938-69ff18be5515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.078158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c428c37-fef3-4c6d-b938-69ff18be5515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.078158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c428c37-fef3-4c6d-b938-69ff18be5515 admin admin] PATH_INFO: `/v3/projects/ed6d82a99bd843ea8dffbc3fd7d3b1c8` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.078913 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c428c37-fef3-4c6d-b938-69ff18be5515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed6d82a99bd843ea8dffbc3fd7d3b1c8)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:43.081276 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c428c37-fef3-4c6d-b938-69ff18be5515 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:43.089279 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12a681-9162-459f-944c-d2754daa3a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:43.090206 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12a681-9162-459f-944c-d2754daa3a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.090491 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12a681-9162-459f-944c-d2754daa3a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.090765 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12a681-9162-459f-944c-d2754daa3a7a admin admin] PATH_INFO: `/v3/users/b81201945f914b52a7434c57cbe45923` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.092678 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12a681-9162-459f-944c-d2754daa3a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b81201945f914b52a7434c57cbe45923)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:43.094647 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12a681-9162-459f-944c-d2754daa3a7a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:43.142146 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4c428c37-fef3-4c6d-b938-69ff18be5515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed6d82a99bd843ea8dffbc3fd7d3b1c8', 'request_id': 'req-4c428c37-fef3-4c6d-b938-69ff18be5515'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:43.151033 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-da12a681-9162-459f-944c-d2754daa3a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b81201945f914b52a7434c57cbe45923'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:43.151752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4c428c37-fef3-4c6d-b938-69ff18be5515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed6d82a99bd843ea8dffbc3fd7d3b1c8', 'request_id': 'req-4c428c37-fef3-4c6d-b938-69ff18be5515'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:43.152299 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-da12a681-9162-459f-944c-d2754daa3a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b81201945f914b52a7434c57cbe45923'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:43.152953 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-da12a681-9162-459f-944c-d2754daa3a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b81201945f914b52a7434c57cbe45923'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:43.161193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4c428c37-fef3-4c6d-b938-69ff18be5515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed6d82a99bd843ea8dffbc3fd7d3b1c8', 'request_id': 'req-4c428c37-fef3-4c6d-b938-69ff18be5515'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:43.162901 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-da12a681-9162-459f-944c-d2754daa3a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b81201945f914b52a7434c57cbe45923'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:43.175663 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-da12a681-9162-459f-944c-d2754daa3a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b81201945f914b52a7434c57cbe45923'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:43.176538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4c428c37-fef3-4c6d-b938-69ff18be5515 admin admin] The token cache is being invalidate because project ed6d82a99bd843ea8dffbc3fd7d3b1c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:43.177602 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4c428c37-fef3-4c6d-b938-69ff18be5515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:43.178408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4c428c37-fef3-4c6d-b938-69ff18be5515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:43.180574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 996/2005] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:42 2022] DELETE /identity/v3/projects/ed6d82a99bd843ea8dffbc3fd7d3b1c8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:43.181724 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c428c37-fef3-4c6d-b938-69ff18be5515 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:43.183310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4c428c37-fef3-4c6d-b938-69ff18be5515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:43.188385 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1010/2006] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:43 2022] DELETE /identity/v3/users/b81201945f914b52a7434c57cbe45923 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:43.190569 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be0d0e-2b53-4ec8-b0f9-162ee315dd4f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.191650 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be0d0e-2b53-4ec8-b0f9-162ee315dd4f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.192085 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be0d0e-2b53-4ec8-b0f9-162ee315dd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.213134 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-23be0d0e-2b53-4ec8-b0f9-162ee315dd4f None None] MFA Rules not processed for user `faac84ed9d37420c811bbf6ac7df0b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:43.214579 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-23be0d0e-2b53-4ec8-b0f9-162ee315dd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:43.270131 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c428c37-fef3-4c6d-b938-69ff18be5515 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:43.296533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1011/2007] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 27 05:06:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:43.297484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be0d0e-2b53-4ec8-b0f9-162ee315dd4f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:43.299215 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-23be0d0e-2b53-4ec8-b0f9-162ee315dd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:43.346040 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b04d08-1ea9-4e51-8743-fba33b4dc2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:43.346807 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b04d08-1ea9-4e51-8743-fba33b4dc2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.347248 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b04d08-1ea9-4e51-8743-fba33b4dc2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.347597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b04d08-1ea9-4e51-8743-fba33b4dc2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.348319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b04d08-1ea9-4e51-8743-fba33b4dc2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:43.352413 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b04d08-1ea9-4e51-8743-fba33b4dc2c2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:43.375626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 997/2008] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:43 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:43.376574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be0d0e-2b53-4ec8-b0f9-162ee315dd4f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:43.377179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04604bb5-cb3d-4930-b81d-a592c505793a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.377538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04604bb5-cb3d-4930-b81d-a592c505793a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.378662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04604bb5-cb3d-4930-b81d-a592c505793a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.384433 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4a553-c634-4dc0-bb21-e2a7c32640b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:43.385692 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4a553-c634-4dc0-bb21-e2a7c32640b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.385978 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4a553-c634-4dc0-bb21-e2a7c32640b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.386259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4a553-c634-4dc0-bb21-e2a7c32640b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.386957 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4a553-c634-4dc0-bb21-e2a7c32640b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:43.388922 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4a553-c634-4dc0-bb21-e2a7c32640b1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:43.400176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-04604bb5-cb3d-4930-b81d-a592c505793a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:43.401689 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-04604bb5-cb3d-4930-b81d-a592c505793a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:43.410748 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 998/2009] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:43.412594 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb04261-a0ae-41ac-a267-5a5969542736 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.412921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb04261-a0ae-41ac-a267-5a5969542736 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.413237 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb04261-a0ae-41ac-a267-5a5969542736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.430644 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1012/2010] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:43 2022] POST /identity/v3/projects => generated 395 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:43.430644 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4a553-c634-4dc0-bb21-e2a7c32640b1 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:43.430644 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8ce4a553-c634-4dc0-bb21-e2a7c32640b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:43.438767 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3fb04261-a0ae-41ac-a267-5a5969542736 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:43.440065 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3fb04261-a0ae-41ac-a267-5a5969542736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:43.507169 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 999/2011] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:43.508074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb04261-a0ae-41ac-a267-5a5969542736 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:43.522180 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4a553-c634-4dc0-bb21-e2a7c32640b1 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:43.526877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb04261-a0ae-41ac-a267-5a5969542736 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:43.528434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40d8fa-9916-4373-9a83-d07e4ae41ca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:43.529134 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40d8fa-9916-4373-9a83-d07e4ae41ca1 service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.529459 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40d8fa-9916-4373-9a83-d07e4ae41ca1 service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.529708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40d8fa-9916-4373-9a83-d07e4ae41ca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.532701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78154387-e86c-4ecb-9c47-66877bae330b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:43.533389 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78154387-e86c-4ecb-9c47-66877bae330b admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.533669 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78154387-e86c-4ecb-9c47-66877bae330b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.533942 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78154387-e86c-4ecb-9c47-66877bae330b admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.534672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78154387-e86c-4ecb-9c47-66877bae330b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:43.536274 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78154387-e86c-4ecb-9c47-66877bae330b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:43.540525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40d8fa-9916-4373-9a83-d07e4ae41ca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:43.542205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40d8fa-9916-4373-9a83-d07e4ae41ca1 service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:43.554001 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1000/2012] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:43.554001 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ab90a-ccbf-4da3-8f29-eab38609249a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.554001 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ab90a-ccbf-4da3-8f29-eab38609249a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.554001 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ab90a-ccbf-4da3-8f29-eab38609249a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.554418 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1013/2013] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:43.554508 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40d8fa-9916-4373-9a83-d07e4ae41ca1 service nova] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:43.564899 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40d8fa-9916-4373-9a83-d07e4ae41ca1 service nova] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:43.570120 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a833e7-1e41-49cb-9e5f-f8b156518286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:43.570795 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a833e7-1e41-49cb-9e5f-f8b156518286 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.571077 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a833e7-1e41-49cb-9e5f-f8b156518286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.571355 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a833e7-1e41-49cb-9e5f-f8b156518286 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.572046 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a833e7-1e41-49cb-9e5f-f8b156518286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:43.574099 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a833e7-1e41-49cb-9e5f-f8b156518286 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:43.597112 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8a3ab90a-ccbf-4da3-8f29-eab38609249a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:43.598489 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8a3ab90a-ccbf-4da3-8f29-eab38609249a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:43.601570 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1014/2014] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:43 2022] POST /identity/v3/users => generated 304 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:43.602502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a833e7-1e41-49cb-9e5f-f8b156518286 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:43.606514 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-11a833e7-1e41-49cb-9e5f-f8b156518286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:43.612513 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1001/2015] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:43.613469 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ab90a-ccbf-4da3-8f29-eab38609249a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:43.641961 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ab90a-ccbf-4da3-8f29-eab38609249a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:43.652390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b85794-d2b7-43bf-9bbf-266fa103766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:43.653067 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b85794-d2b7-43bf-9bbf-266fa103766e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.653357 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b85794-d2b7-43bf-9bbf-266fa103766e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.653637 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b85794-d2b7-43bf-9bbf-266fa103766e admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.654386 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b85794-d2b7-43bf-9bbf-266fa103766e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:43.656013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b85794-d2b7-43bf-9bbf-266fa103766e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:43.686755 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1002/2016] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:43.687647 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b85794-d2b7-43bf-9bbf-266fa103766e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:43.700294 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a833e7-1e41-49cb-9e5f-f8b156518286 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:43.704228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb319cd-bb17-46b0-8e53-8f1633880112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:43.705306 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb319cd-bb17-46b0-8e53-8f1633880112 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.705592 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb319cd-bb17-46b0-8e53-8f1633880112 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.705865 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb319cd-bb17-46b0-8e53-8f1633880112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.710559 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b85794-d2b7-43bf-9bbf-266fa103766e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:43.719183 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb319cd-bb17-46b0-8e53-8f1633880112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:43.721827 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb319cd-bb17-46b0-8e53-8f1633880112 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:43.722321 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cf18a-0504-4737-a2d3-fb1b2cf965b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:43.723010 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cf18a-0504-4737-a2d3-fb1b2cf965b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.723292 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cf18a-0504-4737-a2d3-fb1b2cf965b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.723574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cf18a-0504-4737-a2d3-fb1b2cf965b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.728640 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cf18a-0504-4737-a2d3-fb1b2cf965b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:43.730940 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cf18a-0504-4737-a2d3-fb1b2cf965b9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:43.735058 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1015/2017] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:43.736558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb319cd-bb17-46b0-8e53-8f1633880112 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:43.747448 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb319cd-bb17-46b0-8e53-8f1633880112 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:43.752620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8824b-457b-4ff9-a83f-df1a06bdcf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:43.753636 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8824b-457b-4ff9-a83f-df1a06bdcf27 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.753976 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8824b-457b-4ff9-a83f-df1a06bdcf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.754082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1003/2018] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:43.754335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8824b-457b-4ff9-a83f-df1a06bdcf27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.755757 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8824b-457b-4ff9-a83f-df1a06bdcf27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:43.756751 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8824b-457b-4ff9-a83f-df1a06bdcf27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:43.758821 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8824b-457b-4ff9-a83f-df1a06bdcf27 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:43.761069 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cf18a-0504-4737-a2d3-fb1b2cf965b9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:43.792545 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cf18a-0504-4737-a2d3-fb1b2cf965b9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:43.804605 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1016/2019] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:43.804605 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8824b-457b-4ff9-a83f-df1a06bdcf27 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:43.805608 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a504c9d-c6d3-4300-9e2d-6a32b30fbac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:43.808112 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a504c9d-c6d3-4300-9e2d-6a32b30fbac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.808405 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a504c9d-c6d3-4300-9e2d-6a32b30fbac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.808687 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a504c9d-c6d3-4300-9e2d-6a32b30fbac4 admin admin] PATH_INFO: `/v3/projects/7591e7b98a754b4fb9e7f3e679d2bb17/users/b1f94a49f7fe4116be1f0ad329bcd324/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.829365 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a504c9d-c6d3-4300-9e2d-6a32b30fbac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7591e7b98a754b4fb9e7f3e679d2bb17, user_id=b1f94a49f7fe4116be1f0ad329bcd324, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:43.830613 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8824b-457b-4ff9-a83f-df1a06bdcf27 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:43.833432 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a504c9d-c6d3-4300-9e2d-6a32b30fbac4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:43.842712 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b01bc-3a9c-4fbf-9811-4a61df41eddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:43.843968 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b01bc-3a9c-4fbf-9811-4a61df41eddd admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.844313 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b01bc-3a9c-4fbf-9811-4a61df41eddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.844658 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b01bc-3a9c-4fbf-9811-4a61df41eddd admin admin] PATH_INFO: `/v3/projects/5ed9a80eea8645fab841e61b7ee86966/users/e7028a68704d4b4894b2501a8b3322d7/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.866022 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b01bc-3a9c-4fbf-9811-4a61df41eddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed9a80eea8645fab841e61b7ee86966, user_id=e7028a68704d4b4894b2501a8b3322d7, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:43.870398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b01bc-3a9c-4fbf-9811-4a61df41eddd admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:43.881653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1004/2020] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:43 2022] PUT /identity/v3/projects/7591e7b98a754b4fb9e7f3e679d2bb17/users/b1f94a49f7fe4116be1f0ad329bcd324/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:43.882295 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a504c9d-c6d3-4300-9e2d-6a32b30fbac4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:43.904774 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1017/2021] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:43 2022] PUT /identity/v3/projects/5ed9a80eea8645fab841e61b7ee86966/users/e7028a68704d4b4894b2501a8b3322d7/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:43.908316 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0054eb4-fca6-4e74-833d-7f59c7859a5f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:43.908730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0054eb4-fca6-4e74-833d-7f59c7859a5f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:43.909124 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0054eb4-fca6-4e74-833d-7f59c7859a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:43.963503 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d0054eb4-fca6-4e74-833d-7f59c7859a5f None None] MFA Rules not processed for user `b1f94a49f7fe4116be1f0ad329bcd324`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:43.966131 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d0054eb4-fca6-4e74-833d-7f59c7859a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:43.984894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a504c9d-c6d3-4300-9e2d-6a32b30fbac4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:44.067324 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5113ae-ff5e-48e5-bed7-0fcc18138dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:44.069470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5113ae-ff5e-48e5-bed7-0fcc18138dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:44.069759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5113ae-ff5e-48e5-bed7-0fcc18138dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:44.070043 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5113ae-ff5e-48e5-bed7-0fcc18138dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:44.070754 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5113ae-ff5e-48e5-bed7-0fcc18138dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:44.073259 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5113ae-ff5e-48e5-bed7-0fcc18138dd1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:44.110969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1005/2022] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:43 2022] POST /identity/v3/projects => generated 381 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:44.111841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5113ae-ff5e-48e5-bed7-0fcc18138dd1 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:44.148058 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1018/2023] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:44.148947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0054eb4-fca6-4e74-833d-7f59c7859a5f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:44.167869 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0054eb4-fca6-4e74-833d-7f59c7859a5f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:44.207883 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5113ae-ff5e-48e5-bed7-0fcc18138dd1 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:44.215240 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d9226-3fe4-4ca3-9816-bb3eebb24e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:44.215944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d9226-3fe4-4ca3-9816-bb3eebb24e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:44.216227 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d9226-3fe4-4ca3-9816-bb3eebb24e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:44.216501 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d9226-3fe4-4ca3-9816-bb3eebb24e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:44.217288 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d9226-3fe4-4ca3-9816-bb3eebb24e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:44.219418 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d9226-3fe4-4ca3-9816-bb3eebb24e90 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:44.248053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1006/2024] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:44.248053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d9226-3fe4-4ca3-9816-bb3eebb24e90 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:44.250271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e344bba-d1cb-4dc1-bb0b-a68ffe9bdcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:44.251703 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-372d9226-3fe4-4ca3-9816-bb3eebb24e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:44.252578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e344bba-d1cb-4dc1-bb0b-a68ffe9bdcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:44.253776 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e344bba-d1cb-4dc1-bb0b-a68ffe9bdcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:44.254328 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e344bba-d1cb-4dc1-bb0b-a68ffe9bdcb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:44.257065 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e344bba-d1cb-4dc1-bb0b-a68ffe9bdcb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:44.259867 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e344bba-d1cb-4dc1-bb0b-a68ffe9bdcb1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:44.333787 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1019/2025] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:44 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:44.333787 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e344bba-d1cb-4dc1-bb0b-a68ffe9bdcb1 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:44.350073 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e344bba-d1cb-4dc1-bb0b-a68ffe9bdcb1 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:44.355043 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b396e-a7a6-4a15-ad0d-163c79c217d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:44.356259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b396e-a7a6-4a15-ad0d-163c79c217d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:44.356615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b396e-a7a6-4a15-ad0d-163c79c217d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:44.356994 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b396e-a7a6-4a15-ad0d-163c79c217d8 admin admin] PATH_INFO: `/v3/projects/5ed9a80eea8645fab841e61b7ee86966/users/e7028a68704d4b4894b2501a8b3322d7/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:44.359180 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b396e-a7a6-4a15-ad0d-163c79c217d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed9a80eea8645fab841e61b7ee86966, user_id=e7028a68704d4b4894b2501a8b3322d7, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:44.362000 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b396e-a7a6-4a15-ad0d-163c79c217d8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:44.376110 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d9226-3fe4-4ca3-9816-bb3eebb24e90 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:44.379828 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1020/2026] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:44 2022] PUT /identity/v3/projects/5ed9a80eea8645fab841e61b7ee86966/users/e7028a68704d4b4894b2501a8b3322d7/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:44.390115 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b396e-a7a6-4a15-ad0d-163c79c217d8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:44.392983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0a2b396e-a7a6-4a15-ad0d-163c79c217d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:44.444510 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c15ec-6ec7-41e2-8405-676f88deb7fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:44.445219 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c15ec-6ec7-41e2-8405-676f88deb7fb service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:44.445991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c15ec-6ec7-41e2-8405-676f88deb7fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:44.446718 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c15ec-6ec7-41e2-8405-676f88deb7fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:44.485188 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b396e-a7a6-4a15-ad0d-163c79c217d8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:44.500689 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4b540-531b-411b-a2fb-937c67585cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:44.501902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4b540-531b-411b-a2fb-937c67585cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:44.502304 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4b540-531b-411b-a2fb-937c67585cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:44.502649 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4b540-531b-411b-a2fb-937c67585cb5 admin admin] PATH_INFO: `/v3/projects/0fa86341da844a09a9bb2e14f85de228` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:44.504289 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4b540-531b-411b-a2fb-937c67585cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa86341da844a09a9bb2e14f85de228)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:44.506919 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4b540-531b-411b-a2fb-937c67585cb5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:44.530337 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c15ec-6ec7-41e2-8405-676f88deb7fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:44.531849 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c15ec-6ec7-41e2-8405-676f88deb7fb service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:44.544527 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1007/2027] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:44.545432 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c15ec-6ec7-41e2-8405-676f88deb7fb service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:44.566117 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c15ec-6ec7-41e2-8405-676f88deb7fb service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:44.581413 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ceb4b540-531b-411b-a2fb-937c67585cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa86341da844a09a9bb2e14f85de228', 'request_id': 'req-ceb4b540-531b-411b-a2fb-937c67585cb5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:44.587817 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ceb4b540-531b-411b-a2fb-937c67585cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa86341da844a09a9bb2e14f85de228', 'request_id': 'req-ceb4b540-531b-411b-a2fb-937c67585cb5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:44.601119 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ceb4b540-531b-411b-a2fb-937c67585cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa86341da844a09a9bb2e14f85de228', 'request_id': 'req-ceb4b540-531b-411b-a2fb-937c67585cb5'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:44.619839 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ceb4b540-531b-411b-a2fb-937c67585cb5 admin admin] The token cache is being invalidate because project 0fa86341da844a09a9bb2e14f85de228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:44.620239 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ceb4b540-531b-411b-a2fb-937c67585cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:44.621782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ceb4b540-531b-411b-a2fb-937c67585cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:44.626113 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1021/2028] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:44 2022] DELETE /identity/v3/projects/0fa86341da844a09a9bb2e14f85de228 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:44.627340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7922eb-558e-4f78-aaa1-955d79a504ea None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:44.627627 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7922eb-558e-4f78-aaa1-955d79a504ea None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:44.627906 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7922eb-558e-4f78-aaa1-955d79a504ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:44.658213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9f223-5134-4b19-a595-a13807a5e2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:44.658213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9f223-5134-4b19-a595-a13807a5e2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:44.660692 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9f223-5134-4b19-a595-a13807a5e2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:44.661018 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9f223-5134-4b19-a595-a13807a5e2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:44.662136 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9f223-5134-4b19-a595-a13807a5e2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:44.664139 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1d7922eb-558e-4f78-aaa1-955d79a504ea None None] MFA Rules not processed for user `e7028a68704d4b4894b2501a8b3322d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:44.665516 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1d7922eb-558e-4f78-aaa1-955d79a504ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:44.667943 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9f223-5134-4b19-a595-a13807a5e2c7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:44.683424 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1008/2029] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:44.683424 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9f223-5134-4b19-a595-a13807a5e2c7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:44.688904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d0f9f223-5134-4b19-a595-a13807a5e2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:44.712008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9f223-5134-4b19-a595-a13807a5e2c7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:44.719372 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7f812-5225-47b6-b64c-09600be55dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:44.720705 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7f812-5225-47b6-b64c-09600be55dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:44.721360 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7f812-5225-47b6-b64c-09600be55dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:44.721760 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7f812-5225-47b6-b64c-09600be55dbb admin admin] PATH_INFO: `/v3/users/77f18cc1d797447795c4aea48d50aa76` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:44.723882 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7f812-5225-47b6-b64c-09600be55dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f18cc1d797447795c4aea48d50aa76)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:44.727967 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7f812-5225-47b6-b64c-09600be55dbb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:44.779256 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1022/2030] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:44.780239 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7922eb-558e-4f78-aaa1-955d79a504ea None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:44.781617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1d7922eb-558e-4f78-aaa1-955d79a504ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:44.804628 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2cc7f812-5225-47b6-b64c-09600be55dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f18cc1d797447795c4aea48d50aa76'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:44.805605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2cc7f812-5225-47b6-b64c-09600be55dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f18cc1d797447795c4aea48d50aa76'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:44.806701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2cc7f812-5225-47b6-b64c-09600be55dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f18cc1d797447795c4aea48d50aa76'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:44.810339 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7922eb-558e-4f78-aaa1-955d79a504ea None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:44.816603 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b914d-f2be-4d31-bc71-03a2165e35fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:44.818096 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b914d-f2be-4d31-bc71-03a2165e35fd admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:44.818571 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b914d-f2be-4d31-bc71-03a2165e35fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:44.819056 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b914d-f2be-4d31-bc71-03a2165e35fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:44.819667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2cc7f812-5225-47b6-b64c-09600be55dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f18cc1d797447795c4aea48d50aa76'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:44.819788 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b914d-f2be-4d31-bc71-03a2165e35fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:44.821452 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b914d-f2be-4d31-bc71-03a2165e35fd admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:44.837307 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2cc7f812-5225-47b6-b64c-09600be55dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f18cc1d797447795c4aea48d50aa76'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:44.843368 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1023/2031] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:44.844235 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b914d-f2be-4d31-bc71-03a2165e35fd admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:44.846132 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3c8b914d-f2be-4d31-bc71-03a2165e35fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:44.860840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1009/2032] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:44 2022] DELETE /identity/v3/users/77f18cc1d797447795c4aea48d50aa76 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:44.868331 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7f812-5225-47b6-b64c-09600be55dbb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:44.868331 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2cc7f812-5225-47b6-b64c-09600be55dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:44.973242 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7f812-5225-47b6-b64c-09600be55dbb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:44.985654 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea46e9-35b0-4795-b32a-1926f956b3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:44.986669 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b914d-f2be-4d31-bc71-03a2165e35fd admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:44.987822 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea46e9-35b0-4795-b32a-1926f956b3f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:44.988749 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea46e9-35b0-4795-b32a-1926f956b3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:44.989025 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea46e9-35b0-4795-b32a-1926f956b3f3 admin admin] PATH_INFO: `/v3/projects/6d78fba47813486681978e924a76200c/users/12ad86983a454c3dbbfc30bdd27a3fb0/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:45.016499 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea46e9-35b0-4795-b32a-1926f956b3f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d78fba47813486681978e924a76200c, user_id=12ad86983a454c3dbbfc30bdd27a3fb0, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:45.019556 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea46e9-35b0-4795-b32a-1926f956b3f3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:45.037605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1010/2033] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:44 2022] PUT /identity/v3/projects/6d78fba47813486681978e924a76200c/users/12ad86983a454c3dbbfc30bdd27a3fb0/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:45.053310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad97830-6ddf-4b14-830e-f8f915e9d925 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:45.053605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad97830-6ddf-4b14-830e-f8f915e9d925 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:45.053885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad97830-6ddf-4b14-830e-f8f915e9d925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:45.087016 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908eefdb-b5e2-4db9-b20a-46d5d22b7c44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:45.088142 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908eefdb-b5e2-4db9-b20a-46d5d22b7c44 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:45.088601 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908eefdb-b5e2-4db9-b20a-46d5d22b7c44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:45.089116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908eefdb-b5e2-4db9-b20a-46d5d22b7c44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:45.091167 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-908eefdb-b5e2-4db9-b20a-46d5d22b7c44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:45.096901 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4ad97830-6ddf-4b14-830e-f8f915e9d925 None None] MFA Rules not processed for user `12ad86983a454c3dbbfc30bdd27a3fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:45.098884 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4ad97830-6ddf-4b14-830e-f8f915e9d925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:45.176667 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908eefdb-b5e2-4db9-b20a-46d5d22b7c44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:45.178796 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908eefdb-b5e2-4db9-b20a-46d5d22b7c44 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:45.186898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1011/2034] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:45.189259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1024/2035] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:45.191219 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad97830-6ddf-4b14-830e-f8f915e9d925 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:45.276524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908eefdb-b5e2-4db9-b20a-46d5d22b7c44 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:45.284907 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad97830-6ddf-4b14-830e-f8f915e9d925 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:45.293697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edaee5-8ed4-4c9b-bf2e-e8b813a6c451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:45.294716 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908eefdb-b5e2-4db9-b20a-46d5d22b7c44 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:45.295398 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edaee5-8ed4-4c9b-bf2e-e8b813a6c451 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:45.296021 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edaee5-8ed4-4c9b-bf2e-e8b813a6c451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:45.296574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edaee5-8ed4-4c9b-bf2e-e8b813a6c451 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:45.297684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85edaee5-8ed4-4c9b-bf2e-e8b813a6c451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:45.300339 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85edaee5-8ed4-4c9b-bf2e-e8b813a6c451 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:45.348718 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1012/2036] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:45 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:06:45.350402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edaee5-8ed4-4c9b-bf2e-e8b813a6c451 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:45.355128 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-85edaee5-8ed4-4c9b-bf2e-e8b813a6c451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:45.367476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e536d0e-31ea-4ecc-acda-3f207f142dce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:45.368298 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e536d0e-31ea-4ecc-acda-3f207f142dce service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:45.368640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e536d0e-31ea-4ecc-acda-3f207f142dce service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:45.369056 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e536d0e-31ea-4ecc-acda-3f207f142dce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:45.370888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4e536d0e-31ea-4ecc-acda-3f207f142dce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:45.440204 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e536d0e-31ea-4ecc-acda-3f207f142dce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:45.441971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e536d0e-31ea-4ecc-acda-3f207f142dce service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:45.453013 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1025/2037] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:45.464413 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edaee5-8ed4-4c9b-bf2e-e8b813a6c451 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:45.466425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e536d0e-31ea-4ecc-acda-3f207f142dce service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:45.472695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e43f9-3b12-4189-9705-978a090de321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:45.474262 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e43f9-3b12-4189-9705-978a090de321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:45.474729 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e43f9-3b12-4189-9705-978a090de321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:45.475016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e43f9-3b12-4189-9705-978a090de321 admin admin] PATH_INFO: `/v3/projects/14e3716c7b944b8db3d6472c53114cf7` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:45.476607 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e43f9-3b12-4189-9705-978a090de321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14e3716c7b944b8db3d6472c53114cf7)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:45.478455 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e536d0e-31ea-4ecc-acda-3f207f142dce service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:45.479038 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e43f9-3b12-4189-9705-978a090de321 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:45.483416 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69333c-1aa7-4014-ab7a-1bb5fd775429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:45.484151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69333c-1aa7-4014-ab7a-1bb5fd775429 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:45.484500 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69333c-1aa7-4014-ab7a-1bb5fd775429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:45.485220 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69333c-1aa7-4014-ab7a-1bb5fd775429 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:45.485977 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69333c-1aa7-4014-ab7a-1bb5fd775429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:45.488271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69333c-1aa7-4014-ab7a-1bb5fd775429 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:45.512078 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1026/2038] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:45 2022] POST /identity/v3/users => generated 298 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:45.516931 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69333c-1aa7-4014-ab7a-1bb5fd775429 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:45.527952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69333c-1aa7-4014-ab7a-1bb5fd775429 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:45.539780 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-045e43f9-3b12-4189-9705-978a090de321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e3716c7b944b8db3d6472c53114cf7', 'request_id': 'req-045e43f9-3b12-4189-9705-978a090de321'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:45.550260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-045e43f9-3b12-4189-9705-978a090de321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e3716c7b944b8db3d6472c53114cf7', 'request_id': 'req-045e43f9-3b12-4189-9705-978a090de321'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:45.557291 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-045e43f9-3b12-4189-9705-978a090de321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e3716c7b944b8db3d6472c53114cf7', 'request_id': 'req-045e43f9-3b12-4189-9705-978a090de321'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:45.570522 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-045e43f9-3b12-4189-9705-978a090de321 admin admin] The token cache is being invalidate because project 14e3716c7b944b8db3d6472c53114cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:45.570812 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-045e43f9-3b12-4189-9705-978a090de321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:45.571603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-045e43f9-3b12-4189-9705-978a090de321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:45.573230 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1013/2039] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:45 2022] DELETE /identity/v3/projects/14e3716c7b944b8db3d6472c53114cf7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:45.578183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410584ae-ba12-42c8-8e8d-c9fbf46e06a6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:45.578546 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410584ae-ba12-42c8-8e8d-c9fbf46e06a6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:45.578892 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410584ae-ba12-42c8-8e8d-c9fbf46e06a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:45.593403 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af251e8-36ac-4918-904e-a802358ed9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:45.594082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af251e8-36ac-4918-904e-a802358ed9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:45.594361 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af251e8-36ac-4918-904e-a802358ed9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:45.594692 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af251e8-36ac-4918-904e-a802358ed9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:45.595534 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af251e8-36ac-4918-904e-a802358ed9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:45.597863 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af251e8-36ac-4918-904e-a802358ed9c9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:45.599303 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-410584ae-ba12-42c8-8e8d-c9fbf46e06a6 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:45.600526 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-410584ae-ba12-42c8-8e8d-c9fbf46e06a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:45.610426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1014/2040] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:45.618427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1027/2041] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:45.618805 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b8a70-dec9-49c1-ae74-e4c7fdce4044 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:45.619361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b8a70-dec9-49c1-ae74-e4c7fdce4044 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:45.619361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b8a70-dec9-49c1-ae74-e4c7fdce4044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:45.623237 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af251e8-36ac-4918-904e-a802358ed9c9 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:45.630694 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8af251e8-36ac-4918-904e-a802358ed9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:45.644865 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9b9b8a70-dec9-49c1-ae74-e4c7fdce4044 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:45.646428 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af251e8-36ac-4918-904e-a802358ed9c9 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:45.649069 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9b9b8a70-dec9-49c1-ae74-e4c7fdce4044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:45.653159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222219c-d120-4ea8-8d58-5fc02df45737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:45.654517 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222219c-d120-4ea8-8d58-5fc02df45737 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:45.654951 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222219c-d120-4ea8-8d58-5fc02df45737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:45.655460 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222219c-d120-4ea8-8d58-5fc02df45737 admin admin] PATH_INFO: `/v3/projects/12e0bd139d8945d9bed3e0be04541e53/users/10f46ac4ed7e4b2f8c065c9fb8cf0b5b/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:45.677004 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1015/2042] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:45.678322 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b8a70-dec9-49c1-ae74-e4c7fdce4044 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:45.679521 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222219c-d120-4ea8-8d58-5fc02df45737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e0bd139d8945d9bed3e0be04541e53, user_id=10f46ac4ed7e4b2f8c065c9fb8cf0b5b, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:45.683784 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222219c-d120-4ea8-8d58-5fc02df45737 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:45.710403 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1028/2043] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:45 2022] PUT /identity/v3/projects/12e0bd139d8945d9bed3e0be04541e53/users/10f46ac4ed7e4b2f8c065c9fb8cf0b5b/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:45.711389 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b8a70-dec9-49c1-ae74-e4c7fdce4044 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:45.711617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222219c-d120-4ea8-8d58-5fc02df45737 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:45.831281 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222219c-d120-4ea8-8d58-5fc02df45737 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:45.835673 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac550d-968f-46a1-93b1-556100c58a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:45.838989 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac550d-968f-46a1-93b1-556100c58a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:45.839587 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac550d-968f-46a1-93b1-556100c58a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:45.840214 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac550d-968f-46a1-93b1-556100c58a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:45.842051 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac550d-968f-46a1-93b1-556100c58a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:45.842371 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac550d-968f-46a1-93b1-556100c58a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:45.845929 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac550d-968f-46a1-93b1-556100c58a5a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:45.846503 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9070e2-c297-4b86-8333-002aa8ef905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:45.847200 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9070e2-c297-4b86-8333-002aa8ef905d admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:45.847477 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9070e2-c297-4b86-8333-002aa8ef905d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:45.847755 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9070e2-c297-4b86-8333-002aa8ef905d admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:45.849514 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9070e2-c297-4b86-8333-002aa8ef905d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:45.851535 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9070e2-c297-4b86-8333-002aa8ef905d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:45.872435 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1016/2044] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:45.874329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac550d-968f-46a1-93b1-556100c58a5a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:45.875903 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1029/2045] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:45.882665 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9070e2-c297-4b86-8333-002aa8ef905d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:45.897714 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac550d-968f-46a1-93b1-556100c58a5a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:45.899034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9070e2-c297-4b86-8333-002aa8ef905d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:45.905818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd7e93-0c37-4def-9406-c4dbbdbf0628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:45.907179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd7e93-0c37-4def-9406-c4dbbdbf0628 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:45.907846 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd7e93-0c37-4def-9406-c4dbbdbf0628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:45.908457 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd7e93-0c37-4def-9406-c4dbbdbf0628 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:45.909828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd7e93-0c37-4def-9406-c4dbbdbf0628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:45.913419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2bf1f-6af9-4407-b51f-58359222f16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:45.914591 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2bf1f-6af9-4407-b51f-58359222f16c admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:45.914861 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2bf1f-6af9-4407-b51f-58359222f16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:45.915215 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2bf1f-6af9-4407-b51f-58359222f16c admin admin] PATH_INFO: `/v3/projects/12e0bd139d8945d9bed3e0be04541e53/users/10f46ac4ed7e4b2f8c065c9fb8cf0b5b/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:45.916483 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd7e93-0c37-4def-9406-c4dbbdbf0628 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:45.935486 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2bf1f-6af9-4407-b51f-58359222f16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e0bd139d8945d9bed3e0be04541e53, user_id=10f46ac4ed7e4b2f8c065c9fb8cf0b5b, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:45.936720 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2bf1f-6af9-4407-b51f-58359222f16c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:45.960848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1030/2046] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:45 2022] PUT /identity/v3/projects/12e0bd139d8945d9bed3e0be04541e53/users/10f46ac4ed7e4b2f8c065c9fb8cf0b5b/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:45.976319 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e61730-3fcf-472c-997a-7addd5ba5f5c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:45.976612 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e61730-3fcf-472c-997a-7addd5ba5f5c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:45.976879 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e61730-3fcf-472c-997a-7addd5ba5f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:46.009075 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1017/2047] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:45 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:46.011295 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd7e93-0c37-4def-9406-c4dbbdbf0628 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:46.081825 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b1e61730-3fcf-472c-997a-7addd5ba5f5c None None] MFA Rules not processed for user `10f46ac4ed7e4b2f8c065c9fb8cf0b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:46.083088 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b1e61730-3fcf-472c-997a-7addd5ba5f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:46.129078 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd7e93-0c37-4def-9406-c4dbbdbf0628 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:46.135384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4020e3e-a05c-48f1-b8a6-e2bd517d448f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:46.136341 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4020e3e-a05c-48f1-b8a6-e2bd517d448f admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:46.136804 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4020e3e-a05c-48f1-b8a6-e2bd517d448f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:46.137255 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4020e3e-a05c-48f1-b8a6-e2bd517d448f admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:46.137988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4020e3e-a05c-48f1-b8a6-e2bd517d448f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:46.141764 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4020e3e-a05c-48f1-b8a6-e2bd517d448f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:46.172397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1018/2048] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:46 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:46.177142 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4020e3e-a05c-48f1-b8a6-e2bd517d448f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:46.215366 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4020e3e-a05c-48f1-b8a6-e2bd517d448f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:46.229347 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470915c7-5990-4bcc-a4fc-c8cc65a98836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:46.230425 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470915c7-5990-4bcc-a4fc-c8cc65a98836 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:46.230726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470915c7-5990-4bcc-a4fc-c8cc65a98836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:46.232178 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470915c7-5990-4bcc-a4fc-c8cc65a98836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:46.234077 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470915c7-5990-4bcc-a4fc-c8cc65a98836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:46.237263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470915c7-5990-4bcc-a4fc-c8cc65a98836 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:46.266017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1019/2049] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:46.268823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470915c7-5990-4bcc-a4fc-c8cc65a98836 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:46.291080 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1031/2050] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:46.294960 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470915c7-5990-4bcc-a4fc-c8cc65a98836 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:46.305025 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e61730-3fcf-472c-997a-7addd5ba5f5c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:46.307922 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95fe54-a274-447b-86c7-0200ca3f209c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:46.308072 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b1e61730-3fcf-472c-997a-7addd5ba5f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:46.309573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95fe54-a274-447b-86c7-0200ca3f209c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:46.310723 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95fe54-a274-447b-86c7-0200ca3f209c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:46.311014 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95fe54-a274-447b-86c7-0200ca3f209c admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:46.312385 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95fe54-a274-447b-86c7-0200ca3f209c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:46.315553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95fe54-a274-447b-86c7-0200ca3f209c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:46.334924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1020/2051] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:46.338728 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95fe54-a274-447b-86c7-0200ca3f209c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:46.349527 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95fe54-a274-447b-86c7-0200ca3f209c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:46.355328 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403fab9-334a-4901-83ba-8fea4e86d84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:46.356382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403fab9-334a-4901-83ba-8fea4e86d84f admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:46.356526 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403fab9-334a-4901-83ba-8fea4e86d84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:46.356881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403fab9-334a-4901-83ba-8fea4e86d84f admin admin] PATH_INFO: `/v3/projects/b03572fbe6804bb3bf7929e5655a5c5e/users/93dc222e96e44ca88d51b7fe553f3307/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:46.376749 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403fab9-334a-4901-83ba-8fea4e86d84f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b03572fbe6804bb3bf7929e5655a5c5e, user_id=93dc222e96e44ca88d51b7fe553f3307, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:46.381914 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403fab9-334a-4901-83ba-8fea4e86d84f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:46.403526 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1021/2052] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:46 2022] PUT /identity/v3/projects/b03572fbe6804bb3bf7929e5655a5c5e/users/93dc222e96e44ca88d51b7fe553f3307/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:46.415840 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e61730-3fcf-472c-997a-7addd5ba5f5c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:46.424355 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1c2e5-9e4c-4d53-b1b7-66e05094fc9a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:46.425341 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1c2e5-9e4c-4d53-b1b7-66e05094fc9a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:46.425494 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1c2e5-9e4c-4d53-b1b7-66e05094fc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:46.464971 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-cdf1c2e5-9e4c-4d53-b1b7-66e05094fc9a None None] MFA Rules not processed for user `93dc222e96e44ca88d51b7fe553f3307`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:46.466528 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cdf1c2e5-9e4c-4d53-b1b7-66e05094fc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:46.509889 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545458f6-893e-45ae-a856-7c4e0f008d62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:46.510744 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545458f6-893e-45ae-a856-7c4e0f008d62 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:46.511037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545458f6-893e-45ae-a856-7c4e0f008d62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:46.511404 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545458f6-893e-45ae-a856-7c4e0f008d62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:46.568636 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1022/2053] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:46.574220 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1c2e5-9e4c-4d53-b1b7-66e05094fc9a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:46.609917 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545458f6-893e-45ae-a856-7c4e0f008d62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:46.611093 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545458f6-893e-45ae-a856-7c4e0f008d62 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:46.632428 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1032/2054] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:46.702785 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1c2e5-9e4c-4d53-b1b7-66e05094fc9a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:46.711532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e262ef-b1d2-4ac5-aa6d-2b4bb0cd3f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:46.712429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e262ef-b1d2-4ac5-aa6d-2b4bb0cd3f43 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:46.713785 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e262ef-b1d2-4ac5-aa6d-2b4bb0cd3f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:46.714377 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e262ef-b1d2-4ac5-aa6d-2b4bb0cd3f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:46.715467 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e262ef-b1d2-4ac5-aa6d-2b4bb0cd3f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:46.717896 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e262ef-b1d2-4ac5-aa6d-2b4bb0cd3f43 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:46.743425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545458f6-893e-45ae-a856-7c4e0f008d62 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:46.754552 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545458f6-893e-45ae-a856-7c4e0f008d62 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:46.760357 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c312540-8170-47bc-b755-21f484675704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:46.761829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c312540-8170-47bc-b755-21f484675704 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:46.762409 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c312540-8170-47bc-b755-21f484675704 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:46.762886 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c312540-8170-47bc-b755-21f484675704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:46.765626 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1c312540-8170-47bc-b755-21f484675704 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:46.781198 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1023/2055] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:46 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:06:46.782364 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e262ef-b1d2-4ac5-aa6d-2b4bb0cd3f43 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:46.847695 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c312540-8170-47bc-b755-21f484675704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:46.849533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c312540-8170-47bc-b755-21f484675704 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:46.858263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e262ef-b1d2-4ac5-aa6d-2b4bb0cd3f43 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:46.858660 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1033/2056] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:06:46.864695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f334-f895-48c2-b948-058d2f59e71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:46.865494 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f334-f895-48c2-b948-058d2f59e71a admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:46.865694 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f334-f895-48c2-b948-058d2f59e71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:46.865971 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366f334-f895-48c2-b948-058d2f59e71a admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:46.866667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366f334-f895-48c2-b948-058d2f59e71a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:46.868596 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366f334-f895-48c2-b948-058d2f59e71a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:46.895423 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1024/2057] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:46 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:06:46.897974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c312540-8170-47bc-b755-21f484675704 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:46.910464 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c312540-8170-47bc-b755-21f484675704 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:46.919251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be9d9c-42b1-4a8b-9f51-f17f6407dc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:46.920287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be9d9c-42b1-4a8b-9f51-f17f6407dc12 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:46.920577 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be9d9c-42b1-4a8b-9f51-f17f6407dc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:46.920864 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be9d9c-42b1-4a8b-9f51-f17f6407dc12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:46.921598 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be9d9c-42b1-4a8b-9f51-f17f6407dc12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:46.923220 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be9d9c-42b1-4a8b-9f51-f17f6407dc12 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:46.940824 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1034/2058] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:46.943753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f334-f895-48c2-b948-058d2f59e71a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:46.959301 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366f334-f895-48c2-b948-058d2f59e71a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:46.964425 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb035036-98c0-4e23-84ef-530c75374ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:46.965526 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb035036-98c0-4e23-84ef-530c75374ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:46.965835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb035036-98c0-4e23-84ef-530c75374ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:46.966240 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb035036-98c0-4e23-84ef-530c75374ed9 admin admin] PATH_INFO: `/v3/projects/c7435f8eb47d4bc28a4f226d7c7f790a/users/bf564645c5804e5aad1a31e756113c19/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:46.988658 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb035036-98c0-4e23-84ef-530c75374ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7435f8eb47d4bc28a4f226d7c7f790a, user_id=bf564645c5804e5aad1a31e756113c19, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:46.992108 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb035036-98c0-4e23-84ef-530c75374ed9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:47.016842 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1025/2059] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:46 2022] PUT /identity/v3/projects/c7435f8eb47d4bc28a4f226d7c7f790a/users/bf564645c5804e5aad1a31e756113c19/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:47.020184 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be9d9c-42b1-4a8b-9f51-f17f6407dc12 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:47.044336 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be9d9c-42b1-4a8b-9f51-f17f6407dc12 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:47.123156 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504f832-5fea-47bb-876c-cfaae2ce7152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:47.123907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504f832-5fea-47bb-876c-cfaae2ce7152 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:47.124255 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504f832-5fea-47bb-876c-cfaae2ce7152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:47.124595 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504f832-5fea-47bb-876c-cfaae2ce7152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:47.125432 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504f832-5fea-47bb-876c-cfaae2ce7152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:47.127134 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504f832-5fea-47bb-876c-cfaae2ce7152 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:47.137907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1035/2060] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:47.142273 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb035036-98c0-4e23-84ef-530c75374ed9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:47.153478 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb035036-98c0-4e23-84ef-530c75374ed9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:47.158519 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7ac30-32e0-4520-90b3-508d0b83436d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:47.159408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7ac30-32e0-4520-90b3-508d0b83436d admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:47.159685 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7ac30-32e0-4520-90b3-508d0b83436d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:47.160000 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7ac30-32e0-4520-90b3-508d0b83436d admin admin] PATH_INFO: `/v3/projects/c7435f8eb47d4bc28a4f226d7c7f790a/users/bf564645c5804e5aad1a31e756113c19/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:47.162342 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7ac30-32e0-4520-90b3-508d0b83436d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7435f8eb47d4bc28a4f226d7c7f790a, user_id=bf564645c5804e5aad1a31e756113c19, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:47.165320 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7ac30-32e0-4520-90b3-508d0b83436d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:47.177717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1026/2061] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:47 2022] PUT /identity/v3/projects/c7435f8eb47d4bc28a4f226d7c7f790a/users/bf564645c5804e5aad1a31e756113c19/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:47.188732 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab995a-4c87-42c3-b8ff-97326cc7584b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:47.189147 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab995a-4c87-42c3-b8ff-97326cc7584b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:47.189438 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab995a-4c87-42c3-b8ff-97326cc7584b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:47.225081 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-30ab995a-4c87-42c3-b8ff-97326cc7584b None None] MFA Rules not processed for user `bf564645c5804e5aad1a31e756113c19`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:47.225081 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-30ab995a-4c87-42c3-b8ff-97326cc7584b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:47.310439 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1036/2062] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:47.335916 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7ac30-32e0-4520-90b3-508d0b83436d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:47.350648 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab995a-4c87-42c3-b8ff-97326cc7584b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:47.353555 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-30ab995a-4c87-42c3-b8ff-97326cc7584b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:47.418931 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7ac30-32e0-4520-90b3-508d0b83436d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:47.424701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774e7c9-5483-4169-8de9-040e8c45ea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:47.425796 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774e7c9-5483-4169-8de9-040e8c45ea6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:47.426458 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774e7c9-5483-4169-8de9-040e8c45ea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:47.426591 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774e7c9-5483-4169-8de9-040e8c45ea6b admin admin] PATH_INFO: `/v3/users/12ad86983a454c3dbbfc30bdd27a3fb0` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:47.428601 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774e7c9-5483-4169-8de9-040e8c45ea6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ad86983a454c3dbbfc30bdd27a3fb0)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:47.431128 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774e7c9-5483-4169-8de9-040e8c45ea6b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:47.461355 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab995a-4c87-42c3-b8ff-97326cc7584b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:47.466597 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3d83e-3ebe-44fd-b057-86600d7b5360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:47.467925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3d83e-3ebe-44fd-b057-86600d7b5360 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:47.468389 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3d83e-3ebe-44fd-b057-86600d7b5360 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:47.469059 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3d83e-3ebe-44fd-b057-86600d7b5360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:47.480448 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3d83e-3ebe-44fd-b057-86600d7b5360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:47.482154 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3d83e-3ebe-44fd-b057-86600d7b5360 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:47.496842 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7774e7c9-5483-4169-8de9-040e8c45ea6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ad86983a454c3dbbfc30bdd27a3fb0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:47.497813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7774e7c9-5483-4169-8de9-040e8c45ea6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ad86983a454c3dbbfc30bdd27a3fb0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:47.498573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7774e7c9-5483-4169-8de9-040e8c45ea6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ad86983a454c3dbbfc30bdd27a3fb0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:47.504924 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1037/2063] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:47.510155 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7774e7c9-5483-4169-8de9-040e8c45ea6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ad86983a454c3dbbfc30bdd27a3fb0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:47.530135 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7774e7c9-5483-4169-8de9-040e8c45ea6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ad86983a454c3dbbfc30bdd27a3fb0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:47.561336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1027/2064] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:47 2022] DELETE /identity/v3/users/12ad86983a454c3dbbfc30bdd27a3fb0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:47.564312 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfd0e3-aaa1-45de-a16d-e3526d2f2d3e None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:47.564654 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfd0e3-aaa1-45de-a16d-e3526d2f2d3e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:47.564988 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfd0e3-aaa1-45de-a16d-e3526d2f2d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:47.596729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-aecfd0e3-aaa1-45de-a16d-e3526d2f2d3e None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:47.599749 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-aecfd0e3-aaa1-45de-a16d-e3526d2f2d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:47.689972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1038/2065] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:47.698377 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774e7c9-5483-4169-8de9-040e8c45ea6b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:47.700000 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7774e7c9-5483-4169-8de9-040e8c45ea6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:47.777683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774e7c9-5483-4169-8de9-040e8c45ea6b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:47.792587 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d86c9-cd1d-4378-99e1-f89adef081c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:47.793688 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d86c9-cd1d-4378-99e1-f89adef081c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:47.793974 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d86c9-cd1d-4378-99e1-f89adef081c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:47.794249 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d86c9-cd1d-4378-99e1-f89adef081c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:47.805473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d86c9-cd1d-4378-99e1-f89adef081c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:47.807097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d86c9-cd1d-4378-99e1-f89adef081c7 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:47.818562 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1028/2066] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:48.037780 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfd0e3-aaa1-45de-a16d-e3526d2f2d3e None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:48.039307 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-aecfd0e3-aaa1-45de-a16d-e3526d2f2d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:48.051358 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfd0e3-aaa1-45de-a16d-e3526d2f2d3e None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:48.056413 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b3143-f3fb-4213-aebe-fb5d3a1bc71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:48.057401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b3143-f3fb-4213-aebe-fb5d3a1bc71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:48.057683 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b3143-f3fb-4213-aebe-fb5d3a1bc71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:48.058154 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b3143-f3fb-4213-aebe-fb5d3a1bc71e admin admin] PATH_INFO: `/v3/users/93dc222e96e44ca88d51b7fe553f3307` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:48.059761 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b3143-f3fb-4213-aebe-fb5d3a1bc71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=93dc222e96e44ca88d51b7fe553f3307)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:48.061869 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b3143-f3fb-4213-aebe-fb5d3a1bc71e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:48.149409 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7b2b3143-f3fb-4213-aebe-fb5d3a1bc71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93dc222e96e44ca88d51b7fe553f3307'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.150417 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7b2b3143-f3fb-4213-aebe-fb5d3a1bc71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93dc222e96e44ca88d51b7fe553f3307'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.150737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7b2b3143-f3fb-4213-aebe-fb5d3a1bc71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93dc222e96e44ca88d51b7fe553f3307'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.166549 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7b2b3143-f3fb-4213-aebe-fb5d3a1bc71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93dc222e96e44ca88d51b7fe553f3307'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.183607 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7b2b3143-f3fb-4213-aebe-fb5d3a1bc71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93dc222e96e44ca88d51b7fe553f3307'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.202296 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1039/2067] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:48 2022] DELETE /identity/v3/users/93dc222e96e44ca88d51b7fe553f3307 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:48.206928 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf32180-44e6-4b07-9ece-a2c4c2f733e2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:48.207276 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf32180-44e6-4b07-9ece-a2c4c2f733e2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:48.207582 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf32180-44e6-4b07-9ece-a2c4c2f733e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:48.228966 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4cf32180-44e6-4b07-9ece-a2c4c2f733e2 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:48.230279 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4cf32180-44e6-4b07-9ece-a2c4c2f733e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:48.297797 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1029/2068] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:48.308580 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b3143-f3fb-4213-aebe-fb5d3a1bc71e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:48.310038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7b2b3143-f3fb-4213-aebe-fb5d3a1bc71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:48.321081 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf32180-44e6-4b07-9ece-a2c4c2f733e2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:48.322825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4cf32180-44e6-4b07-9ece-a2c4c2f733e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:48.336731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf32180-44e6-4b07-9ece-a2c4c2f733e2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:48.342578 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519fa40-8190-427c-9561-5e6324629b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:48.343447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519fa40-8190-427c-9561-5e6324629b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:48.343781 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519fa40-8190-427c-9561-5e6324629b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:48.344068 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519fa40-8190-427c-9561-5e6324629b91 admin admin] PATH_INFO: `/v3/projects/6d78fba47813486681978e924a76200c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:48.345300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519fa40-8190-427c-9561-5e6324629b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d78fba47813486681978e924a76200c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:48.347232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519fa40-8190-427c-9561-5e6324629b91 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:48.377904 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b3143-f3fb-4213-aebe-fb5d3a1bc71e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:48.383096 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7cba0-a8b1-462c-9ed1-27d5fd6411b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:48.383736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7cba0-a8b1-462c-9ed1-27d5fd6411b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:48.384012 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7cba0-a8b1-462c-9ed1-27d5fd6411b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:48.384281 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7cba0-a8b1-462c-9ed1-27d5fd6411b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:48.393618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7cba0-a8b1-462c-9ed1-27d5fd6411b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:48.395049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7cba0-a8b1-462c-9ed1-27d5fd6411b5 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:48.397398 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e519fa40-8190-427c-9561-5e6324629b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d78fba47813486681978e924a76200c', 'request_id': 'req-e519fa40-8190-427c-9561-5e6324629b91'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.405898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e519fa40-8190-427c-9561-5e6324629b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d78fba47813486681978e924a76200c', 'request_id': 'req-e519fa40-8190-427c-9561-5e6324629b91'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.406881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1040/2069] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:48.413067 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e519fa40-8190-427c-9561-5e6324629b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d78fba47813486681978e924a76200c', 'request_id': 'req-e519fa40-8190-427c-9561-5e6324629b91'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.423643 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e519fa40-8190-427c-9561-5e6324629b91 admin admin] The token cache is being invalidate because project 6d78fba47813486681978e924a76200c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:48.423935 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e519fa40-8190-427c-9561-5e6324629b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.424602 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e519fa40-8190-427c-9561-5e6324629b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.426212 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1030/2070] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:48 2022] DELETE /identity/v3/projects/6d78fba47813486681978e924a76200c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:48.431249 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7cba0-a8b1-462c-9ed1-27d5fd6411b5 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:48.441192 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7cba0-a8b1-462c-9ed1-27d5fd6411b5 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:48.517612 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b41a3d-4116-4c70-a6fe-f0ac6f42be78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:48.518484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b41a3d-4116-4c70-a6fe-f0ac6f42be78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:48.518769 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b41a3d-4116-4c70-a6fe-f0ac6f42be78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:48.519154 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b41a3d-4116-4c70-a6fe-f0ac6f42be78 admin admin] PATH_INFO: `/v3/users/10f46ac4ed7e4b2f8c065c9fb8cf0b5b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:48.520371 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b41a3d-4116-4c70-a6fe-f0ac6f42be78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f46ac4ed7e4b2f8c065c9fb8cf0b5b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:48.523009 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b41a3d-4116-4c70-a6fe-f0ac6f42be78 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:48.589567 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e5b41a3d-4116-4c70-a6fe-f0ac6f42be78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f46ac4ed7e4b2f8c065c9fb8cf0b5b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.590109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e5b41a3d-4116-4c70-a6fe-f0ac6f42be78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f46ac4ed7e4b2f8c065c9fb8cf0b5b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.591726 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e5b41a3d-4116-4c70-a6fe-f0ac6f42be78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f46ac4ed7e4b2f8c065c9fb8cf0b5b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.606362 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e5b41a3d-4116-4c70-a6fe-f0ac6f42be78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f46ac4ed7e4b2f8c065c9fb8cf0b5b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.622001 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-e5b41a3d-4116-4c70-a6fe-f0ac6f42be78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f46ac4ed7e4b2f8c065c9fb8cf0b5b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.635355 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1041/2071] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:48 2022] DELETE /identity/v3/users/10f46ac4ed7e4b2f8c065c9fb8cf0b5b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:48.703756 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519fa40-8190-427c-9561-5e6324629b91 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:48.705343 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e519fa40-8190-427c-9561-5e6324629b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:48.720659 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519fa40-8190-427c-9561-5e6324629b91 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:48.801398 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45283c41-2207-4ecd-97ec-1e08f875cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:48.803254 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45283c41-2207-4ecd-97ec-1e08f875cab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:48.803830 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45283c41-2207-4ecd-97ec-1e08f875cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:48.804055 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45283c41-2207-4ecd-97ec-1e08f875cab6 admin admin] PATH_INFO: `/v3/projects/b03572fbe6804bb3bf7929e5655a5c5e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:48.806052 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45283c41-2207-4ecd-97ec-1e08f875cab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b03572fbe6804bb3bf7929e5655a5c5e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:48.808040 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45283c41-2207-4ecd-97ec-1e08f875cab6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:48.870220 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-45283c41-2207-4ecd-97ec-1e08f875cab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b03572fbe6804bb3bf7929e5655a5c5e', 'request_id': 'req-45283c41-2207-4ecd-97ec-1e08f875cab6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.880956 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-45283c41-2207-4ecd-97ec-1e08f875cab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b03572fbe6804bb3bf7929e5655a5c5e', 'request_id': 'req-45283c41-2207-4ecd-97ec-1e08f875cab6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.888362 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-45283c41-2207-4ecd-97ec-1e08f875cab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b03572fbe6804bb3bf7929e5655a5c5e', 'request_id': 'req-45283c41-2207-4ecd-97ec-1e08f875cab6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.899603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-45283c41-2207-4ecd-97ec-1e08f875cab6 admin admin] The token cache is being invalidate because project b03572fbe6804bb3bf7929e5655a5c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:48.899891 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-45283c41-2207-4ecd-97ec-1e08f875cab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.900550 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-45283c41-2207-4ecd-97ec-1e08f875cab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:48.902730 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1031/2072] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:48 2022] DELETE /identity/v3/projects/b03572fbe6804bb3bf7929e5655a5c5e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:48.906322 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b41a3d-4116-4c70-a6fe-f0ac6f42be78 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:48.907798 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e5b41a3d-4116-4c70-a6fe-f0ac6f42be78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:48.922094 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b41a3d-4116-4c70-a6fe-f0ac6f42be78 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:48.950387 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45283c41-2207-4ecd-97ec-1e08f875cab6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:48.951779 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-45283c41-2207-4ecd-97ec-1e08f875cab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:49.007781 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68468f-c2f6-42a9-b07b-55bbc707f792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:49.009435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68468f-c2f6-42a9-b07b-55bbc707f792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:49.009711 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68468f-c2f6-42a9-b07b-55bbc707f792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:49.010124 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68468f-c2f6-42a9-b07b-55bbc707f792 admin admin] PATH_INFO: `/v3/users/bf564645c5804e5aad1a31e756113c19` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:49.011288 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68468f-c2f6-42a9-b07b-55bbc707f792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf564645c5804e5aad1a31e756113c19)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:49.021326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68468f-c2f6-42a9-b07b-55bbc707f792 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:49.027869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45283c41-2207-4ecd-97ec-1e08f875cab6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:49.032549 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d112b4-7782-42fb-9023-066c380a7077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:49.033440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d112b4-7782-42fb-9023-066c380a7077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:49.033710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d112b4-7782-42fb-9023-066c380a7077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:49.033982 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d112b4-7782-42fb-9023-066c380a7077 admin admin] PATH_INFO: `/v3/projects/12e0bd139d8945d9bed3e0be04541e53` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:49.035170 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d112b4-7782-42fb-9023-066c380a7077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e0bd139d8945d9bed3e0be04541e53)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:49.037705 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d112b4-7782-42fb-9023-066c380a7077 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:49.069612 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7f68468f-c2f6-42a9-b07b-55bbc707f792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf564645c5804e5aad1a31e756113c19'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:49.070155 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7f68468f-c2f6-42a9-b07b-55bbc707f792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf564645c5804e5aad1a31e756113c19'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:49.070763 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7f68468f-c2f6-42a9-b07b-55bbc707f792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf564645c5804e5aad1a31e756113c19'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:49.078010 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7f68468f-c2f6-42a9-b07b-55bbc707f792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf564645c5804e5aad1a31e756113c19'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:49.084053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b3d112b4-7782-42fb-9023-066c380a7077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e0bd139d8945d9bed3e0be04541e53', 'request_id': 'req-b3d112b4-7782-42fb-9023-066c380a7077'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:49.089766 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7f68468f-c2f6-42a9-b07b-55bbc707f792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf564645c5804e5aad1a31e756113c19'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:49.091860 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b3d112b4-7782-42fb-9023-066c380a7077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e0bd139d8945d9bed3e0be04541e53', 'request_id': 'req-b3d112b4-7782-42fb-9023-066c380a7077'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:49.097909 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b3d112b4-7782-42fb-9023-066c380a7077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e0bd139d8945d9bed3e0be04541e53', 'request_id': 'req-b3d112b4-7782-42fb-9023-066c380a7077'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:49.102865 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1042/2073] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:48 2022] DELETE /identity/v3/users/bf564645c5804e5aad1a31e756113c19 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:49.110370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b3d112b4-7782-42fb-9023-066c380a7077 admin admin] The token cache is being invalidate because project 12e0bd139d8945d9bed3e0be04541e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:49.110656 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b3d112b4-7782-42fb-9023-066c380a7077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:49.111312 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b3d112b4-7782-42fb-9023-066c380a7077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:49.112871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1032/2074] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:48 2022] DELETE /identity/v3/projects/12e0bd139d8945d9bed3e0be04541e53 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:49.118160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4533256-5bb5-43d9-8c68-34246f583b44 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:49.118448 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4533256-5bb5-43d9-8c68-34246f583b44 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:49.118723 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4533256-5bb5-43d9-8c68-34246f583b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:49.150036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a4533256-5bb5-43d9-8c68-34246f583b44 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:49.151342 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a4533256-5bb5-43d9-8c68-34246f583b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:49.271509 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1043/2075] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:49.279555 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fe808-2c16-4f74-96dc-cba651bb7285 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:49.280085 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fe808-2c16-4f74-96dc-cba651bb7285 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:49.281610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fe808-2c16-4f74-96dc-cba651bb7285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:49.304137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2a8fe808-2c16-4f74-96dc-cba651bb7285 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:49.305098 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2a8fe808-2c16-4f74-96dc-cba651bb7285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:49.326020 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1033/2076] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:49.330071 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4533256-5bb5-43d9-8c68-34246f583b44 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:49.343807 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4533256-5bb5-43d9-8c68-34246f583b44 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:49.351223 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22279074-5ed3-43e4-a07b-bdc16a9e7437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:49.352037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22279074-5ed3-43e4-a07b-bdc16a9e7437 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:49.352419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22279074-5ed3-43e4-a07b-bdc16a9e7437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:49.352965 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22279074-5ed3-43e4-a07b-bdc16a9e7437 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:49.353704 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22279074-5ed3-43e4-a07b-bdc16a9e7437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:49.354110 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22279074-5ed3-43e4-a07b-bdc16a9e7437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:49.356885 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22279074-5ed3-43e4-a07b-bdc16a9e7437 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:49.371996 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1044/2077] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:49.376240 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fe808-2c16-4f74-96dc-cba651bb7285 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:49.387754 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fe808-2c16-4f74-96dc-cba651bb7285 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:49.394759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e24aa-b6d7-40d5-8c25-c3f2aae4e6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:49.396300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e24aa-b6d7-40d5-8c25-c3f2aae4e6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:49.397712 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e24aa-b6d7-40d5-8c25-c3f2aae4e6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:49.398214 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e24aa-b6d7-40d5-8c25-c3f2aae4e6a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:49.399347 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e24aa-b6d7-40d5-8c25-c3f2aae4e6a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:49.402601 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e24aa-b6d7-40d5-8c25-c3f2aae4e6a6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:49.434887 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1034/2078] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:49 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:49.438766 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22279074-5ed3-43e4-a07b-bdc16a9e7437 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:49.450505 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22279074-5ed3-43e4-a07b-bdc16a9e7437 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:49.556916 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c441f58-83cd-49a4-bf8f-57603b585d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:49.559337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c441f58-83cd-49a4-bf8f-57603b585d26 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:49.559768 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c441f58-83cd-49a4-bf8f-57603b585d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:49.560256 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c441f58-83cd-49a4-bf8f-57603b585d26 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:49.561079 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c441f58-83cd-49a4-bf8f-57603b585d26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:49.564571 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c441f58-83cd-49a4-bf8f-57603b585d26 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:49.594778 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1045/2079] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:49 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:49.599631 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e24aa-b6d7-40d5-8c25-c3f2aae4e6a6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:49.618061 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e24aa-b6d7-40d5-8c25-c3f2aae4e6a6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:49.625035 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149644e-ad9f-4dd3-b6cf-664a297187cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:49.626007 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149644e-ad9f-4dd3-b6cf-664a297187cd admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:49.626636 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149644e-ad9f-4dd3-b6cf-664a297187cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:49.627225 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149644e-ad9f-4dd3-b6cf-664a297187cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:49.629193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149644e-ad9f-4dd3-b6cf-664a297187cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:49.632619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149644e-ad9f-4dd3-b6cf-664a297187cd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:49.654410 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1035/2080] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:49.658050 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c441f58-83cd-49a4-bf8f-57603b585d26 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:49.676384 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c441f58-83cd-49a4-bf8f-57603b585d26 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:49.686182 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce74779-a956-4c16-85b5-1561abccef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:49.687659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce74779-a956-4c16-85b5-1561abccef19 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:49.688019 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce74779-a956-4c16-85b5-1561abccef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:49.688304 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce74779-a956-4c16-85b5-1561abccef19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:49.689157 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce74779-a956-4c16-85b5-1561abccef19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:49.691067 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce74779-a956-4c16-85b5-1561abccef19 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:49.704217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1046/2081] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:49.711091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149644e-ad9f-4dd3-b6cf-664a297187cd admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:49.722905 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149644e-ad9f-4dd3-b6cf-664a297187cd admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:49.731766 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff3297-2542-4428-8537-f013774412ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:49.733069 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff3297-2542-4428-8537-f013774412ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:49.733616 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff3297-2542-4428-8537-f013774412ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:49.733856 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff3297-2542-4428-8537-f013774412ed admin admin] PATH_INFO: `/v3/projects/92636337d1fc42088d2211ddd9011f9b/users/9bc476d9a39c440fa6f8db3a6b2e3711/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:49.753411 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff3297-2542-4428-8537-f013774412ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=92636337d1fc42088d2211ddd9011f9b, user_id=9bc476d9a39c440fa6f8db3a6b2e3711, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:49.756435 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff3297-2542-4428-8537-f013774412ed admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:49.793568 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1036/2082] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:49 2022] PUT /identity/v3/projects/92636337d1fc42088d2211ddd9011f9b/users/9bc476d9a39c440fa6f8db3a6b2e3711/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:49.807674 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58a186-49c6-42aa-97df-8374b3f07078 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:49.808002 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58a186-49c6-42aa-97df-8374b3f07078 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:49.808002 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58a186-49c6-42aa-97df-8374b3f07078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:49.848162 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-af58a186-49c6-42aa-97df-8374b3f07078 None None] MFA Rules not processed for user `9bc476d9a39c440fa6f8db3a6b2e3711`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:49.849872 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-af58a186-49c6-42aa-97df-8374b3f07078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:49.923145 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1047/2083] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:49.936083 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff3297-2542-4428-8537-f013774412ed admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:49.937871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ffff3297-2542-4428-8537-f013774412ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:50.008747 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff3297-2542-4428-8537-f013774412ed admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:50.013889 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5ad05-bddb-4d8d-84b4-80ebbd192b90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e04bf8c51c4d89bbb45e96223e7409', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:50.014544 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5ad05-bddb-4d8d-84b4-80ebbd192b90 service glance] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:50.014832 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5ad05-bddb-4d8d-84b4-80ebbd192b90 service glance] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:50.015112 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5ad05-bddb-4d8d-84b4-80ebbd192b90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:50.025780 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5ad05-bddb-4d8d-84b4-80ebbd192b90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:50.028390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5ad05-bddb-4d8d-84b4-80ebbd192b90 service glance] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:50.039535 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1037/2084] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:50.100365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58a186-49c6-42aa-97df-8374b3f07078 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:50.103823 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-af58a186-49c6-42aa-97df-8374b3f07078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:50.133220 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5ad05-bddb-4d8d-84b4-80ebbd192b90 service glance] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:50.136136 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-06a5ad05-bddb-4d8d-84b4-80ebbd192b90 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:50.206623 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58a186-49c6-42aa-97df-8374b3f07078 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:50.212235 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db482329-d798-471c-b581-0ea5ec7f9e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:50.213261 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db482329-d798-471c-b581-0ea5ec7f9e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:50.213616 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db482329-d798-471c-b581-0ea5ec7f9e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:50.213954 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db482329-d798-471c-b581-0ea5ec7f9e3b admin admin] PATH_INFO: `/v3/users/e467bb243de34fffb5f4aa3f7d27ac0f` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:50.215452 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db482329-d798-471c-b581-0ea5ec7f9e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e467bb243de34fffb5f4aa3f7d27ac0f)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:50.217533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db482329-d798-471c-b581-0ea5ec7f9e3b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:50.258626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5ad05-bddb-4d8d-84b4-80ebbd192b90 service glance] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:50.264437 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e68f12-75d3-48d4-b135-952ba6da302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:50.265409 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e68f12-75d3-48d4-b135-952ba6da302c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:50.266370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e68f12-75d3-48d4-b135-952ba6da302c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:50.266684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e68f12-75d3-48d4-b135-952ba6da302c admin admin] PATH_INFO: `/v3/projects/c7435f8eb47d4bc28a4f226d7c7f790a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:50.268512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e68f12-75d3-48d4-b135-952ba6da302c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7435f8eb47d4bc28a4f226d7c7f790a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:50.273403 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e68f12-75d3-48d4-b135-952ba6da302c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:50.295759 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-db482329-d798-471c-b581-0ea5ec7f9e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e467bb243de34fffb5f4aa3f7d27ac0f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:50.297495 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-db482329-d798-471c-b581-0ea5ec7f9e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e467bb243de34fffb5f4aa3f7d27ac0f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:50.298436 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-db482329-d798-471c-b581-0ea5ec7f9e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e467bb243de34fffb5f4aa3f7d27ac0f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:50.309903 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-db482329-d798-471c-b581-0ea5ec7f9e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e467bb243de34fffb5f4aa3f7d27ac0f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:50.326687 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-db482329-d798-471c-b581-0ea5ec7f9e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e467bb243de34fffb5f4aa3f7d27ac0f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:50.334860 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f2e68f12-75d3-48d4-b135-952ba6da302c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7435f8eb47d4bc28a4f226d7c7f790a', 'request_id': 'req-f2e68f12-75d3-48d4-b135-952ba6da302c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:50.343033 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f2e68f12-75d3-48d4-b135-952ba6da302c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7435f8eb47d4bc28a4f226d7c7f790a', 'request_id': 'req-f2e68f12-75d3-48d4-b135-952ba6da302c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:50.349458 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1048/2085] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:50 2022] DELETE /identity/v3/users/e467bb243de34fffb5f4aa3f7d27ac0f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:50.351861 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f2e68f12-75d3-48d4-b135-952ba6da302c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7435f8eb47d4bc28a4f226d7c7f790a', 'request_id': 'req-f2e68f12-75d3-48d4-b135-952ba6da302c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:50.354534 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f055f49-adcb-42a0-8412-e190ea06df3c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:50.354948 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f055f49-adcb-42a0-8412-e190ea06df3c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:50.355276 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f055f49-adcb-42a0-8412-e190ea06df3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:50.363416 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f2e68f12-75d3-48d4-b135-952ba6da302c admin admin] The token cache is being invalidate because project c7435f8eb47d4bc28a4f226d7c7f790a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:50.363818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f2e68f12-75d3-48d4-b135-952ba6da302c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:50.365438 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f2e68f12-75d3-48d4-b135-952ba6da302c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:50.367624 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1038/2086] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:50 2022] DELETE /identity/v3/projects/c7435f8eb47d4bc28a4f226d7c7f790a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:50.373718 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a895754-333f-400c-b469-e2287ebcef3a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:50.374012 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a895754-333f-400c-b469-e2287ebcef3a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:50.374284 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a895754-333f-400c-b469-e2287ebcef3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:50.377319 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4f055f49-adcb-42a0-8412-e190ea06df3c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:50.379154 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4f055f49-adcb-42a0-8412-e190ea06df3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:50.395245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2a895754-333f-400c-b469-e2287ebcef3a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:50.398038 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2a895754-333f-400c-b469-e2287ebcef3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:50.461478 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1049/2087] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:50.462645 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f055f49-adcb-42a0-8412-e190ea06df3c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:50.464122 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4f055f49-adcb-42a0-8412-e190ea06df3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:50.480907 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1039/2088] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:50.480907 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a895754-333f-400c-b469-e2287ebcef3a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:50.481226 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f055f49-adcb-42a0-8412-e190ea06df3c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:50.481319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2a895754-333f-400c-b469-e2287ebcef3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:50.482035 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80c2e2-58ec-469e-bcde-9e18f9de4e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:50.482903 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80c2e2-58ec-469e-bcde-9e18f9de4e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:50.483195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80c2e2-58ec-469e-bcde-9e18f9de4e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:50.483735 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80c2e2-58ec-469e-bcde-9e18f9de4e68 admin admin] PATH_INFO: `/v3/users/8d72f0a3fe72443e90c39de21e5d15a2` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:50.484674 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80c2e2-58ec-469e-bcde-9e18f9de4e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d72f0a3fe72443e90c39de21e5d15a2)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:50.487907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80c2e2-58ec-469e-bcde-9e18f9de4e68 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:50.542150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a895754-333f-400c-b469-e2287ebcef3a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:50.542346 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bd80c2e2-58ec-469e-bcde-9e18f9de4e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d72f0a3fe72443e90c39de21e5d15a2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:50.543021 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bd80c2e2-58ec-469e-bcde-9e18f9de4e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d72f0a3fe72443e90c39de21e5d15a2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:50.543739 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bd80c2e2-58ec-469e-bcde-9e18f9de4e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d72f0a3fe72443e90c39de21e5d15a2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:50.551895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb52c20-e3ee-4618-b2a1-c36ab126fa9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:50.553671 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb52c20-e3ee-4618-b2a1-c36ab126fa9b service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:50.554062 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb52c20-e3ee-4618-b2a1-c36ab126fa9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:50.554289 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb52c20-e3ee-4618-b2a1-c36ab126fa9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:50.556235 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-dbb52c20-e3ee-4618-b2a1-c36ab126fa9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:50.557688 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bd80c2e2-58ec-469e-bcde-9e18f9de4e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d72f0a3fe72443e90c39de21e5d15a2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:50.574869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb52c20-e3ee-4618-b2a1-c36ab126fa9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:50.576309 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bd80c2e2-58ec-469e-bcde-9e18f9de4e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d72f0a3fe72443e90c39de21e5d15a2'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:50.576423 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb52c20-e3ee-4618-b2a1-c36ab126fa9b service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:50.593011 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1050/2089] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:50 2022] DELETE /identity/v3/users/8d72f0a3fe72443e90c39de21e5d15a2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:50.594521 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f31bfe-91df-4bd4-89dc-247f37703829 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:50.595035 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f31bfe-91df-4bd4-89dc-247f37703829 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:50.595508 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f31bfe-91df-4bd4-89dc-247f37703829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:50.617801 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-46f31bfe-91df-4bd4-89dc-247f37703829 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:50.619577 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-46f31bfe-91df-4bd4-89dc-247f37703829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:50.620824 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1040/2090] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:50.626128 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504848e-8b0b-44d8-83a8-458da2af26f5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:50.626635 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504848e-8b0b-44d8-83a8-458da2af26f5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:50.631298 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504848e-8b0b-44d8-83a8-458da2af26f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:50.673128 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2504848e-8b0b-44d8-83a8-458da2af26f5 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:50.674350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2504848e-8b0b-44d8-83a8-458da2af26f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:50.691140 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1051/2091] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:50.698254 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f31bfe-91df-4bd4-89dc-247f37703829 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:50.708991 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f31bfe-91df-4bd4-89dc-247f37703829 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:50.719302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c21655-bb95-49f0-8806-e7c839bfbab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:50.720191 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c21655-bb95-49f0-8806-e7c839bfbab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:50.720486 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c21655-bb95-49f0-8806-e7c839bfbab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:50.720772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c21655-bb95-49f0-8806-e7c839bfbab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:50.721608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c21655-bb95-49f0-8806-e7c839bfbab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:50.721950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c21655-bb95-49f0-8806-e7c839bfbab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:50.723570 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c21655-bb95-49f0-8806-e7c839bfbab1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:50.750970 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1052/2092] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:50.756461 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c21655-bb95-49f0-8806-e7c839bfbab1 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:50.762750 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1041/2093] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:50.773312 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504848e-8b0b-44d8-83a8-458da2af26f5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:50.774262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c21655-bb95-49f0-8806-e7c839bfbab1 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:50.775161 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2504848e-8b0b-44d8-83a8-458da2af26f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:50.779534 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d4064-87a5-44c4-b8b4-5fd745b8a693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:50.780195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d4064-87a5-44c4-b8b4-5fd745b8a693 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:50.780476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d4064-87a5-44c4-b8b4-5fd745b8a693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:50.780751 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d4064-87a5-44c4-b8b4-5fd745b8a693 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:50.781480 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d4064-87a5-44c4-b8b4-5fd745b8a693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:50.783562 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d4064-87a5-44c4-b8b4-5fd745b8a693 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:50.820382 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1053/2094] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:50 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:50.822296 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d4064-87a5-44c4-b8b4-5fd745b8a693 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:50.863147 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504848e-8b0b-44d8-83a8-458da2af26f5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:50.912115 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d4064-87a5-44c4-b8b4-5fd745b8a693 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:50.918670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf1f0e-daf7-40ec-a9a4-0bc40cb51403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:50.919519 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf1f0e-daf7-40ec-a9a4-0bc40cb51403 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:50.919803 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf1f0e-daf7-40ec-a9a4-0bc40cb51403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:50.920082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf1f0e-daf7-40ec-a9a4-0bc40cb51403 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:50.921644 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf1f0e-daf7-40ec-a9a4-0bc40cb51403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:50.924057 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf1f0e-daf7-40ec-a9a4-0bc40cb51403 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:50.942852 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13854f3f-3ffb-4163-9584-33f6a933c403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:50.944232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13854f3f-3ffb-4163-9584-33f6a933c403 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:50.944750 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13854f3f-3ffb-4163-9584-33f6a933c403 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:50.945165 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13854f3f-3ffb-4163-9584-33f6a933c403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:50.952505 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1054/2095] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:50 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:50.956730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf1f0e-daf7-40ec-a9a4-0bc40cb51403 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:50.956890 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13854f3f-3ffb-4163-9584-33f6a933c403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:50.959329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13854f3f-3ffb-4163-9584-33f6a933c403 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:50.969097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf1f0e-daf7-40ec-a9a4-0bc40cb51403 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:50.972239 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1042/2096] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:06:50.975053 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3994d1-8ca4-4ab0-92ff-6e92e8c10a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:50.975874 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3994d1-8ca4-4ab0-92ff-6e92e8c10a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:50.976152 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3994d1-8ca4-4ab0-92ff-6e92e8c10a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:50.976527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3994d1-8ca4-4ab0-92ff-6e92e8c10a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:50.977376 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3994d1-8ca4-4ab0-92ff-6e92e8c10a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:50.979067 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3994d1-8ca4-4ab0-92ff-6e92e8c10a7f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:50.990317 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1055/2097] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:06:50.994587 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13854f3f-3ffb-4163-9584-33f6a933c403 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:51.005649 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13854f3f-3ffb-4163-9584-33f6a933c403 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:51.011009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576289dc-a4d3-433b-8a4a-8c4ca9718eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:51.012074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576289dc-a4d3-433b-8a4a-8c4ca9718eac admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:51.012358 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576289dc-a4d3-433b-8a4a-8c4ca9718eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:51.012635 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576289dc-a4d3-433b-8a4a-8c4ca9718eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:51.013410 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576289dc-a4d3-433b-8a4a-8c4ca9718eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:51.015008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576289dc-a4d3-433b-8a4a-8c4ca9718eac admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:51.027148 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1043/2098] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:51.032366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3994d1-8ca4-4ab0-92ff-6e92e8c10a7f admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:51.043831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3994d1-8ca4-4ab0-92ff-6e92e8c10a7f admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:51.049439 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eebdc7-b74d-449d-a7bb-07caaea64885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:51.050554 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eebdc7-b74d-449d-a7bb-07caaea64885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:51.050881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eebdc7-b74d-449d-a7bb-07caaea64885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:51.051188 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eebdc7-b74d-449d-a7bb-07caaea64885 admin admin] PATH_INFO: `/v3/projects/1b540d8cad814eb59c99ee3993553fc1/users/4b23075a6f214cbc83667b44bb1b9c2d/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:51.069810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eebdc7-b74d-449d-a7bb-07caaea64885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b540d8cad814eb59c99ee3993553fc1, user_id=4b23075a6f214cbc83667b44bb1b9c2d, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:51.075031 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eebdc7-b74d-449d-a7bb-07caaea64885 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:51.075402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576289dc-a4d3-433b-8a4a-8c4ca9718eac admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:51.077224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-576289dc-a4d3-433b-8a4a-8c4ca9718eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:51.095953 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1056/2099] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:51 2022] PUT /identity/v3/projects/1b540d8cad814eb59c99ee3993553fc1/users/4b23075a6f214cbc83667b44bb1b9c2d/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:51.103628 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576289dc-a4d3-433b-8a4a-8c4ca9718eac admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:51.108858 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdef772-85aa-4b09-8f87-dc3f715f64c0 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:51.109333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdef772-85aa-4b09-8f87-dc3f715f64c0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:51.109333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdef772-85aa-4b09-8f87-dc3f715f64c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:51.154808 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-bfdef772-85aa-4b09-8f87-dc3f715f64c0 None None] MFA Rules not processed for user `4b23075a6f214cbc83667b44bb1b9c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:51.156133 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-bfdef772-85aa-4b09-8f87-dc3f715f64c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:51.184986 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e983f4-2d49-4843-b319-b1c1e004198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:51.186108 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e983f4-2d49-4843-b319-b1c1e004198a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:51.186387 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e983f4-2d49-4843-b319-b1c1e004198a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:51.186678 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e983f4-2d49-4843-b319-b1c1e004198a admin admin] PATH_INFO: `/v3/projects/393543e8bbf240bfba97544cef518bfa` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:51.187873 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e983f4-2d49-4843-b319-b1c1e004198a admin admin] RBAC: Authorizing `identity:delete_project(project_id=393543e8bbf240bfba97544cef518bfa)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:51.189845 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e983f4-2d49-4843-b319-b1c1e004198a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:51.236883 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1057/2100] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:51.241881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdef772-85aa-4b09-8f87-dc3f715f64c0 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:51.252907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdef772-85aa-4b09-8f87-dc3f715f64c0 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:51.258124 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-08e983f4-2d49-4843-b319-b1c1e004198a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393543e8bbf240bfba97544cef518bfa', 'request_id': 'req-08e983f4-2d49-4843-b319-b1c1e004198a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.278575 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-08e983f4-2d49-4843-b319-b1c1e004198a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393543e8bbf240bfba97544cef518bfa', 'request_id': 'req-08e983f4-2d49-4843-b319-b1c1e004198a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.288515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-08e983f4-2d49-4843-b319-b1c1e004198a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393543e8bbf240bfba97544cef518bfa', 'request_id': 'req-08e983f4-2d49-4843-b319-b1c1e004198a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.307821 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-08e983f4-2d49-4843-b319-b1c1e004198a admin admin] The token cache is being invalidate because project 393543e8bbf240bfba97544cef518bfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:51.308155 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-08e983f4-2d49-4843-b319-b1c1e004198a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.309276 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-08e983f4-2d49-4843-b319-b1c1e004198a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.312845 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1044/2101] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:51 2022] DELETE /identity/v3/projects/393543e8bbf240bfba97544cef518bfa => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:51.312845 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e983f4-2d49-4843-b319-b1c1e004198a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:51.313989 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-08e983f4-2d49-4843-b319-b1c1e004198a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:51.334675 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1444a0-6245-40ee-b9ea-2fb71b0672ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:51.335927 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1444a0-6245-40ee-b9ea-2fb71b0672ca admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:51.336210 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1444a0-6245-40ee-b9ea-2fb71b0672ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:51.336545 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1444a0-6245-40ee-b9ea-2fb71b0672ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:51.337349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1444a0-6245-40ee-b9ea-2fb71b0672ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:51.339592 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1444a0-6245-40ee-b9ea-2fb71b0672ca admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:51.375037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1058/2102] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:51 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:06:51.375728 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1444a0-6245-40ee-b9ea-2fb71b0672ca admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:51.377516 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0f1444a0-6245-40ee-b9ea-2fb71b0672ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:51.397901 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e983f4-2d49-4843-b319-b1c1e004198a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:51.441879 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1444a0-6245-40ee-b9ea-2fb71b0672ca admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:51.448114 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb6e9a-3b29-4262-9d30-8e57e28d6ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:51.449106 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb6e9a-3b29-4262-9d30-8e57e28d6ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:51.449454 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb6e9a-3b29-4262-9d30-8e57e28d6ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:51.449730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb6e9a-3b29-4262-9d30-8e57e28d6ff6 admin admin] PATH_INFO: `/v3/users/e7028a68704d4b4894b2501a8b3322d7` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:51.450930 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb6e9a-3b29-4262-9d30-8e57e28d6ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7028a68704d4b4894b2501a8b3322d7)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:51.452889 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb6e9a-3b29-4262-9d30-8e57e28d6ff6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:51.455458 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3e900-d52e-4638-8181-113241932fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:51.456366 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3e900-d52e-4638-8181-113241932fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:51.456645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3e900-d52e-4638-8181-113241932fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:51.456959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3e900-d52e-4638-8181-113241932fc0 admin admin] PATH_INFO: `/v3/projects/5dcfb0971c2a415e9a3a4b3be5d858bd` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:51.458755 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3e900-d52e-4638-8181-113241932fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dcfb0971c2a415e9a3a4b3be5d858bd)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:51.460664 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3e900-d52e-4638-8181-113241932fc0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:51.498448 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5bcb6e9a-3b29-4262-9d30-8e57e28d6ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7028a68704d4b4894b2501a8b3322d7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.499136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5bcb6e9a-3b29-4262-9d30-8e57e28d6ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7028a68704d4b4894b2501a8b3322d7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.499750 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5bcb6e9a-3b29-4262-9d30-8e57e28d6ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7028a68704d4b4894b2501a8b3322d7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.508061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5bcb6e9a-3b29-4262-9d30-8e57e28d6ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7028a68704d4b4894b2501a8b3322d7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.509232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9ec3e900-d52e-4638-8181-113241932fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dcfb0971c2a415e9a3a4b3be5d858bd', 'request_id': 'req-9ec3e900-d52e-4638-8181-113241932fc0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.516840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9ec3e900-d52e-4638-8181-113241932fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dcfb0971c2a415e9a3a4b3be5d858bd', 'request_id': 'req-9ec3e900-d52e-4638-8181-113241932fc0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.521062 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5bcb6e9a-3b29-4262-9d30-8e57e28d6ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7028a68704d4b4894b2501a8b3322d7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.522922 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9ec3e900-d52e-4638-8181-113241932fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dcfb0971c2a415e9a3a4b3be5d858bd', 'request_id': 'req-9ec3e900-d52e-4638-8181-113241932fc0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.532819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1059/2103] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:51 2022] DELETE /identity/v3/users/e7028a68704d4b4894b2501a8b3322d7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:51.535922 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9ec3e900-d52e-4638-8181-113241932fc0 admin admin] The token cache is being invalidate because project 5dcfb0971c2a415e9a3a4b3be5d858bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:51.535922 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9ec3e900-d52e-4638-8181-113241932fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.536103 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb6e9a-3b29-4262-9d30-8e57e28d6ff6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:51.536740 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9ec3e900-d52e-4638-8181-113241932fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.536865 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5bcb6e9a-3b29-4262-9d30-8e57e28d6ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:51.536959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1045/2104] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:51 2022] DELETE /identity/v3/projects/5dcfb0971c2a415e9a3a4b3be5d858bd => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:51.540034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3e900-d52e-4638-8181-113241932fc0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:51.541534 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9ec3e900-d52e-4638-8181-113241932fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:51.608364 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb6e9a-3b29-4262-9d30-8e57e28d6ff6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:51.612203 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3e900-d52e-4638-8181-113241932fc0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:51.614385 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211ec1d-bbb9-408a-bbcc-4c944609b97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:51.615713 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211ec1d-bbb9-408a-bbcc-4c944609b97c admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:51.615997 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211ec1d-bbb9-408a-bbcc-4c944609b97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:51.616397 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211ec1d-bbb9-408a-bbcc-4c944609b97c admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:51.617665 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211ec1d-bbb9-408a-bbcc-4c944609b97c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:51.618295 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718ddf4-3c17-483d-b64b-69534bc9dfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:51.619369 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211ec1d-bbb9-408a-bbcc-4c944609b97c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:51.619479 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718ddf4-3c17-483d-b64b-69534bc9dfd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:51.619555 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718ddf4-3c17-483d-b64b-69534bc9dfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:51.619972 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718ddf4-3c17-483d-b64b-69534bc9dfd3 admin admin] PATH_INFO: `/v3/users/d84f6a83bae24201b479373df6930eb9` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:51.621290 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718ddf4-3c17-483d-b64b-69534bc9dfd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84f6a83bae24201b479373df6930eb9)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:51.623341 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718ddf4-3c17-483d-b64b-69534bc9dfd3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:51.641192 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1060/2105] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:51 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:51.644289 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211ec1d-bbb9-408a-bbcc-4c944609b97c admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:51.646776 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1211ec1d-bbb9-408a-bbcc-4c944609b97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:51.658953 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211ec1d-bbb9-408a-bbcc-4c944609b97c admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:51.664689 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a836f-5b9e-4a3b-b7da-d874b29f58e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:51.665366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a836f-5b9e-4a3b-b7da-d874b29f58e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:51.665665 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a836f-5b9e-4a3b-b7da-d874b29f58e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:51.665937 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a836f-5b9e-4a3b-b7da-d874b29f58e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:51.666656 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a836f-5b9e-4a3b-b7da-d874b29f58e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:51.668251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a836f-5b9e-4a3b-b7da-d874b29f58e6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:51.680024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1061/2106] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:51.684232 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a836f-5b9e-4a3b-b7da-d874b29f58e6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:51.694934 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a836f-5b9e-4a3b-b7da-d874b29f58e6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:51.695641 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c718ddf4-3c17-483d-b64b-69534bc9dfd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84f6a83bae24201b479373df6930eb9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.696355 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c718ddf4-3c17-483d-b64b-69534bc9dfd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84f6a83bae24201b479373df6930eb9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.697079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c718ddf4-3c17-483d-b64b-69534bc9dfd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84f6a83bae24201b479373df6930eb9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.704137 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d281b9-2c28-4a32-aea4-62dc07611381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:51.706218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c718ddf4-3c17-483d-b64b-69534bc9dfd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84f6a83bae24201b479373df6930eb9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.707154 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d281b9-2c28-4a32-aea4-62dc07611381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:51.707444 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d281b9-2c28-4a32-aea4-62dc07611381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:51.707726 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d281b9-2c28-4a32-aea4-62dc07611381 admin admin] PATH_INFO: `/v3/projects/23c9e65fd5e84d5bb12983adb9b82542/users/129ecd28320d4e15a8d9985ceac5d012/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:51.731498 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c718ddf4-3c17-483d-b64b-69534bc9dfd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84f6a83bae24201b479373df6930eb9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:51.731853 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d281b9-2c28-4a32-aea4-62dc07611381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c9e65fd5e84d5bb12983adb9b82542, user_id=129ecd28320d4e15a8d9985ceac5d012, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:51.735691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1046/2107] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:51 2022] DELETE /identity/v3/users/d84f6a83bae24201b479373df6930eb9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:51.737015 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d281b9-2c28-4a32-aea4-62dc07611381 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:51.751273 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1062/2108] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:51 2022] PUT /identity/v3/projects/23c9e65fd5e84d5bb12983adb9b82542/users/129ecd28320d4e15a8d9985ceac5d012/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:51.755723 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718ddf4-3c17-483d-b64b-69534bc9dfd3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:51.757349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c718ddf4-3c17-483d-b64b-69534bc9dfd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:51.827925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718ddf4-3c17-483d-b64b-69534bc9dfd3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:51.893968 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e55db-8398-409e-a181-1f2d7af7f281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:51.894582 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e55db-8398-409e-a181-1f2d7af7f281 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:51.894864 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e55db-8398-409e-a181-1f2d7af7f281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:51.895144 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e55db-8398-409e-a181-1f2d7af7f281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:51.896015 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e55db-8398-409e-a181-1f2d7af7f281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:51.897931 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e55db-8398-409e-a181-1f2d7af7f281 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:51.911227 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1047/2109] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:51.912514 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d281b9-2c28-4a32-aea4-62dc07611381 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:51.923977 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d281b9-2c28-4a32-aea4-62dc07611381 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:51.930325 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ea390-310c-4b7b-90c4-c0ebfb0edc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:51.931214 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ea390-310c-4b7b-90c4-c0ebfb0edc05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:51.931492 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ea390-310c-4b7b-90c4-c0ebfb0edc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:51.931762 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ea390-310c-4b7b-90c4-c0ebfb0edc05 admin admin] PATH_INFO: `/v3/projects/23c9e65fd5e84d5bb12983adb9b82542/users/129ecd28320d4e15a8d9985ceac5d012/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:51.935609 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ea390-310c-4b7b-90c4-c0ebfb0edc05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c9e65fd5e84d5bb12983adb9b82542, user_id=129ecd28320d4e15a8d9985ceac5d012, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:51.937028 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ea390-310c-4b7b-90c4-c0ebfb0edc05 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:51.937294 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e55db-8398-409e-a181-1f2d7af7f281 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:51.939217 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-242e55db-8398-409e-a181-1f2d7af7f281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:51.949596 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1063/2110] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:51 2022] PUT /identity/v3/projects/23c9e65fd5e84d5bb12983adb9b82542/users/129ecd28320d4e15a8d9985ceac5d012/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:51.959150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e55db-8398-409e-a181-1f2d7af7f281 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:51.962735 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516adf35-b6e2-4af4-ae30-87fdca2d9ce5 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:51.962735 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516adf35-b6e2-4af4-ae30-87fdca2d9ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:51.963183 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516adf35-b6e2-4af4-ae30-87fdca2d9ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:52.004841 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-516adf35-b6e2-4af4-ae30-87fdca2d9ce5 None None] MFA Rules not processed for user `129ecd28320d4e15a8d9985ceac5d012`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:52.006374 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-516adf35-b6e2-4af4-ae30-87fdca2d9ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:52.075911 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402e0d0-2f8f-42e3-8e53-63c4425425cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:52.076897 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402e0d0-2f8f-42e3-8e53-63c4425425cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:52.077262 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402e0d0-2f8f-42e3-8e53-63c4425425cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:52.077607 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402e0d0-2f8f-42e3-8e53-63c4425425cb admin admin] PATH_INFO: `/v3/projects/5ed9a80eea8645fab841e61b7ee86966` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:52.085155 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402e0d0-2f8f-42e3-8e53-63c4425425cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed9a80eea8645fab841e61b7ee86966)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:52.087161 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402e0d0-2f8f-42e3-8e53-63c4425425cb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:52.105746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1064/2111] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:52.117024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516adf35-b6e2-4af4-ae30-87fdca2d9ce5 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:52.118586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-516adf35-b6e2-4af4-ae30-87fdca2d9ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:52.162544 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e402e0d0-2f8f-42e3-8e53-63c4425425cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed9a80eea8645fab841e61b7ee86966', 'request_id': 'req-e402e0d0-2f8f-42e3-8e53-63c4425425cb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:52.171195 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e402e0d0-2f8f-42e3-8e53-63c4425425cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed9a80eea8645fab841e61b7ee86966', 'request_id': 'req-e402e0d0-2f8f-42e3-8e53-63c4425425cb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:52.182465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e402e0d0-2f8f-42e3-8e53-63c4425425cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed9a80eea8645fab841e61b7ee86966', 'request_id': 'req-e402e0d0-2f8f-42e3-8e53-63c4425425cb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:52.204251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e402e0d0-2f8f-42e3-8e53-63c4425425cb admin admin] The token cache is being invalidate because project 5ed9a80eea8645fab841e61b7ee86966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:52.204397 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516adf35-b6e2-4af4-ae30-87fdca2d9ce5 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:52.204963 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e402e0d0-2f8f-42e3-8e53-63c4425425cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:52.206030 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e402e0d0-2f8f-42e3-8e53-63c4425425cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:52.208168 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1048/2112] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:51 2022] DELETE /identity/v3/projects/5ed9a80eea8645fab841e61b7ee86966 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:52.210994 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402e0d0-2f8f-42e3-8e53-63c4425425cb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:52.213935 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e402e0d0-2f8f-42e3-8e53-63c4425425cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:52.276289 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30079761-2270-43ee-a153-f1ea7192e9ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:52.276971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30079761-2270-43ee-a153-f1ea7192e9ea service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:52.277256 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30079761-2270-43ee-a153-f1ea7192e9ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:52.277537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30079761-2270-43ee-a153-f1ea7192e9ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:52.279332 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-30079761-2270-43ee-a153-f1ea7192e9ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:52.285781 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402e0d0-2f8f-42e3-8e53-63c4425425cb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:52.290900 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba4950-a783-4415-8893-38fdfee2b2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:52.291665 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba4950-a783-4415-8893-38fdfee2b2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:52.291947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba4950-a783-4415-8893-38fdfee2b2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:52.292305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba4950-a783-4415-8893-38fdfee2b2e1 admin admin] PATH_INFO: `/v3/projects/ee5eb12180dd471babfdf3cb0585b93b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:52.293473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba4950-a783-4415-8893-38fdfee2b2e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5eb12180dd471babfdf3cb0585b93b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:52.295385 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba4950-a783-4415-8893-38fdfee2b2e1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:52.338329 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30079761-2270-43ee-a153-f1ea7192e9ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:52.339877 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30079761-2270-43ee-a153-f1ea7192e9ea service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:52.340993 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-09ba4950-a783-4415-8893-38fdfee2b2e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5eb12180dd471babfdf3cb0585b93b', 'request_id': 'req-09ba4950-a783-4415-8893-38fdfee2b2e1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:52.348367 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-09ba4950-a783-4415-8893-38fdfee2b2e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5eb12180dd471babfdf3cb0585b93b', 'request_id': 'req-09ba4950-a783-4415-8893-38fdfee2b2e1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:52.348864 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1065/2113] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:52.350285 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78739d92-8915-466f-8c8a-1c2a8291709e None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:52.350568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78739d92-8915-466f-8c8a-1c2a8291709e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:52.350839 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78739d92-8915-466f-8c8a-1c2a8291709e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:52.359159 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-09ba4950-a783-4415-8893-38fdfee2b2e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5eb12180dd471babfdf3cb0585b93b', 'request_id': 'req-09ba4950-a783-4415-8893-38fdfee2b2e1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:52.369543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-78739d92-8915-466f-8c8a-1c2a8291709e None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:52.370881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-78739d92-8915-466f-8c8a-1c2a8291709e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:52.371138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-09ba4950-a783-4415-8893-38fdfee2b2e1 admin admin] The token cache is being invalidate because project ee5eb12180dd471babfdf3cb0585b93b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:52.371429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-09ba4950-a783-4415-8893-38fdfee2b2e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:52.373136 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-09ba4950-a783-4415-8893-38fdfee2b2e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:52.375061 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1049/2114] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:52 2022] DELETE /identity/v3/projects/ee5eb12180dd471babfdf3cb0585b93b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:52.379813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff30ef-bfbb-479b-bf24-27ffaebd0619 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:52.380172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff30ef-bfbb-479b-bf24-27ffaebd0619 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:52.380470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff30ef-bfbb-479b-bf24-27ffaebd0619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:52.401823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-cfff30ef-bfbb-479b-bf24-27ffaebd0619 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:52.402991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cfff30ef-bfbb-479b-bf24-27ffaebd0619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:52.452173 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1066/2115] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:52.454091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e09394-26e3-4e04-9cce-1cfcd4dd7761 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:52.454379 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e09394-26e3-4e04-9cce-1cfcd4dd7761 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:52.454655 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e09394-26e3-4e04-9cce-1cfcd4dd7761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:52.480688 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1050/2116] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:52.481218 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-95e09394-26e3-4e04-9cce-1cfcd4dd7761 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:52.482484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-95e09394-26e3-4e04-9cce-1cfcd4dd7761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:52.489701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81660c2-7e5c-46fe-9a2b-cabfdd378022 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:52.489701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81660c2-7e5c-46fe-9a2b-cabfdd378022 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:52.489992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81660c2-7e5c-46fe-9a2b-cabfdd378022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:52.491666 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1067/2117] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:52.495743 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e09394-26e3-4e04-9cce-1cfcd4dd7761 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:52.506470 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e09394-26e3-4e04-9cce-1cfcd4dd7761 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:52.512234 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcb6c6-a29f-462f-897e-9244c69b25a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:52.512922 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcb6c6-a29f-462f-897e-9244c69b25a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:52.513201 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcb6c6-a29f-462f-897e-9244c69b25a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:52.513469 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcb6c6-a29f-462f-897e-9244c69b25a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:52.514350 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcb6c6-a29f-462f-897e-9244c69b25a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:52.514652 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcb6c6-a29f-462f-897e-9244c69b25a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:52.516245 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcb6c6-a29f-462f-897e-9244c69b25a1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:52.526557 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f81660c2-7e5c-46fe-9a2b-cabfdd378022 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:52.528574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f81660c2-7e5c-46fe-9a2b-cabfdd378022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:52.530510 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1068/2118] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 05:06:52.534883 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcb6c6-a29f-462f-897e-9244c69b25a1 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:52.545979 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcb6c6-a29f-462f-897e-9244c69b25a1 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:52.549050 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1051/2119] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:52.550465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81660c2-7e5c-46fe-9a2b-cabfdd378022 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:52.551557 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708dcde-202b-4aed-8035-7070af12e56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:52.552736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708dcde-202b-4aed-8035-7070af12e56d admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:52.553150 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708dcde-202b-4aed-8035-7070af12e56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:52.553492 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708dcde-202b-4aed-8035-7070af12e56d admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:52.557337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708dcde-202b-4aed-8035-7070af12e56d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:52.559276 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708dcde-202b-4aed-8035-7070af12e56d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:52.566184 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81660c2-7e5c-46fe-9a2b-cabfdd378022 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:52.583828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b06b03-3a76-4918-be5d-0bedebdb2de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:52.584905 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b06b03-3a76-4918-be5d-0bedebdb2de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:52.585235 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b06b03-3a76-4918-be5d-0bedebdb2de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:52.585500 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b06b03-3a76-4918-be5d-0bedebdb2de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:52.586954 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b06b03-3a76-4918-be5d-0bedebdb2de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:52.588632 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b06b03-3a76-4918-be5d-0bedebdb2de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:52.591087 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b06b03-3a76-4918-be5d-0bedebdb2de1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:52.604529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1069/2120] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:52 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:06:52.606204 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1052/2121] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:52.606732 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708dcde-202b-4aed-8035-7070af12e56d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:52.610247 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b06b03-3a76-4918-be5d-0bedebdb2de1 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:52.631321 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b06b03-3a76-4918-be5d-0bedebdb2de1 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:52.730409 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708dcde-202b-4aed-8035-7070af12e56d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:52.730660 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3b651-24b3-445d-91eb-34c28bed73d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:52.731139 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3b651-24b3-445d-91eb-34c28bed73d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:52.731419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3b651-24b3-445d-91eb-34c28bed73d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:52.734201 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3b651-24b3-445d-91eb-34c28bed73d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:52.734925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3b651-24b3-445d-91eb-34c28bed73d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:52.736149 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6d472-7f0a-4087-a0f2-cc419db5f15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:52.736691 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6d472-7f0a-4087-a0f2-cc419db5f15c admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:52.737081 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6d472-7f0a-4087-a0f2-cc419db5f15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:52.737433 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6d472-7f0a-4087-a0f2-cc419db5f15c admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:52.738256 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6d472-7f0a-4087-a0f2-cc419db5f15c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:52.739112 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e3b651-24b3-445d-91eb-34c28bed73d0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:52.741705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6d472-7f0a-4087-a0f2-cc419db5f15c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:52.772979 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1070/2122] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:52 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:52.775763 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6d472-7f0a-4087-a0f2-cc419db5f15c admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:52.809697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6d472-7f0a-4087-a0f2-cc419db5f15c admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:52.816584 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1053/2123] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:52 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:52.819964 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3b651-24b3-445d-91eb-34c28bed73d0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:52.830376 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500abb1e-2320-42a5-a856-9624b108ba7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:52.831821 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500abb1e-2320-42a5-a856-9624b108ba7e admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:52.832127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500abb1e-2320-42a5-a856-9624b108ba7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:52.832404 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500abb1e-2320-42a5-a856-9624b108ba7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:52.834537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500abb1e-2320-42a5-a856-9624b108ba7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:52.836689 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500abb1e-2320-42a5-a856-9624b108ba7e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:52.850422 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1071/2124] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:52.856120 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500abb1e-2320-42a5-a856-9624b108ba7e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:52.889068 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500abb1e-2320-42a5-a856-9624b108ba7e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:52.946590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3b651-24b3-445d-91eb-34c28bed73d0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:52.961942 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeec9e-aaba-4903-962e-bf73ca032038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:52.965681 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeec9e-aaba-4903-962e-bf73ca032038 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:52.966177 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeec9e-aaba-4903-962e-bf73ca032038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:52.966877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eeec9e-aaba-4903-962e-bf73ca032038 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:52.968261 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eeec9e-aaba-4903-962e-bf73ca032038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:52.970289 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eeec9e-aaba-4903-962e-bf73ca032038 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:53.022016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1054/2125] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:52 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:53.027321 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e70192-eca7-46ac-9419-be38c3bcc415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:53.029328 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeec9e-aaba-4903-962e-bf73ca032038 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:53.030260 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e70192-eca7-46ac-9419-be38c3bcc415 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:53.030848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e70192-eca7-46ac-9419-be38c3bcc415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:53.031183 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e70192-eca7-46ac-9419-be38c3bcc415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:53.033834 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e70192-eca7-46ac-9419-be38c3bcc415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:53.033834 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e70192-eca7-46ac-9419-be38c3bcc415 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:53.048558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1072/2126] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:06:53.048852 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eeec9e-aaba-4903-962e-bf73ca032038 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:53.049887 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e70192-eca7-46ac-9419-be38c3bcc415 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:53.055771 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677eb2d-5bca-45cf-9a33-2c42f438b6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:53.059377 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677eb2d-5bca-45cf-9a33-2c42f438b6df admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:53.059377 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677eb2d-5bca-45cf-9a33-2c42f438b6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:53.059377 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677eb2d-5bca-45cf-9a33-2c42f438b6df admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:53.059377 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677eb2d-5bca-45cf-9a33-2c42f438b6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:53.059696 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677eb2d-5bca-45cf-9a33-2c42f438b6df admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:53.061660 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e70192-eca7-46ac-9419-be38c3bcc415 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:53.068200 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1d459-864e-4956-b4d3-79145c0b6abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:53.069294 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1d459-864e-4956-b4d3-79145c0b6abc admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:53.069730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1d459-864e-4956-b4d3-79145c0b6abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:53.071215 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1d459-864e-4956-b4d3-79145c0b6abc admin admin] PATH_INFO: `/v3/projects/bfc2f98fa2a24ec3b103535b10d6305e/users/d4806f4ecc6548ce83d95d6bed9ff53f/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:53.076437 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1055/2127] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:06:53.077403 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677eb2d-5bca-45cf-9a33-2c42f438b6df admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:53.086627 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1d459-864e-4956-b4d3-79145c0b6abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc2f98fa2a24ec3b103535b10d6305e, user_id=d4806f4ecc6548ce83d95d6bed9ff53f, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:53.088680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677eb2d-5bca-45cf-9a33-2c42f438b6df admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:53.089129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1d459-864e-4956-b4d3-79145c0b6abc admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:53.094828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0102be-8ec4-4921-bca4-9a454189f9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:53.095564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0102be-8ec4-4921-bca4-9a454189f9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:53.096243 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0102be-8ec4-4921-bca4-9a454189f9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:53.096243 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0102be-8ec4-4921-bca4-9a454189f9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:53.096872 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0102be-8ec4-4921-bca4-9a454189f9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:53.098479 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0102be-8ec4-4921-bca4-9a454189f9c5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:53.110769 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1056/2128] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:53.115700 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0102be-8ec4-4921-bca4-9a454189f9c5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:53.135553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0102be-8ec4-4921-bca4-9a454189f9c5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:53.143720 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe6223-9718-4b37-9ee7-40422d1be328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:53.144895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe6223-9718-4b37-9ee7-40422d1be328 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:53.145217 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe6223-9718-4b37-9ee7-40422d1be328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:53.145438 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe6223-9718-4b37-9ee7-40422d1be328 admin admin] PATH_INFO: `/v3/projects/77c1b520352244159a61d659cdda3718/users/383b90254b44432085b2d0e8f9bfe832/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:53.150547 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1073/2129] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:53 2022] PUT /identity/v3/projects/bfc2f98fa2a24ec3b103535b10d6305e/users/d4806f4ecc6548ce83d95d6bed9ff53f/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:53.155966 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731f697-be84-4250-9e71-2c1ddd4ee8fc None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:53.156142 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731f697-be84-4250-9e71-2c1ddd4ee8fc None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:53.156523 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731f697-be84-4250-9e71-2c1ddd4ee8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:53.165073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe6223-9718-4b37-9ee7-40422d1be328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c1b520352244159a61d659cdda3718, user_id=383b90254b44432085b2d0e8f9bfe832, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:53.167911 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe6223-9718-4b37-9ee7-40422d1be328 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:53.180608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c731f697-be84-4250-9e71-2c1ddd4ee8fc None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:53.182371 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c731f697-be84-4250-9e71-2c1ddd4ee8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:53.188969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1057/2130] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:53 2022] PUT /identity/v3/projects/77c1b520352244159a61d659cdda3718/users/383b90254b44432085b2d0e8f9bfe832/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:53.199833 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240fcfc-32c8-460c-80ef-7bf291f0653a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:53.200119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240fcfc-32c8-460c-80ef-7bf291f0653a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:53.200412 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240fcfc-32c8-460c-80ef-7bf291f0653a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:53.241372 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3240fcfc-32c8-460c-80ef-7bf291f0653a None None] MFA Rules not processed for user `383b90254b44432085b2d0e8f9bfe832`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:53.243009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3240fcfc-32c8-460c-80ef-7bf291f0653a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:53.308466 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1074/2131] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:53.320279 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731f697-be84-4250-9e71-2c1ddd4ee8fc None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:53.322249 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c731f697-be84-4250-9e71-2c1ddd4ee8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:53.346619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1058/2132] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:53.351157 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240fcfc-32c8-460c-80ef-7bf291f0653a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:53.367340 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240fcfc-32c8-460c-80ef-7bf291f0653a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:53.372810 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76135f3-5eb1-40ea-9748-d8014987de08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:53.373547 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76135f3-5eb1-40ea-9748-d8014987de08 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:53.374543 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76135f3-5eb1-40ea-9748-d8014987de08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:53.375542 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76135f3-5eb1-40ea-9748-d8014987de08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:53.376264 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76135f3-5eb1-40ea-9748-d8014987de08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:53.405733 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76135f3-5eb1-40ea-9748-d8014987de08 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:53.412007 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731f697-be84-4250-9e71-2c1ddd4ee8fc None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:53.416226 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d65bf-6f94-4182-b8f2-acdd23c4ecca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:53.417670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d65bf-6f94-4182-b8f2-acdd23c4ecca service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:53.418136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d65bf-6f94-4182-b8f2-acdd23c4ecca service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:53.418698 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d65bf-6f94-4182-b8f2-acdd23c4ecca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:53.430414 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d65bf-6f94-4182-b8f2-acdd23c4ecca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:53.432109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d65bf-6f94-4182-b8f2-acdd23c4ecca service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:53.445819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1059/2133] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:53 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:53.450135 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76135f3-5eb1-40ea-9748-d8014987de08 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:53.453146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1075/2134] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:06:53.525872 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76135f3-5eb1-40ea-9748-d8014987de08 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:53.531619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe9dd0-cf20-4a71-bca2-9c0a9dfc9cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:53.532297 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe9dd0-cf20-4a71-bca2-9c0a9dfc9cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:53.532608 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe9dd0-cf20-4a71-bca2-9c0a9dfc9cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:53.532923 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe9dd0-cf20-4a71-bca2-9c0a9dfc9cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:53.533708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe9dd0-cf20-4a71-bca2-9c0a9dfc9cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:53.535604 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe9dd0-cf20-4a71-bca2-9c0a9dfc9cf3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:53.560518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1060/2135] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:53 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:53.561962 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d65bf-6f94-4182-b8f2-acdd23c4ecca service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:53.574130 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d65bf-6f94-4182-b8f2-acdd23c4ecca service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:53.578741 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967eb8f-7542-4999-b3b1-910fcc7a9ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:53.579406 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967eb8f-7542-4999-b3b1-910fcc7a9ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:53.579691 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967eb8f-7542-4999-b3b1-910fcc7a9ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:53.579969 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967eb8f-7542-4999-b3b1-910fcc7a9ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:53.580698 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967eb8f-7542-4999-b3b1-910fcc7a9ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:53.582378 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967eb8f-7542-4999-b3b1-910fcc7a9ad2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:53.593711 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1076/2136] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:53.598078 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe9dd0-cf20-4a71-bca2-9c0a9dfc9cf3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:53.610404 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe9dd0-cf20-4a71-bca2-9c0a9dfc9cf3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:53.620230 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e8df7-f5a4-465f-b039-4b99602e8d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:53.621249 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8df7-f5a4-465f-b039-4b99602e8d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:53.621659 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8df7-f5a4-465f-b039-4b99602e8d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:53.622002 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e8df7-f5a4-465f-b039-4b99602e8d84 admin admin] PATH_INFO: `/v3/projects/4d9b53611e714ed79f72c2f01483f6ec/users/eaaa6bf4923f4514a692460c01be23df/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:53.659091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e8df7-f5a4-465f-b039-4b99602e8d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9b53611e714ed79f72c2f01483f6ec, user_id=eaaa6bf4923f4514a692460c01be23df, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:53.662470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e8df7-f5a4-465f-b039-4b99602e8d84 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:53.684175 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967eb8f-7542-4999-b3b1-910fcc7a9ad2 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:53.690162 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1061/2137] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:53 2022] PUT /identity/v3/projects/4d9b53611e714ed79f72c2f01483f6ec/users/eaaa6bf4923f4514a692460c01be23df/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:53.698964 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967eb8f-7542-4999-b3b1-910fcc7a9ad2 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:53.791431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07216f-53d8-47bc-a537-104383054079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:53.792146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07216f-53d8-47bc-a537-104383054079 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:53.792942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07216f-53d8-47bc-a537-104383054079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:53.793068 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07216f-53d8-47bc-a537-104383054079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:53.793862 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07216f-53d8-47bc-a537-104383054079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:53.795707 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07216f-53d8-47bc-a537-104383054079 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:53.812850 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1077/2138] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:53.815757 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e8df7-f5a4-465f-b039-4b99602e8d84 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:53.830874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e8df7-f5a4-465f-b039-4b99602e8d84 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:53.866096 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1add2-f741-457c-aa5d-3ae6eef98f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:53.867236 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1add2-f741-457c-aa5d-3ae6eef98f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:53.867493 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1add2-f741-457c-aa5d-3ae6eef98f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:53.867976 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1add2-f741-457c-aa5d-3ae6eef98f73 admin admin] PATH_INFO: `/v3/projects/4d9b53611e714ed79f72c2f01483f6ec/users/eaaa6bf4923f4514a692460c01be23df/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:53.871839 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1add2-f741-457c-aa5d-3ae6eef98f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9b53611e714ed79f72c2f01483f6ec, user_id=eaaa6bf4923f4514a692460c01be23df, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:53.875298 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f1add2-f741-457c-aa5d-3ae6eef98f73 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:53.890574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1062/2139] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:53 2022] PUT /identity/v3/projects/4d9b53611e714ed79f72c2f01483f6ec/users/eaaa6bf4923f4514a692460c01be23df/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:53.902696 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0ecc4-9a01-4b0c-8b69-9de9bf585a1e None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:53.903066 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0ecc4-9a01-4b0c-8b69-9de9bf585a1e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:53.903247 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0ecc4-9a01-4b0c-8b69-9de9bf585a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:53.954871 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-34c0ecc4-9a01-4b0c-8b69-9de9bf585a1e None None] MFA Rules not processed for user `eaaa6bf4923f4514a692460c01be23df`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:53.957075 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-34c0ecc4-9a01-4b0c-8b69-9de9bf585a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:54.066216 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1078/2140] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:54.085426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1add2-f741-457c-aa5d-3ae6eef98f73 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:54.087599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a2f1add2-f741-457c-aa5d-3ae6eef98f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:54.173048 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1add2-f741-457c-aa5d-3ae6eef98f73 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:54.177833 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c41926-e7a4-4a55-80ab-a046a794c92e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:54.178613 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c41926-e7a4-4a55-80ab-a046a794c92e service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:54.178971 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c41926-e7a4-4a55-80ab-a046a794c92e service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:54.179333 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c41926-e7a4-4a55-80ab-a046a794c92e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:54.199126 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c41926-e7a4-4a55-80ab-a046a794c92e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:54.200934 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c41926-e7a4-4a55-80ab-a046a794c92e service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:54.218876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1063/2141] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:54.265356 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dbedf-ff54-4158-aef6-237db60e9f5d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:54.265849 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dbedf-ff54-4158-aef6-237db60e9f5d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:54.266087 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dbedf-ff54-4158-aef6-237db60e9f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:54.325687 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-241dbedf-ff54-4158-aef6-237db60e9f5d None None] MFA Rules not processed for user `d4806f4ecc6548ce83d95d6bed9ff53f`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:54.326929 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-241dbedf-ff54-4158-aef6-237db60e9f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:54.467597 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1079/2142] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:54.472510 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c41926-e7a4-4a55-80ab-a046a794c92e service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:54.642712 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c41926-e7a4-4a55-80ab-a046a794c92e service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:54.653461 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708a045-f5fd-484b-8293-f8be3fd75c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:54.654151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708a045-f5fd-484b-8293-f8be3fd75c83 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:54.654435 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708a045-f5fd-484b-8293-f8be3fd75c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:54.654709 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708a045-f5fd-484b-8293-f8be3fd75c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:54.656252 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708a045-f5fd-484b-8293-f8be3fd75c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:54.663971 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708a045-f5fd-484b-8293-f8be3fd75c83 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:54.699245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1064/2143] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:54 2022] POST /identity/v3/projects => generated 371 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:54.703365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dbedf-ff54-4158-aef6-237db60e9f5d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:54.719132 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dbedf-ff54-4158-aef6-237db60e9f5d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:54.812677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13404767-a52e-4a63-aff2-d17a51feb2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:54.813414 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13404767-a52e-4a63-aff2-d17a51feb2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:54.813703 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13404767-a52e-4a63-aff2-d17a51feb2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:54.813979 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13404767-a52e-4a63-aff2-d17a51feb2c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:54.814782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13404767-a52e-4a63-aff2-d17a51feb2c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:54.816872 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13404767-a52e-4a63-aff2-d17a51feb2c3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:54.853636 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1080/2144] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:54 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:54.853851 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708a045-f5fd-484b-8293-f8be3fd75c83 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:54.880482 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708a045-f5fd-484b-8293-f8be3fd75c83 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:54.897903 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd819c3-ad7e-4456-8e16-c51c828242e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:54.898692 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd819c3-ad7e-4456-8e16-c51c828242e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:54.900528 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd819c3-ad7e-4456-8e16-c51c828242e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:54.900966 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd819c3-ad7e-4456-8e16-c51c828242e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:54.901917 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd819c3-ad7e-4456-8e16-c51c828242e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:54.904283 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd819c3-ad7e-4456-8e16-c51c828242e6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:54.933029 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1065/2145] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:54.934803 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13404767-a52e-4a63-aff2-d17a51feb2c3 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:54.951542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13404767-a52e-4a63-aff2-d17a51feb2c3 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:54.976873 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf586f0a-78d7-48a3-b22a-b5e7259cd415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:54.976873 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf586f0a-78d7-48a3-b22a-b5e7259cd415 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:54.976873 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf586f0a-78d7-48a3-b22a-b5e7259cd415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:54.976873 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf586f0a-78d7-48a3-b22a-b5e7259cd415 admin admin] PATH_INFO: `/v3/projects/33b2fbb0b63340f791f3e60ac78f7ddf/users/9bd94e7212d340518f688652fdda304b/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:55.017064 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf586f0a-78d7-48a3-b22a-b5e7259cd415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b2fbb0b63340f791f3e60ac78f7ddf, user_id=9bd94e7212d340518f688652fdda304b, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:55.025131 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf586f0a-78d7-48a3-b22a-b5e7259cd415 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:55.052396 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1081/2146] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:54 2022] PUT /identity/v3/projects/33b2fbb0b63340f791f3e60ac78f7ddf/users/9bd94e7212d340518f688652fdda304b/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:55.056186 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd819c3-ad7e-4456-8e16-c51c828242e6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:55.070699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd819c3-ad7e-4456-8e16-c51c828242e6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:55.150202 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee306fc0-e416-4c7e-b4f1-5ffe15da9bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:55.150900 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee306fc0-e416-4c7e-b4f1-5ffe15da9bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:55.151188 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee306fc0-e416-4c7e-b4f1-5ffe15da9bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:55.151500 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee306fc0-e416-4c7e-b4f1-5ffe15da9bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:55.152226 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee306fc0-e416-4c7e-b4f1-5ffe15da9bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:55.153883 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee306fc0-e416-4c7e-b4f1-5ffe15da9bf5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:55.169477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1066/2147] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:55.174109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf586f0a-78d7-48a3-b22a-b5e7259cd415 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:55.188268 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf586f0a-78d7-48a3-b22a-b5e7259cd415 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:55.194242 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3980b-d984-41d7-8ea1-15b270e5180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:55.195451 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3980b-d984-41d7-8ea1-15b270e5180b admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:55.195811 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3980b-d984-41d7-8ea1-15b270e5180b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:55.196160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3980b-d984-41d7-8ea1-15b270e5180b admin admin] PATH_INFO: `/v3/projects/33b2fbb0b63340f791f3e60ac78f7ddf/users/9bd94e7212d340518f688652fdda304b/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:55.198524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3980b-d984-41d7-8ea1-15b270e5180b admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b2fbb0b63340f791f3e60ac78f7ddf, user_id=9bd94e7212d340518f688652fdda304b, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:55.202465 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3980b-d984-41d7-8ea1-15b270e5180b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:55.219385 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1082/2148] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:55 2022] PUT /identity/v3/projects/33b2fbb0b63340f791f3e60ac78f7ddf/users/9bd94e7212d340518f688652fdda304b/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:55.359894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee306fc0-e416-4c7e-b4f1-5ffe15da9bf5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:55.372130 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee306fc0-e416-4c7e-b4f1-5ffe15da9bf5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:55.472267 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347c8ff-6304-4c17-8dfd-d792afa1476e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:55.473229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347c8ff-6304-4c17-8dfd-d792afa1476e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:55.473898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347c8ff-6304-4c17-8dfd-d792afa1476e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:55.474613 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347c8ff-6304-4c17-8dfd-d792afa1476e admin admin] PATH_INFO: `/v3/users/383b90254b44432085b2d0e8f9bfe832` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:55.477457 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347c8ff-6304-4c17-8dfd-d792afa1476e admin admin] RBAC: Authorizing `identity:delete_user(user_id=383b90254b44432085b2d0e8f9bfe832)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:55.480210 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347c8ff-6304-4c17-8dfd-d792afa1476e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:55.557969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1347c8ff-6304-4c17-8dfd-d792afa1476e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '383b90254b44432085b2d0e8f9bfe832'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:55.558970 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1347c8ff-6304-4c17-8dfd-d792afa1476e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '383b90254b44432085b2d0e8f9bfe832'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:55.559901 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1347c8ff-6304-4c17-8dfd-d792afa1476e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '383b90254b44432085b2d0e8f9bfe832'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:55.570660 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1347c8ff-6304-4c17-8dfd-d792afa1476e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '383b90254b44432085b2d0e8f9bfe832'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:55.585192 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1347c8ff-6304-4c17-8dfd-d792afa1476e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '383b90254b44432085b2d0e8f9bfe832'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:55.604078 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1067/2149] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:55 2022] DELETE /identity/v3/users/383b90254b44432085b2d0e8f9bfe832 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:55.609271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa9936-a107-43fe-ab11-d4b5f78393b2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:55.609902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa9936-a107-43fe-ab11-d4b5f78393b2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:55.609902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa9936-a107-43fe-ab11-d4b5f78393b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:55.638003 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-adaa9936-a107-43fe-ab11-d4b5f78393b2 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:55.639876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-adaa9936-a107-43fe-ab11-d4b5f78393b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:55.734419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1083/2150] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:55.746895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347c8ff-6304-4c17-8dfd-d792afa1476e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:55.748431 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1347c8ff-6304-4c17-8dfd-d792afa1476e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:55.839357 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347c8ff-6304-4c17-8dfd-d792afa1476e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:55.845141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10462f1-9fca-49c6-aaa9-6b7f68f15b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:55.846865 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10462f1-9fca-49c6-aaa9-6b7f68f15b8c service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:55.847205 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10462f1-9fca-49c6-aaa9-6b7f68f15b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:55.847588 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10462f1-9fca-49c6-aaa9-6b7f68f15b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:55.860237 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10462f1-9fca-49c6-aaa9-6b7f68f15b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:55.862329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10462f1-9fca-49c6-aaa9-6b7f68f15b8c service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:55.873721 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1068/2151] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:56.149524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2435e-7201-4fe6-9924-dc55b53a968d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:56.150216 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2435e-7201-4fe6-9924-dc55b53a968d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:56.150561 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2435e-7201-4fe6-9924-dc55b53a968d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:56.190864 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4cc2435e-7201-4fe6-9924-dc55b53a968d None None] MFA Rules not processed for user `9bd94e7212d340518f688652fdda304b`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:56.195226 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4cc2435e-7201-4fe6-9924-dc55b53a968d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:56.366109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1084/2152] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:56.374064 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10462f1-9fca-49c6-aaa9-6b7f68f15b8c service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:56.378085 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b10462f1-9fca-49c6-aaa9-6b7f68f15b8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:56.469771 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10462f1-9fca-49c6-aaa9-6b7f68f15b8c service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:56.476043 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c36326-a6c1-48d2-a708-f1cf2176173b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:56.476927 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c36326-a6c1-48d2-a708-f1cf2176173b service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:56.477311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c36326-a6c1-48d2-a708-f1cf2176173b service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:56.477690 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c36326-a6c1-48d2-a708-f1cf2176173b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:56.481091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-02c36326-a6c1-48d2-a708-f1cf2176173b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:56.558985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c36326-a6c1-48d2-a708-f1cf2176173b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:56.560697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c36326-a6c1-48d2-a708-f1cf2176173b service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:56.572547 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1069/2153] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:06:56.910056 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2435e-7201-4fe6-9924-dc55b53a968d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:56.912504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4cc2435e-7201-4fe6-9924-dc55b53a968d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:56.942881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2435e-7201-4fe6-9924-dc55b53a968d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:56.955340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:56.956271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:56.956561 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:56.956855 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d admin admin] PATH_INFO: `/v3/projects/77c1b520352244159a61d659cdda3718` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:56.960608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d admin admin] RBAC: Authorizing `identity:delete_project(project_id=77c1b520352244159a61d659cdda3718)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:56.964852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:57.048154 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77c1b520352244159a61d659cdda3718', 'request_id': 'req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:57.056826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77c1b520352244159a61d659cdda3718', 'request_id': 'req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:57.067051 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77c1b520352244159a61d659cdda3718', 'request_id': 'req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:57.082881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d admin admin] The token cache is being invalidate because project 77c1b520352244159a61d659cdda3718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:57.084160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:57.085347 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:57.088186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1085/2154] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:56 2022] DELETE /identity/v3/projects/77c1b520352244159a61d659cdda3718 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:57.092556 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c36326-a6c1-48d2-a708-f1cf2176173b service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:57.104151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c36326-a6c1-48d2-a708-f1cf2176173b service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:57.157922 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:57.159878 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:57.182457 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed545094-6663-4061-9270-61c92c9bbe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:57.184027 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed545094-6663-4061-9270-61c92c9bbe5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:57.184492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed545094-6663-4061-9270-61c92c9bbe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:57.185505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed545094-6663-4061-9270-61c92c9bbe5c admin admin] PATH_INFO: `/v3/users/eaaa6bf4923f4514a692460c01be23df` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:57.186928 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed545094-6663-4061-9270-61c92c9bbe5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaaa6bf4923f4514a692460c01be23df)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:57.190409 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed545094-6663-4061-9270-61c92c9bbe5c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:57.237045 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17e5e3-6620-4fd0-bbd8-4e695922c66d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:57.242039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a67fa3-9f6e-4246-ae3d-22d4414fe16e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:57.242765 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a67fa3-9f6e-4246-ae3d-22d4414fe16e service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:57.243106 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a67fa3-9f6e-4246-ae3d-22d4414fe16e service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:57.243387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a67fa3-9f6e-4246-ae3d-22d4414fe16e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:57.245370 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-17a67fa3-9f6e-4246-ae3d-22d4414fe16e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:57.261461 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ed545094-6663-4061-9270-61c92c9bbe5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaaa6bf4923f4514a692460c01be23df'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:57.262608 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ed545094-6663-4061-9270-61c92c9bbe5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaaa6bf4923f4514a692460c01be23df'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:57.263829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ed545094-6663-4061-9270-61c92c9bbe5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaaa6bf4923f4514a692460c01be23df'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:57.274674 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ed545094-6663-4061-9270-61c92c9bbe5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaaa6bf4923f4514a692460c01be23df'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:57.288853 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ed545094-6663-4061-9270-61c92c9bbe5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaaa6bf4923f4514a692460c01be23df'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:57.305622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1070/2155] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:57 2022] DELETE /identity/v3/users/eaaa6bf4923f4514a692460c01be23df => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:57.343730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a67fa3-9f6e-4246-ae3d-22d4414fe16e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:57.345526 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a67fa3-9f6e-4246-ae3d-22d4414fe16e service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:57.358536 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1086/2156] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:57.600145 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed545094-6663-4061-9270-61c92c9bbe5c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:57.601788 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ed545094-6663-4061-9270-61c92c9bbe5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:57.697069 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed545094-6663-4061-9270-61c92c9bbe5c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:57.702765 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54521bf-72eb-4c21-97ad-dbeadd546f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:57.703749 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54521bf-72eb-4c21-97ad-dbeadd546f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:57.704137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54521bf-72eb-4c21-97ad-dbeadd546f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:57.704517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54521bf-72eb-4c21-97ad-dbeadd546f55 admin admin] PATH_INFO: `/v3/projects/4d9b53611e714ed79f72c2f01483f6ec` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:57.705948 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54521bf-72eb-4c21-97ad-dbeadd546f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9b53611e714ed79f72c2f01483f6ec)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:57.708645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54521bf-72eb-4c21-97ad-dbeadd546f55 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:57.771023 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b54521bf-72eb-4c21-97ad-dbeadd546f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9b53611e714ed79f72c2f01483f6ec', 'request_id': 'req-b54521bf-72eb-4c21-97ad-dbeadd546f55'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:57.779451 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b54521bf-72eb-4c21-97ad-dbeadd546f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9b53611e714ed79f72c2f01483f6ec', 'request_id': 'req-b54521bf-72eb-4c21-97ad-dbeadd546f55'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:57.787643 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b54521bf-72eb-4c21-97ad-dbeadd546f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9b53611e714ed79f72c2f01483f6ec', 'request_id': 'req-b54521bf-72eb-4c21-97ad-dbeadd546f55'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:57.798178 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b54521bf-72eb-4c21-97ad-dbeadd546f55 admin admin] The token cache is being invalidate because project 4d9b53611e714ed79f72c2f01483f6ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:57.798533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b54521bf-72eb-4c21-97ad-dbeadd546f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:57.799246 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b54521bf-72eb-4c21-97ad-dbeadd546f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:57.800895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1071/2157] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:57 2022] DELETE /identity/v3/projects/4d9b53611e714ed79f72c2f01483f6ec => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:57.806737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda1751-0b8e-42cd-a595-e1d8f175acb2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:57.807029 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda1751-0b8e-42cd-a595-e1d8f175acb2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:57.807307 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda1751-0b8e-42cd-a595-e1d8f175acb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:57.825151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4bda1751-0b8e-42cd-a595-e1d8f175acb2 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:57.826418 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4bda1751-0b8e-42cd-a595-e1d8f175acb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:57.889482 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1087/2158] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:57.898191 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ea765-88cc-45a2-9ffb-5fa75f947386 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:57.898480 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ea765-88cc-45a2-9ffb-5fa75f947386 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:57.898762 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ea765-88cc-45a2-9ffb-5fa75f947386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:57.919807 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f81ea765-88cc-45a2-9ffb-5fa75f947386 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:57.921121 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f81ea765-88cc-45a2-9ffb-5fa75f947386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:57.931703 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1072/2159] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:57.935655 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda1751-0b8e-42cd-a595-e1d8f175acb2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:57.946704 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda1751-0b8e-42cd-a595-e1d8f175acb2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:57.952250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b466c07-5c80-4b0d-9a3d-3c97d7fc0e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:57.953175 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b466c07-5c80-4b0d-9a3d-3c97d7fc0e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:57.953567 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b466c07-5c80-4b0d-9a3d-3c97d7fc0e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:57.953852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b466c07-5c80-4b0d-9a3d-3c97d7fc0e81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:57.954583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b466c07-5c80-4b0d-9a3d-3c97d7fc0e81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:57.954894 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b466c07-5c80-4b0d-9a3d-3c97d7fc0e81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:57.956528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b466c07-5c80-4b0d-9a3d-3c97d7fc0e81 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:57.970885 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1088/2160] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:57.975312 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ea765-88cc-45a2-9ffb-5fa75f947386 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:57.984634 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ea765-88cc-45a2-9ffb-5fa75f947386 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:57.995585 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8191f7f-3145-422e-a98d-4b208a45b838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:57.996263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8191f7f-3145-422e-a98d-4b208a45b838 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:57.996543 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8191f7f-3145-422e-a98d-4b208a45b838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:57.996835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8191f7f-3145-422e-a98d-4b208a45b838 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:57.997558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8191f7f-3145-422e-a98d-4b208a45b838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:57.999495 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8191f7f-3145-422e-a98d-4b208a45b838 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:58.035634 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1073/2161] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:57 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:58.037309 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b466c07-5c80-4b0d-9a3d-3c97d7fc0e81 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:58.047520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b466c07-5c80-4b0d-9a3d-3c97d7fc0e81 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:58.121771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e45ac-0d79-4da7-9d54-a5a872e3ad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:58.122372 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e45ac-0d79-4da7-9d54-a5a872e3ad66 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:58.122648 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e45ac-0d79-4da7-9d54-a5a872e3ad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:58.122928 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e45ac-0d79-4da7-9d54-a5a872e3ad66 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:58.123658 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e45ac-0d79-4da7-9d54-a5a872e3ad66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:58.125651 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e45ac-0d79-4da7-9d54-a5a872e3ad66 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:58.147280 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1089/2162] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:58 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:58.151375 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8191f7f-3145-422e-a98d-4b208a45b838 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:58.162517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8191f7f-3145-422e-a98d-4b208a45b838 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:58.167137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a7d73-a707-420e-a10d-d4328073d8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:58.167823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a7d73-a707-420e-a10d-d4328073d8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:58.168105 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a7d73-a707-420e-a10d-d4328073d8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:58.168381 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a7d73-a707-420e-a10d-d4328073d8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:58.169143 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a7d73-a707-420e-a10d-d4328073d8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:58.170809 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a7d73-a707-420e-a10d-d4328073d8c1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:58.182647 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1074/2163] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:58.186564 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e45ac-0d79-4da7-9d54-a5a872e3ad66 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:58.197072 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e45ac-0d79-4da7-9d54-a5a872e3ad66 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:58.201893 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14f078-34f6-4889-8e52-d47a95055d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:58.202561 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14f078-34f6-4889-8e52-d47a95055d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:58.202844 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14f078-34f6-4889-8e52-d47a95055d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:58.203124 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14f078-34f6-4889-8e52-d47a95055d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:58.203857 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14f078-34f6-4889-8e52-d47a95055d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:58.205535 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14f078-34f6-4889-8e52-d47a95055d46 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:58.215822 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1090/2164] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:58.220021 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a7d73-a707-420e-a10d-d4328073d8c1 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:58.230735 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a7d73-a707-420e-a10d-d4328073d8c1 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:58.235856 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adbe6d-f60f-4621-bcd1-68616fa33984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:58.236727 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adbe6d-f60f-4621-bcd1-68616fa33984 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:58.237039 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adbe6d-f60f-4621-bcd1-68616fa33984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:58.237314 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adbe6d-f60f-4621-bcd1-68616fa33984 admin admin] PATH_INFO: `/v3/projects/a53b438ab0ed4d289f763d3f16be2f5e/users/dfb60932c98c46bba0ad7e2015610481/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:58.253724 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adbe6d-f60f-4621-bcd1-68616fa33984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53b438ab0ed4d289f763d3f16be2f5e, user_id=dfb60932c98c46bba0ad7e2015610481, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:58.256427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adbe6d-f60f-4621-bcd1-68616fa33984 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:58.269801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1075/2165] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:58 2022] PUT /identity/v3/projects/a53b438ab0ed4d289f763d3f16be2f5e/users/dfb60932c98c46bba0ad7e2015610481/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:06:58.280224 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d07d0d-8ad2-4b3a-850b-5668320c3c28 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:58.280561 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d07d0d-8ad2-4b3a-850b-5668320c3c28 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:58.280864 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d07d0d-8ad2-4b3a-850b-5668320c3c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:58.321821 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f1d07d0d-8ad2-4b3a-850b-5668320c3c28 None None] MFA Rules not processed for user `dfb60932c98c46bba0ad7e2015610481`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:58.323098 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f1d07d0d-8ad2-4b3a-850b-5668320c3c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:58.400677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1091/2166] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:58.407837 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adbe6d-f60f-4621-bcd1-68616fa33984 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:58.409563 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a2adbe6d-f60f-4621-bcd1-68616fa33984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:58.469187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adbe6d-f60f-4621-bcd1-68616fa33984 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:58.472909 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ba741-7291-4397-b04b-72edb1a97613 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:58.474232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ba741-7291-4397-b04b-72edb1a97613 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:58.474605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ba741-7291-4397-b04b-72edb1a97613 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:58.474887 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ba741-7291-4397-b04b-72edb1a97613 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:58.484154 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ba741-7291-4397-b04b-72edb1a97613 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:58.485773 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ba741-7291-4397-b04b-72edb1a97613 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:58.495602 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1076/2167] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:58.514769 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d07d0d-8ad2-4b3a-850b-5668320c3c28 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:58.578763 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d07d0d-8ad2-4b3a-850b-5668320c3c28 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:58.584051 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091884c-a819-4f13-9eea-96291873a6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:58.584967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091884c-a819-4f13-9eea-96291873a6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:58.585251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091884c-a819-4f13-9eea-96291873a6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:58.585523 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091884c-a819-4f13-9eea-96291873a6ca admin admin] PATH_INFO: `/v3/users/dfb60932c98c46bba0ad7e2015610481` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:58.586745 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091884c-a819-4f13-9eea-96291873a6ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb60932c98c46bba0ad7e2015610481)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:58.588687 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091884c-a819-4f13-9eea-96291873a6ca admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:58.641416 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1091884c-a819-4f13-9eea-96291873a6ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb60932c98c46bba0ad7e2015610481'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:58.642186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1091884c-a819-4f13-9eea-96291873a6ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb60932c98c46bba0ad7e2015610481'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:58.642874 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1091884c-a819-4f13-9eea-96291873a6ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb60932c98c46bba0ad7e2015610481'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:58.651538 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1091884c-a819-4f13-9eea-96291873a6ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb60932c98c46bba0ad7e2015610481'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:58.663160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1091884c-a819-4f13-9eea-96291873a6ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb60932c98c46bba0ad7e2015610481'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:58.674746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1092/2168] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:58 2022] DELETE /identity/v3/users/dfb60932c98c46bba0ad7e2015610481 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:58.679972 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4592d-3f58-4a5f-a539-de36e6a0366c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:58.680434 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4592d-3f58-4a5f-a539-de36e6a0366c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:58.680540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4592d-3f58-4a5f-a539-de36e6a0366c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:58.698165 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-abd4592d-3f58-4a5f-a539-de36e6a0366c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:58.699370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-abd4592d-3f58-4a5f-a539-de36e6a0366c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:58.758194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1077/2169] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:58.767978 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091884c-a819-4f13-9eea-96291873a6ca admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:58.769431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1091884c-a819-4f13-9eea-96291873a6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:58.824708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091884c-a819-4f13-9eea-96291873a6ca admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:58.828419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ca93a-e1ea-4188-ab57-b2f6b5784816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:58.829090 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ca93a-e1ea-4188-ab57-b2f6b5784816 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:58.829372 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ca93a-e1ea-4188-ab57-b2f6b5784816 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:58.829646 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ca93a-e1ea-4188-ab57-b2f6b5784816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:58.838626 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ca93a-e1ea-4188-ab57-b2f6b5784816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:58.840048 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ca93a-e1ea-4188-ab57-b2f6b5784816 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:58.849745 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1093/2170] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:06:59.130729 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4592d-3f58-4a5f-a539-de36e6a0366c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:59.132838 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-abd4592d-3f58-4a5f-a539-de36e6a0366c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:59.151972 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4592d-3f58-4a5f-a539-de36e6a0366c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:59.157194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdc07c-7513-4cc9-8df1-cc2e636ad69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:59.158189 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdc07c-7513-4cc9-8df1-cc2e636ad69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:59.158532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdc07c-7513-4cc9-8df1-cc2e636ad69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:59.158873 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdc07c-7513-4cc9-8df1-cc2e636ad69e admin admin] PATH_INFO: `/v3/projects/a53b438ab0ed4d289f763d3f16be2f5e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:59.160149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdc07c-7513-4cc9-8df1-cc2e636ad69e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a53b438ab0ed4d289f763d3f16be2f5e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:59.163165 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdc07c-7513-4cc9-8df1-cc2e636ad69e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:59.216356 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-accdc07c-7513-4cc9-8df1-cc2e636ad69e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a53b438ab0ed4d289f763d3f16be2f5e', 'request_id': 'req-accdc07c-7513-4cc9-8df1-cc2e636ad69e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:59.224645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-accdc07c-7513-4cc9-8df1-cc2e636ad69e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a53b438ab0ed4d289f763d3f16be2f5e', 'request_id': 'req-accdc07c-7513-4cc9-8df1-cc2e636ad69e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:59.232305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-accdc07c-7513-4cc9-8df1-cc2e636ad69e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a53b438ab0ed4d289f763d3f16be2f5e', 'request_id': 'req-accdc07c-7513-4cc9-8df1-cc2e636ad69e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:59.243301 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-accdc07c-7513-4cc9-8df1-cc2e636ad69e admin admin] The token cache is being invalidate because project a53b438ab0ed4d289f763d3f16be2f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:06:59.243592 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-accdc07c-7513-4cc9-8df1-cc2e636ad69e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:59.244253 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-accdc07c-7513-4cc9-8df1-cc2e636ad69e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:06:59.245844 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1078/2171] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:06:59 2022] DELETE /identity/v3/projects/a53b438ab0ed4d289f763d3f16be2f5e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:59.251361 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc14ab-b8cd-4c45-9f52-9f5a913eebae None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:59.251885 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc14ab-b8cd-4c45-9f52-9f5a913eebae None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:59.251885 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc14ab-b8cd-4c45-9f52-9f5a913eebae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:59.270284 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-10cc14ab-b8cd-4c45-9f52-9f5a913eebae None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:59.272335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-10cc14ab-b8cd-4c45-9f52-9f5a913eebae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:59.337908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1094/2172] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:06:59.346796 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257feab-5761-4c3f-a56f-483039f27e3e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:59.347204 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257feab-5761-4c3f-a56f-483039f27e3e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:59.347483 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257feab-5761-4c3f-a56f-483039f27e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:59.369131 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4257feab-5761-4c3f-a56f-483039f27e3e None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:59.370330 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4257feab-5761-4c3f-a56f-483039f27e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:59.381881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1079/2173] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:59.385813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc14ab-b8cd-4c45-9f52-9f5a913eebae None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:59.398780 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc14ab-b8cd-4c45-9f52-9f5a913eebae None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:59.407738 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602c8ce-d9e7-428e-b930-ae7c3a52a7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:59.408469 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602c8ce-d9e7-428e-b930-ae7c3a52a7ff admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:59.409023 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602c8ce-d9e7-428e-b930-ae7c3a52a7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:59.409436 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602c8ce-d9e7-428e-b930-ae7c3a52a7ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:59.410395 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602c8ce-d9e7-428e-b930-ae7c3a52a7ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:06:59.410860 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602c8ce-d9e7-428e-b930-ae7c3a52a7ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:59.413634 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602c8ce-d9e7-428e-b930-ae7c3a52a7ff admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:59.431147 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1095/2174] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:06:59.436391 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257feab-5761-4c3f-a56f-483039f27e3e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:59.445846 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257feab-5761-4c3f-a56f-483039f27e3e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:59.450529 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198534c-af71-4082-83c1-0396b63a7916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:59.451241 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198534c-af71-4082-83c1-0396b63a7916 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:59.451590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198534c-af71-4082-83c1-0396b63a7916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:59.451960 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198534c-af71-4082-83c1-0396b63a7916 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:59.452728 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198534c-af71-4082-83c1-0396b63a7916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:59.454795 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198534c-af71-4082-83c1-0396b63a7916 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:59.481015 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1080/2175] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:06:59 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:06:59.485216 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602c8ce-d9e7-428e-b930-ae7c3a52a7ff admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:59.495544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602c8ce-d9e7-428e-b930-ae7c3a52a7ff admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:59.552294 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cbd32-23ef-4dd8-8fd5-1d9be37ea465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:59.553015 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cbd32-23ef-4dd8-8fd5-1d9be37ea465 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:59.553289 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cbd32-23ef-4dd8-8fd5-1d9be37ea465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:59.553807 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cbd32-23ef-4dd8-8fd5-1d9be37ea465 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:59.554517 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cbd32-23ef-4dd8-8fd5-1d9be37ea465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:59.556485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cbd32-23ef-4dd8-8fd5-1d9be37ea465 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:59.581360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1096/2176] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:06:59 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:06:59.586764 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198534c-af71-4082-83c1-0396b63a7916 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:59.599564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198534c-af71-4082-83c1-0396b63a7916 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:59.604285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b80833-70a4-4e06-938f-5c97a579eca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:59.604988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b80833-70a4-4e06-938f-5c97a579eca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:59.605263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b80833-70a4-4e06-938f-5c97a579eca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:59.605533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b80833-70a4-4e06-938f-5c97a579eca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:59.606254 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b80833-70a4-4e06-938f-5c97a579eca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:59.607844 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b80833-70a4-4e06-938f-5c97a579eca8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:59.622188 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1081/2177] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:59.623428 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cbd32-23ef-4dd8-8fd5-1d9be37ea465 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:59.635260 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cbd32-23ef-4dd8-8fd5-1d9be37ea465 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:59.640019 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bd0d6-85f5-422f-87de-6fd0937516ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:59.640750 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bd0d6-85f5-422f-87de-6fd0937516ab admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:59.641066 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bd0d6-85f5-422f-87de-6fd0937516ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:59.641349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bd0d6-85f5-422f-87de-6fd0937516ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:59.642074 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bd0d6-85f5-422f-87de-6fd0937516ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:59.643669 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bd0d6-85f5-422f-87de-6fd0937516ab admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:59.653741 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1097/2178] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:06:59.657869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b80833-70a4-4e06-938f-5c97a579eca8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:59.669459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b80833-70a4-4e06-938f-5c97a579eca8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:59.674260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eb36a-0bb5-44ae-bd82-34d3f8d15163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:59.675315 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eb36a-0bb5-44ae-bd82-34d3f8d15163 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:59.675576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eb36a-0bb5-44ae-bd82-34d3f8d15163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:59.675876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eb36a-0bb5-44ae-bd82-34d3f8d15163 admin admin] PATH_INFO: `/v3/projects/241e12f995e14eb9b6b7b225d93f41f3/users/adf9efb3d4734a6fb386902629f991cd/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:59.693810 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5eb36a-0bb5-44ae-bd82-34d3f8d15163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=241e12f995e14eb9b6b7b225d93f41f3, user_id=adf9efb3d4734a6fb386902629f991cd, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:59.696736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5eb36a-0bb5-44ae-bd82-34d3f8d15163 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:59.714732 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1082/2179] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:06:59 2022] PUT /identity/v3/projects/241e12f995e14eb9b6b7b225d93f41f3/users/adf9efb3d4734a6fb386902629f991cd/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:06:59.725088 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2c9bd-c2dc-4364-8478-e73a174e9aed None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:59.725626 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2c9bd-c2dc-4364-8478-e73a174e9aed None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:59.725960 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2c9bd-c2dc-4364-8478-e73a174e9aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:59.754627 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1dc2c9bd-c2dc-4364-8478-e73a174e9aed None None] MFA Rules not processed for user `adf9efb3d4734a6fb386902629f991cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:06:59.756436 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1dc2c9bd-c2dc-4364-8478-e73a174e9aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:59.836572 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1098/2180] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:06:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:06:59.843895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eb36a-0bb5-44ae-bd82-34d3f8d15163 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:06:59.845765 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3b5eb36a-0bb5-44ae-bd82-34d3f8d15163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:06:59.905539 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eb36a-0bb5-44ae-bd82-34d3f8d15163 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:06:59.909295 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14dcf9b-ed8c-4c79-ac07-b5f0b3f00cf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:06:59.909944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14dcf9b-ed8c-4c79-ac07-b5f0b3f00cf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:06:59.910225 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14dcf9b-ed8c-4c79-ac07-b5f0b3f00cf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:06:59.910498 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14dcf9b-ed8c-4c79-ac07-b5f0b3f00cf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:06:59.920082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14dcf9b-ed8c-4c79-ac07-b5f0b3f00cf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:06:59.921617 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14dcf9b-ed8c-4c79-ac07-b5f0b3f00cf9 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:06:59.931209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1083/2181] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:06:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:06:59.954450 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2c9bd-c2dc-4364-8478-e73a174e9aed None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:00.059134 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2c9bd-c2dc-4364-8478-e73a174e9aed None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:00.064262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da3ad6-c225-4392-b2fa-ca3b3688398c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:00.065537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da3ad6-c225-4392-b2fa-ca3b3688398c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:00.066016 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da3ad6-c225-4392-b2fa-ca3b3688398c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:00.066325 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da3ad6-c225-4392-b2fa-ca3b3688398c admin admin] PATH_INFO: `/v3/users/adf9efb3d4734a6fb386902629f991cd` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:00.069221 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da3ad6-c225-4392-b2fa-ca3b3688398c admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf9efb3d4734a6fb386902629f991cd)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:00.070607 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da3ad6-c225-4392-b2fa-ca3b3688398c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:00.148860 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-85da3ad6-c225-4392-b2fa-ca3b3688398c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf9efb3d4734a6fb386902629f991cd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:00.149620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-85da3ad6-c225-4392-b2fa-ca3b3688398c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf9efb3d4734a6fb386902629f991cd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:00.150458 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-85da3ad6-c225-4392-b2fa-ca3b3688398c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf9efb3d4734a6fb386902629f991cd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:00.162659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-85da3ad6-c225-4392-b2fa-ca3b3688398c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf9efb3d4734a6fb386902629f991cd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:00.175933 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-85da3ad6-c225-4392-b2fa-ca3b3688398c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf9efb3d4734a6fb386902629f991cd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:00.193051 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1099/2182] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:06:59 2022] DELETE /identity/v3/users/adf9efb3d4734a6fb386902629f991cd => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:00.195754 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14dcf9b-ed8c-4c79-ac07-b5f0b3f00cf9 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:00.197218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f14dcf9b-ed8c-4c79-ac07-b5f0b3f00cf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:00.197498 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39206e73-4fc0-4d4f-9525-ed3ef0bccfe9 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:00.197925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39206e73-4fc0-4d4f-9525-ed3ef0bccfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:00.198345 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39206e73-4fc0-4d4f-9525-ed3ef0bccfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:00.209943 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14dcf9b-ed8c-4c79-ac07-b5f0b3f00cf9 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:00.222783 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-39206e73-4fc0-4d4f-9525-ed3ef0bccfe9 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:00.224350 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-39206e73-4fc0-4d4f-9525-ed3ef0bccfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:00.260871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b439482-318c-44dd-a9bb-b8b4c40479b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:00.261541 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b439482-318c-44dd-a9bb-b8b4c40479b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:00.261894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b439482-318c-44dd-a9bb-b8b4c40479b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:00.262232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b439482-318c-44dd-a9bb-b8b4c40479b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:00.264127 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5b439482-318c-44dd-a9bb-b8b4c40479b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:00.288784 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1100/2183] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:07:00.303522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39206e73-4fc0-4d4f-9525-ed3ef0bccfe9 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:00.305190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-39206e73-4fc0-4d4f-9525-ed3ef0bccfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:00.338506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b439482-318c-44dd-a9bb-b8b4c40479b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:00.340406 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b439482-318c-44dd-a9bb-b8b4c40479b3 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:00.351758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1084/2184] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:00 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:00.373710 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39206e73-4fc0-4d4f-9525-ed3ef0bccfe9 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:00.377580 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc25e6-3335-48e6-8d56-7a2112340358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:00.378481 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc25e6-3335-48e6-8d56-7a2112340358 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:00.380739 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc25e6-3335-48e6-8d56-7a2112340358 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:00.380739 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc25e6-3335-48e6-8d56-7a2112340358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:00.391112 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc25e6-3335-48e6-8d56-7a2112340358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:00.392713 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc25e6-3335-48e6-8d56-7a2112340358 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:00.404767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1101/2185] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:00.745686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b439482-318c-44dd-a9bb-b8b4c40479b3 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:00.747283 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5b439482-318c-44dd-a9bb-b8b4c40479b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:00.764432 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b439482-318c-44dd-a9bb-b8b4c40479b3 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:00.769492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24083cf-ef75-405c-a42a-212057b0501b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:00.770683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24083cf-ef75-405c-a42a-212057b0501b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:00.771035 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24083cf-ef75-405c-a42a-212057b0501b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:00.771605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24083cf-ef75-405c-a42a-212057b0501b admin admin] PATH_INFO: `/v3/projects/241e12f995e14eb9b6b7b225d93f41f3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:00.773296 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24083cf-ef75-405c-a42a-212057b0501b admin admin] RBAC: Authorizing `identity:delete_project(project_id=241e12f995e14eb9b6b7b225d93f41f3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:00.775329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24083cf-ef75-405c-a42a-212057b0501b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:00.827927 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f24083cf-ef75-405c-a42a-212057b0501b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241e12f995e14eb9b6b7b225d93f41f3', 'request_id': 'req-f24083cf-ef75-405c-a42a-212057b0501b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:00.835808 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f24083cf-ef75-405c-a42a-212057b0501b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241e12f995e14eb9b6b7b225d93f41f3', 'request_id': 'req-f24083cf-ef75-405c-a42a-212057b0501b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:00.842294 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f24083cf-ef75-405c-a42a-212057b0501b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241e12f995e14eb9b6b7b225d93f41f3', 'request_id': 'req-f24083cf-ef75-405c-a42a-212057b0501b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:00.854240 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f24083cf-ef75-405c-a42a-212057b0501b admin admin] The token cache is being invalidate because project 241e12f995e14eb9b6b7b225d93f41f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:00.854590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f24083cf-ef75-405c-a42a-212057b0501b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:00.855191 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f24083cf-ef75-405c-a42a-212057b0501b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:00.857022 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1085/2186] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:00 2022] DELETE /identity/v3/projects/241e12f995e14eb9b6b7b225d93f41f3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:00.869020 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bf704-7580-466c-bced-7e3ec1c3cc21 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:00.869403 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bf704-7580-466c-bced-7e3ec1c3cc21 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:00.869689 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bf704-7580-466c-bced-7e3ec1c3cc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:00.888849 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-400bf704-7580-466c-bced-7e3ec1c3cc21 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:00.890333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-400bf704-7580-466c-bced-7e3ec1c3cc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:00.959583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1102/2187] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:00.967416 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a140d54-a644-4a92-b3bd-62588ca15597 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:00.967710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a140d54-a644-4a92-b3bd-62588ca15597 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:00.968018 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a140d54-a644-4a92-b3bd-62588ca15597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:00.987815 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5a140d54-a644-4a92-b3bd-62588ca15597 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:00.989046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5a140d54-a644-4a92-b3bd-62588ca15597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:00.997150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1086/2188] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:01.001401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bf704-7580-466c-bced-7e3ec1c3cc21 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:01.011685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bf704-7580-466c-bced-7e3ec1c3cc21 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:01.016307 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e2e2c-e842-4ee1-bce5-a41732cef044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:01.016930 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e2e2c-e842-4ee1-bce5-a41732cef044 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:01.017211 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e2e2c-e842-4ee1-bce5-a41732cef044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:01.017484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e2e2c-e842-4ee1-bce5-a41732cef044 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:01.018201 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e2e2c-e842-4ee1-bce5-a41732cef044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:07:01.018506 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e2e2c-e842-4ee1-bce5-a41732cef044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:01.020105 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e2e2c-e842-4ee1-bce5-a41732cef044 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:01.031646 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1103/2189] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 05:07:01.035789 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a140d54-a644-4a92-b3bd-62588ca15597 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:01.045201 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a140d54-a644-4a92-b3bd-62588ca15597 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:01.049829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7232b24-c676-4cf7-a023-3954204cea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:01.050487 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7232b24-c676-4cf7-a023-3954204cea84 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:01.050751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7232b24-c676-4cf7-a023-3954204cea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:01.051027 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7232b24-c676-4cf7-a023-3954204cea84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:01.051834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7232b24-c676-4cf7-a023-3954204cea84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:01.053778 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7232b24-c676-4cf7-a023-3954204cea84 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:01.081947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1087/2190] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:01 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:01.086557 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e2e2c-e842-4ee1-bce5-a41732cef044 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:01.096255 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e2e2c-e842-4ee1-bce5-a41732cef044 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:01.150868 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15495b9-45f5-4eae-a86a-8209f414ac5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:01.151534 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15495b9-45f5-4eae-a86a-8209f414ac5c admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:01.151827 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15495b9-45f5-4eae-a86a-8209f414ac5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:01.152369 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15495b9-45f5-4eae-a86a-8209f414ac5c admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:01.153083 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15495b9-45f5-4eae-a86a-8209f414ac5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:01.155008 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15495b9-45f5-4eae-a86a-8209f414ac5c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:01.175830 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1104/2191] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:01 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:07:01.179907 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7232b24-c676-4cf7-a023-3954204cea84 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:01.190075 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7232b24-c676-4cf7-a023-3954204cea84 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:01.195436 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2cb72-1c2a-4dbd-8327-8934da0e7702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:01.196093 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2cb72-1c2a-4dbd-8327-8934da0e7702 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:01.196383 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2cb72-1c2a-4dbd-8327-8934da0e7702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:01.196736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2cb72-1c2a-4dbd-8327-8934da0e7702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:01.197584 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2cb72-1c2a-4dbd-8327-8934da0e7702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:01.199265 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2cb72-1c2a-4dbd-8327-8934da0e7702 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:01.210416 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1088/2192] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:01.214608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15495b9-45f5-4eae-a86a-8209f414ac5c admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:01.224609 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15495b9-45f5-4eae-a86a-8209f414ac5c admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:01.229217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f440460-bfd4-4d39-9e44-25b5c5905d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:01.230034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f440460-bfd4-4d39-9e44-25b5c5905d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:01.230314 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f440460-bfd4-4d39-9e44-25b5c5905d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:01.230760 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f440460-bfd4-4d39-9e44-25b5c5905d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:01.231640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f440460-bfd4-4d39-9e44-25b5c5905d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:01.233572 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f440460-bfd4-4d39-9e44-25b5c5905d71 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:01.246020 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1105/2193] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:01.249219 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2cb72-1c2a-4dbd-8327-8934da0e7702 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:01.261095 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2cb72-1c2a-4dbd-8327-8934da0e7702 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:01.265894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c1268-5333-4c89-9b03-744574aeecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:01.266830 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1268-5333-4c89-9b03-744574aeecd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:01.267039 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1268-5333-4c89-9b03-744574aeecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:01.267309 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c1268-5333-4c89-9b03-744574aeecd3 admin admin] PATH_INFO: `/v3/projects/d1ecad46c8144051a9b4125f7f169267/users/c9bc1cd2f6fc4cb2bcb02d80b3e9a54b/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:01.283642 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c1268-5333-4c89-9b03-744574aeecd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1ecad46c8144051a9b4125f7f169267, user_id=c9bc1cd2f6fc4cb2bcb02d80b3e9a54b, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:01.287302 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c1268-5333-4c89-9b03-744574aeecd3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:01.302850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1089/2194] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:01 2022] PUT /identity/v3/projects/d1ecad46c8144051a9b4125f7f169267/users/c9bc1cd2f6fc4cb2bcb02d80b3e9a54b/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:01.314105 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6fce8-d3e0-499e-a5a0-06026c46c1f6 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:01.314577 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6fce8-d3e0-499e-a5a0-06026c46c1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:01.314685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6fce8-d3e0-499e-a5a0-06026c46c1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:01.342735 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e9e6fce8-d3e0-499e-a5a0-06026c46c1f6 None None] MFA Rules not processed for user `c9bc1cd2f6fc4cb2bcb02d80b3e9a54b`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:01.343964 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e9e6fce8-d3e0-499e-a5a0-06026c46c1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:01.408902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1106/2195] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:07:01.420624 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c1268-5333-4c89-9b03-744574aeecd3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:01.422918 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5f3c1268-5333-4c89-9b03-744574aeecd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:01.482107 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c1268-5333-4c89-9b03-744574aeecd3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:01.485969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630c615-3b67-475a-84f1-f8e197e82d23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:01.486604 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c615-3b67-475a-84f1-f8e197e82d23 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:01.486881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c615-3b67-475a-84f1-f8e197e82d23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:01.487153 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c615-3b67-475a-84f1-f8e197e82d23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:01.496593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630c615-3b67-475a-84f1-f8e197e82d23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:01.498054 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630c615-3b67-475a-84f1-f8e197e82d23 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:01.507693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1090/2196] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:03.528923 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6fce8-d3e0-499e-a5a0-06026c46c1f6 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:03.530330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e9e6fce8-d3e0-499e-a5a0-06026c46c1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:03.593405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6fce8-d3e0-499e-a5a0-06026c46c1f6 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:03.597962 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577af1b-4e43-44b6-b84b-4de6c9b42a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:03.598873 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577af1b-4e43-44b6-b84b-4de6c9b42a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:03.599151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577af1b-4e43-44b6-b84b-4de6c9b42a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:03.599422 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577af1b-4e43-44b6-b84b-4de6c9b42a39 admin admin] PATH_INFO: `/v3/users/4b23075a6f214cbc83667b44bb1b9c2d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:03.600686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577af1b-4e43-44b6-b84b-4de6c9b42a39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b23075a6f214cbc83667b44bb1b9c2d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:03.602621 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577af1b-4e43-44b6-b84b-4de6c9b42a39 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:03.651781 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f577af1b-4e43-44b6-b84b-4de6c9b42a39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b23075a6f214cbc83667b44bb1b9c2d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:03.652455 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f577af1b-4e43-44b6-b84b-4de6c9b42a39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b23075a6f214cbc83667b44bb1b9c2d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:03.653141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f577af1b-4e43-44b6-b84b-4de6c9b42a39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b23075a6f214cbc83667b44bb1b9c2d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:03.660966 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f577af1b-4e43-44b6-b84b-4de6c9b42a39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b23075a6f214cbc83667b44bb1b9c2d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:03.675427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f577af1b-4e43-44b6-b84b-4de6c9b42a39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b23075a6f214cbc83667b44bb1b9c2d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:03.687745 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1107/2197] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:03 2022] DELETE /identity/v3/users/4b23075a6f214cbc83667b44bb1b9c2d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:03.693119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b3584-4c48-4484-b06d-a2ed5d427177 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:03.693576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b3584-4c48-4484-b06d-a2ed5d427177 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:03.693668 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b3584-4c48-4484-b06d-a2ed5d427177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:03.711634 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e93b3584-4c48-4484-b06d-a2ed5d427177 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:03.712887 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e93b3584-4c48-4484-b06d-a2ed5d427177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:03.772837 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1091/2198] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:03.782403 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577af1b-4e43-44b6-b84b-4de6c9b42a39 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:03.783798 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f577af1b-4e43-44b6-b84b-4de6c9b42a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:03.840777 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577af1b-4e43-44b6-b84b-4de6c9b42a39 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:03.844546 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d367504-a55f-44c7-a1b9-66ec40f1ef79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:03.845261 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d367504-a55f-44c7-a1b9-66ec40f1ef79 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:03.845539 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d367504-a55f-44c7-a1b9-66ec40f1ef79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:03.845808 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d367504-a55f-44c7-a1b9-66ec40f1ef79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:03.855039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d367504-a55f-44c7-a1b9-66ec40f1ef79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:03.856803 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d367504-a55f-44c7-a1b9-66ec40f1ef79 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:03.868429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1108/2199] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:04.146109 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b3584-4c48-4484-b06d-a2ed5d427177 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:04.147605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e93b3584-4c48-4484-b06d-a2ed5d427177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:04.161213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b3584-4c48-4484-b06d-a2ed5d427177 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:04.166173 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10baeaf-d513-4060-b1cd-354766aa7069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:04.167032 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10baeaf-d513-4060-b1cd-354766aa7069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:04.167305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10baeaf-d513-4060-b1cd-354766aa7069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:04.167576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10baeaf-d513-4060-b1cd-354766aa7069 admin admin] PATH_INFO: `/v3/projects/1b540d8cad814eb59c99ee3993553fc1` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:04.168743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10baeaf-d513-4060-b1cd-354766aa7069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b540d8cad814eb59c99ee3993553fc1)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:04.170915 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10baeaf-d513-4060-b1cd-354766aa7069 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:04.218125 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e10baeaf-d513-4060-b1cd-354766aa7069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b540d8cad814eb59c99ee3993553fc1', 'request_id': 'req-e10baeaf-d513-4060-b1cd-354766aa7069'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:04.226477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e10baeaf-d513-4060-b1cd-354766aa7069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b540d8cad814eb59c99ee3993553fc1', 'request_id': 'req-e10baeaf-d513-4060-b1cd-354766aa7069'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:04.232535 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e10baeaf-d513-4060-b1cd-354766aa7069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b540d8cad814eb59c99ee3993553fc1', 'request_id': 'req-e10baeaf-d513-4060-b1cd-354766aa7069'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:04.242587 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e10baeaf-d513-4060-b1cd-354766aa7069 admin admin] The token cache is being invalidate because project 1b540d8cad814eb59c99ee3993553fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:04.242869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e10baeaf-d513-4060-b1cd-354766aa7069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:04.243494 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e10baeaf-d513-4060-b1cd-354766aa7069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:04.245331 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1092/2200] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:04 2022] DELETE /identity/v3/projects/1b540d8cad814eb59c99ee3993553fc1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:04.249407 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d367504-a55f-44c7-a1b9-66ec40f1ef79 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:04.259881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d367504-a55f-44c7-a1b9-66ec40f1ef79 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:04.321259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d59d1c-a279-43aa-8b82-82282ada1610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:04.322148 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d59d1c-a279-43aa-8b82-82282ada1610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:04.322461 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d59d1c-a279-43aa-8b82-82282ada1610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:04.322740 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d59d1c-a279-43aa-8b82-82282ada1610 admin admin] PATH_INFO: `/v3/users/129ecd28320d4e15a8d9985ceac5d012` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:04.323990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d59d1c-a279-43aa-8b82-82282ada1610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=129ecd28320d4e15a8d9985ceac5d012)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:04.325983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d59d1c-a279-43aa-8b82-82282ada1610 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:04.372175 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-54d59d1c-a279-43aa-8b82-82282ada1610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '129ecd28320d4e15a8d9985ceac5d012'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:04.372840 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-54d59d1c-a279-43aa-8b82-82282ada1610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '129ecd28320d4e15a8d9985ceac5d012'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:04.373439 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-54d59d1c-a279-43aa-8b82-82282ada1610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '129ecd28320d4e15a8d9985ceac5d012'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:04.381559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-54d59d1c-a279-43aa-8b82-82282ada1610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '129ecd28320d4e15a8d9985ceac5d012'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:04.393292 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-54d59d1c-a279-43aa-8b82-82282ada1610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '129ecd28320d4e15a8d9985ceac5d012'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:04.406447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1109/2201] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:04 2022] DELETE /identity/v3/users/129ecd28320d4e15a8d9985ceac5d012 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:04.682158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10baeaf-d513-4060-b1cd-354766aa7069 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:04.683624 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e10baeaf-d513-4060-b1cd-354766aa7069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:04.703137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10baeaf-d513-4060-b1cd-354766aa7069 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:04.772024 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdc574-f0f3-4ac8-af7b-18ffee01486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:04.772940 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdc574-f0f3-4ac8-af7b-18ffee01486c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:04.773224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdc574-f0f3-4ac8-af7b-18ffee01486c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:04.773496 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdc574-f0f3-4ac8-af7b-18ffee01486c admin admin] PATH_INFO: `/v3/projects/23c9e65fd5e84d5bb12983adb9b82542` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:04.774738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdc574-f0f3-4ac8-af7b-18ffee01486c admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c9e65fd5e84d5bb12983adb9b82542)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:04.776661 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdc574-f0f3-4ac8-af7b-18ffee01486c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:04.823025 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1ecdc574-f0f3-4ac8-af7b-18ffee01486c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c9e65fd5e84d5bb12983adb9b82542', 'request_id': 'req-1ecdc574-f0f3-4ac8-af7b-18ffee01486c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:04.831026 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1ecdc574-f0f3-4ac8-af7b-18ffee01486c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c9e65fd5e84d5bb12983adb9b82542', 'request_id': 'req-1ecdc574-f0f3-4ac8-af7b-18ffee01486c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:04.837825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1ecdc574-f0f3-4ac8-af7b-18ffee01486c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c9e65fd5e84d5bb12983adb9b82542', 'request_id': 'req-1ecdc574-f0f3-4ac8-af7b-18ffee01486c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:04.847968 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1ecdc574-f0f3-4ac8-af7b-18ffee01486c admin admin] The token cache is being invalidate because project 23c9e65fd5e84d5bb12983adb9b82542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:04.848255 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1ecdc574-f0f3-4ac8-af7b-18ffee01486c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:04.848956 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1ecdc574-f0f3-4ac8-af7b-18ffee01486c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:04.850472 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1093/2202] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:04 2022] DELETE /identity/v3/projects/23c9e65fd5e84d5bb12983adb9b82542 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:04.856420 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17091ccb-3b39-4851-8b52-13cba291af05 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:04.856912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17091ccb-3b39-4851-8b52-13cba291af05 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:04.857001 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17091ccb-3b39-4851-8b52-13cba291af05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:04.875985 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-17091ccb-3b39-4851-8b52-13cba291af05 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:04.877225 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-17091ccb-3b39-4851-8b52-13cba291af05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:04.935093 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1110/2203] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:04.945617 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49df82-0428-476e-a520-f8cc49568a08 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:04.945904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49df82-0428-476e-a520-f8cc49568a08 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:04.946180 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49df82-0428-476e-a520-f8cc49568a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:04.965156 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0f49df82-0428-476e-a520-f8cc49568a08 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:04.966354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0f49df82-0428-476e-a520-f8cc49568a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:04.976313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1094/2204] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:04.980584 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17091ccb-3b39-4851-8b52-13cba291af05 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:04.991567 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17091ccb-3b39-4851-8b52-13cba291af05 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:04.996271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce8bb9-1e84-468f-8603-7f33b644c09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:04.996973 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8bb9-1e84-468f-8603-7f33b644c09c admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:04.997254 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8bb9-1e84-468f-8603-7f33b644c09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:04.997528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8bb9-1e84-468f-8603-7f33b644c09c admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:04.998250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce8bb9-1e84-468f-8603-7f33b644c09c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:07:04.998556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce8bb9-1e84-468f-8603-7f33b644c09c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:05.000165 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce8bb9-1e84-468f-8603-7f33b644c09c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:05.012834 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1111/2205] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 05:07:05.017237 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49df82-0428-476e-a520-f8cc49568a08 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:05.027323 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49df82-0428-476e-a520-f8cc49568a08 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:05.035335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be9b2d-f534-4055-9e6f-45d133b72f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:05.036144 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be9b2d-f534-4055-9e6f-45d133b72f84 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:05.036577 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be9b2d-f534-4055-9e6f-45d133b72f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:05.037121 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be9b2d-f534-4055-9e6f-45d133b72f84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:05.038402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be9b2d-f534-4055-9e6f-45d133b72f84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:05.040328 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5be9b2d-f534-4055-9e6f-45d133b72f84 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:05.066946 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1095/2206] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:05 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:05.071812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce8bb9-1e84-468f-8603-7f33b644c09c admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:05.081988 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce8bb9-1e84-468f-8603-7f33b644c09c admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:05.140551 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd305e46-9760-41c2-af17-076847f71c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:05.141298 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd305e46-9760-41c2-af17-076847f71c8d admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:05.141612 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd305e46-9760-41c2-af17-076847f71c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:05.142046 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd305e46-9760-41c2-af17-076847f71c8d admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:05.142935 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd305e46-9760-41c2-af17-076847f71c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:05.144944 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd305e46-9760-41c2-af17-076847f71c8d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:05.165661 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1112/2207] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:05 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:07:05.171295 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be9b2d-f534-4055-9e6f-45d133b72f84 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:05.182113 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be9b2d-f534-4055-9e6f-45d133b72f84 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:05.186801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ba8de-f54b-4d3b-858b-e2cb169fd82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:05.187465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ba8de-f54b-4d3b-858b-e2cb169fd82e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:05.187757 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ba8de-f54b-4d3b-858b-e2cb169fd82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:05.188038 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ba8de-f54b-4d3b-858b-e2cb169fd82e admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:05.188771 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ba8de-f54b-4d3b-858b-e2cb169fd82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:05.190400 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ba8de-f54b-4d3b-858b-e2cb169fd82e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:05.201743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1096/2208] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:07:05.208098 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd305e46-9760-41c2-af17-076847f71c8d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:05.218755 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd305e46-9760-41c2-af17-076847f71c8d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:05.223542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f963fa7-7ad3-4754-a12b-50baf5cc963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:05.224417 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f963fa7-7ad3-4754-a12b-50baf5cc963f admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:05.224705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f963fa7-7ad3-4754-a12b-50baf5cc963f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:05.225010 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f963fa7-7ad3-4754-a12b-50baf5cc963f admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:05.225913 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f963fa7-7ad3-4754-a12b-50baf5cc963f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:05.227328 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f963fa7-7ad3-4754-a12b-50baf5cc963f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:05.241088 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1113/2209] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:05.242361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ba8de-f54b-4d3b-858b-e2cb169fd82e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:05.252217 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ba8de-f54b-4d3b-858b-e2cb169fd82e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:05.258166 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a7071-6837-4d94-b274-744156a7f252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:05.259066 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a7071-6837-4d94-b274-744156a7f252 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:05.259349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a7071-6837-4d94-b274-744156a7f252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:05.259629 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a7071-6837-4d94-b274-744156a7f252 admin admin] PATH_INFO: `/v3/projects/97c9441584e04f0e957db3201caa80a8/users/70081fc16c444dc8b1df9a734e55d1a0/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:05.275214 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a7071-6837-4d94-b274-744156a7f252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c9441584e04f0e957db3201caa80a8, user_id=70081fc16c444dc8b1df9a734e55d1a0, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:05.277972 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a7071-6837-4d94-b274-744156a7f252 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:05.295398 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1097/2210] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:05 2022] PUT /identity/v3/projects/97c9441584e04f0e957db3201caa80a8/users/70081fc16c444dc8b1df9a734e55d1a0/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:05.308590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e91b85-3080-4859-9f42-a5648b21fc5f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:05.309002 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e91b85-3080-4859-9f42-a5648b21fc5f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:05.309289 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e91b85-3080-4859-9f42-a5648b21fc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:05.338226 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-61e91b85-3080-4859-9f42-a5648b21fc5f None None] MFA Rules not processed for user `70081fc16c444dc8b1df9a734e55d1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:05.339436 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-61e91b85-3080-4859-9f42-a5648b21fc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:05.406121 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1114/2211] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:05.410610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a7071-6837-4d94-b274-744156a7f252 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:05.472874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a7071-6837-4d94-b274-744156a7f252 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:05.478265 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df34aac-f2b9-4253-ade6-8844beef0533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:05.478923 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df34aac-f2b9-4253-ade6-8844beef0533 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:05.479207 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df34aac-f2b9-4253-ade6-8844beef0533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:05.479485 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df34aac-f2b9-4253-ade6-8844beef0533 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:05.480193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df34aac-f2b9-4253-ade6-8844beef0533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:05.482151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df34aac-f2b9-4253-ade6-8844beef0533 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:05.510830 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1098/2212] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:05 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:05.514985 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e91b85-3080-4859-9f42-a5648b21fc5f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:05.526446 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e91b85-3080-4859-9f42-a5648b21fc5f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:05.582519 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c502c4d-011a-4e95-b979-3ea328a15598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:05.583764 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c502c4d-011a-4e95-b979-3ea328a15598 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:05.584100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c502c4d-011a-4e95-b979-3ea328a15598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:05.584327 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c502c4d-011a-4e95-b979-3ea328a15598 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:05.585124 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c502c4d-011a-4e95-b979-3ea328a15598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:05.587058 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c502c4d-011a-4e95-b979-3ea328a15598 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:05.607151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1115/2213] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:05 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:05.611324 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df34aac-f2b9-4253-ade6-8844beef0533 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:05.622232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df34aac-f2b9-4253-ade6-8844beef0533 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:05.626858 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e816d20-4230-4aed-94c2-7d1b7db6dd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:05.627511 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e816d20-4230-4aed-94c2-7d1b7db6dd98 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:05.627792 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e816d20-4230-4aed-94c2-7d1b7db6dd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:05.628064 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e816d20-4230-4aed-94c2-7d1b7db6dd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:05.629091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e816d20-4230-4aed-94c2-7d1b7db6dd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:05.631231 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e816d20-4230-4aed-94c2-7d1b7db6dd98 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:05.641629 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1099/2214] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:05.646804 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c502c4d-011a-4e95-b979-3ea328a15598 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:05.656951 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c502c4d-011a-4e95-b979-3ea328a15598 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:05.661597 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cecf270-50bd-4b7c-ae5b-37f9a6a5eecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:05.662244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecf270-50bd-4b7c-ae5b-37f9a6a5eecb admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:05.662526 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecf270-50bd-4b7c-ae5b-37f9a6a5eecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:05.662801 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecf270-50bd-4b7c-ae5b-37f9a6a5eecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:05.663523 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cecf270-50bd-4b7c-ae5b-37f9a6a5eecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:05.665160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cecf270-50bd-4b7c-ae5b-37f9a6a5eecb admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:05.674737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1116/2215] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:07:05.679081 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e816d20-4230-4aed-94c2-7d1b7db6dd98 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:05.688770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e816d20-4230-4aed-94c2-7d1b7db6dd98 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:05.694483 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085300c4-150e-443c-aeec-6d01498a0d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:05.695349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085300c4-150e-443c-aeec-6d01498a0d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:05.695622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085300c4-150e-443c-aeec-6d01498a0d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:05.695890 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085300c4-150e-443c-aeec-6d01498a0d2a admin admin] PATH_INFO: `/v3/projects/a57ed6c2ac184360ae98d9f27a09ec54/users/b36be791683c4fb08f41962442a5ee8e/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:05.710783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085300c4-150e-443c-aeec-6d01498a0d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a57ed6c2ac184360ae98d9f27a09ec54, user_id=b36be791683c4fb08f41962442a5ee8e, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:05.713538 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085300c4-150e-443c-aeec-6d01498a0d2a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:05.728340 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1100/2216] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:05 2022] PUT /identity/v3/projects/a57ed6c2ac184360ae98d9f27a09ec54/users/b36be791683c4fb08f41962442a5ee8e/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:05.738818 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2245c-8e31-4c28-a553-d0828f3f2b53 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:05.739142 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2245c-8e31-4c28-a553-d0828f3f2b53 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:05.739428 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2245c-8e31-4c28-a553-d0828f3f2b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:05.768223 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9dd2245c-8e31-4c28-a553-d0828f3f2b53 None None] MFA Rules not processed for user `b36be791683c4fb08f41962442a5ee8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:05.769537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9dd2245c-8e31-4c28-a553-d0828f3f2b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:05.836489 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1117/2217] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:05.841028 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085300c4-150e-443c-aeec-6d01498a0d2a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:05.906419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085300c4-150e-443c-aeec-6d01498a0d2a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:05.914177 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95e756-5848-4bf5-90f5-147ce1d79df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:05.914859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95e756-5848-4bf5-90f5-147ce1d79df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:05.915158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95e756-5848-4bf5-90f5-147ce1d79df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:05.915426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95e756-5848-4bf5-90f5-147ce1d79df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:05.916134 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95e756-5848-4bf5-90f5-147ce1d79df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:05.918137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95e756-5848-4bf5-90f5-147ce1d79df8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:05.945758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1101/2218] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:05 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:05.950820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2245c-8e31-4c28-a553-d0828f3f2b53 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:05.962315 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2245c-8e31-4c28-a553-d0828f3f2b53 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:06.019536 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5667e3-add2-4cec-b8cc-3d36d0774cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:06.020206 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5667e3-add2-4cec-b8cc-3d36d0774cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:06.020544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5667e3-add2-4cec-b8cc-3d36d0774cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:06.020912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5667e3-add2-4cec-b8cc-3d36d0774cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:06.021609 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5667e3-add2-4cec-b8cc-3d36d0774cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:06.023547 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5667e3-add2-4cec-b8cc-3d36d0774cd7 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:06.043245 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1118/2219] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:05 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:06.047245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95e756-5848-4bf5-90f5-147ce1d79df8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:06.057944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95e756-5848-4bf5-90f5-147ce1d79df8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:06.062545 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058db5e-8f89-4f76-9824-6983b1934da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:06.063193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058db5e-8f89-4f76-9824-6983b1934da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:06.063473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058db5e-8f89-4f76-9824-6983b1934da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:06.063747 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058db5e-8f89-4f76-9824-6983b1934da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:06.064468 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058db5e-8f89-4f76-9824-6983b1934da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:06.066095 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058db5e-8f89-4f76-9824-6983b1934da7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:06.076264 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1102/2220] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:06.080326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5667e3-add2-4cec-b8cc-3d36d0774cd7 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:06.090289 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5667e3-add2-4cec-b8cc-3d36d0774cd7 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:06.094859 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5408e1-685c-4195-936b-e9d91d40d8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:06.095732 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5408e1-685c-4195-936b-e9d91d40d8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:06.096012 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5408e1-685c-4195-936b-e9d91d40d8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:06.096287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5408e1-685c-4195-936b-e9d91d40d8b4 admin admin] PATH_INFO: `/v3/projects/b70928b0715e456e8ccecd7e9e27adbb/users/82a5ba471fc54fb7938c4be62dec251c/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:06.111815 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5408e1-685c-4195-936b-e9d91d40d8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70928b0715e456e8ccecd7e9e27adbb, user_id=82a5ba471fc54fb7938c4be62dec251c, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:06.115401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5408e1-685c-4195-936b-e9d91d40d8b4 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:06.130276 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1119/2221] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:06 2022] PUT /identity/v3/projects/b70928b0715e456e8ccecd7e9e27adbb/users/82a5ba471fc54fb7938c4be62dec251c/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:06.135679 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058db5e-8f89-4f76-9824-6983b1934da7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:06.146843 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058db5e-8f89-4f76-9824-6983b1934da7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:06.203101 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f34f7-2cbc-493e-8235-bdca7119375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:06.203770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f34f7-2cbc-493e-8235-bdca7119375f admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:06.204049 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f34f7-2cbc-493e-8235-bdca7119375f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:06.204327 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f34f7-2cbc-493e-8235-bdca7119375f admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:06.205088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f34f7-2cbc-493e-8235-bdca7119375f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:06.206689 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f34f7-2cbc-493e-8235-bdca7119375f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:06.216244 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1103/2222] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:07:06.221107 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5408e1-685c-4195-936b-e9d91d40d8b4 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:06.232393 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5408e1-685c-4195-936b-e9d91d40d8b4 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:06.237098 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e9685-1529-4ec8-9b85-ece5cfabf143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:06.237982 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e9685-1529-4ec8-9b85-ece5cfabf143 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:06.238260 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e9685-1529-4ec8-9b85-ece5cfabf143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:06.238539 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e9685-1529-4ec8-9b85-ece5cfabf143 admin admin] PATH_INFO: `/v3/projects/b70928b0715e456e8ccecd7e9e27adbb/users/82a5ba471fc54fb7938c4be62dec251c/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:06.241456 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e9685-1529-4ec8-9b85-ece5cfabf143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70928b0715e456e8ccecd7e9e27adbb, user_id=82a5ba471fc54fb7938c4be62dec251c, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:06.244164 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e9685-1529-4ec8-9b85-ece5cfabf143 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:06.254471 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1120/2223] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:06 2022] PUT /identity/v3/projects/b70928b0715e456e8ccecd7e9e27adbb/users/82a5ba471fc54fb7938c4be62dec251c/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:06.266500 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9d2ba-5a2c-4fe1-82a5-1d2f56ba5c2d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:06.266793 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9d2ba-5a2c-4fe1-82a5-1d2f56ba5c2d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:06.267074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9d2ba-5a2c-4fe1-82a5-1d2f56ba5c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:06.293053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-fee9d2ba-5a2c-4fe1-82a5-1d2f56ba5c2d None None] MFA Rules not processed for user `82a5ba471fc54fb7938c4be62dec251c`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:06.294258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fee9d2ba-5a2c-4fe1-82a5-1d2f56ba5c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:06.363689 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1104/2224] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:06.376371 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e9685-1529-4ec8-9b85-ece5cfabf143 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:06.378161 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e67e9685-1529-4ec8-9b85-ece5cfabf143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:06.450636 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e9685-1529-4ec8-9b85-ece5cfabf143 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:06.455249 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d01c7-67ac-484a-b15e-382a0818d954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:06.456039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d01c7-67ac-484a-b15e-382a0818d954 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:06.456388 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d01c7-67ac-484a-b15e-382a0818d954 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:06.456931 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d01c7-67ac-484a-b15e-382a0818d954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:06.517742 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d01c7-67ac-484a-b15e-382a0818d954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:06.519184 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d01c7-67ac-484a-b15e-382a0818d954 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:06.528115 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1121/2225] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:07.706706 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9d2ba-5a2c-4fe1-82a5-1d2f56ba5c2d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:07.708719 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fee9d2ba-5a2c-4fe1-82a5-1d2f56ba5c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:07.794788 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9d2ba-5a2c-4fe1-82a5-1d2f56ba5c2d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:07.800637 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac32b1-afd1-4485-9ea8-b260889c3a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:07.801636 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac32b1-afd1-4485-9ea8-b260889c3a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:07.802014 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac32b1-afd1-4485-9ea8-b260889c3a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:07.802499 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac32b1-afd1-4485-9ea8-b260889c3a4a admin admin] PATH_INFO: `/v3/users/b1f94a49f7fe4116be1f0ad329bcd324` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:07.803837 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac32b1-afd1-4485-9ea8-b260889c3a4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f94a49f7fe4116be1f0ad329bcd324)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:07.805834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac32b1-afd1-4485-9ea8-b260889c3a4a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:07.853871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-79ac32b1-afd1-4485-9ea8-b260889c3a4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f94a49f7fe4116be1f0ad329bcd324'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:07.854553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-79ac32b1-afd1-4485-9ea8-b260889c3a4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f94a49f7fe4116be1f0ad329bcd324'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:07.855177 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-79ac32b1-afd1-4485-9ea8-b260889c3a4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f94a49f7fe4116be1f0ad329bcd324'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:07.863490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-79ac32b1-afd1-4485-9ea8-b260889c3a4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f94a49f7fe4116be1f0ad329bcd324'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:07.876044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-79ac32b1-afd1-4485-9ea8-b260889c3a4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f94a49f7fe4116be1f0ad329bcd324'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:07.892991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1105/2226] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:07 2022] DELETE /identity/v3/users/b1f94a49f7fe4116be1f0ad329bcd324 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:07.894660 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2d7f5-40a9-4fe3-9cc1-d3fe13b6c7ad None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:07.895150 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2d7f5-40a9-4fe3-9cc1-d3fe13b6c7ad None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:07.895290 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2d7f5-40a9-4fe3-9cc1-d3fe13b6c7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:07.914164 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f5b2d7f5-40a9-4fe3-9cc1-d3fe13b6c7ad None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:07.915451 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f5b2d7f5-40a9-4fe3-9cc1-d3fe13b6c7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:07.977815 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1122/2227] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:07.987719 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac32b1-afd1-4485-9ea8-b260889c3a4a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:07.989196 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-79ac32b1-afd1-4485-9ea8-b260889c3a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:08.046734 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac32b1-afd1-4485-9ea8-b260889c3a4a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:08.050393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f994ce-0568-4e7f-8dae-52e3d73a05c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:08.051033 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f994ce-0568-4e7f-8dae-52e3d73a05c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:08.051310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f994ce-0568-4e7f-8dae-52e3d73a05c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:08.053253 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f994ce-0568-4e7f-8dae-52e3d73a05c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:08.060495 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2d7f5-40a9-4fe3-9cc1-d3fe13b6c7ad None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:08.061996 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f5b2d7f5-40a9-4fe3-9cc1-d3fe13b6c7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:08.062861 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f994ce-0568-4e7f-8dae-52e3d73a05c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:08.064297 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f994ce-0568-4e7f-8dae-52e3d73a05c9 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:08.074005 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1106/2228] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:08.123721 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2d7f5-40a9-4fe3-9cc1-d3fe13b6c7ad None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:08.128039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566c2c1-3121-464b-8eb5-a66699647aac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:08.128990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566c2c1-3121-464b-8eb5-a66699647aac service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:08.129272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566c2c1-3121-464b-8eb5-a66699647aac service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:08.129571 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566c2c1-3121-464b-8eb5-a66699647aac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:08.131411 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a566c2c1-3121-464b-8eb5-a66699647aac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:08.191633 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566c2c1-3121-464b-8eb5-a66699647aac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:08.193173 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566c2c1-3121-464b-8eb5-a66699647aac service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:08.202080 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1123/2229] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:07:08.346135 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f994ce-0568-4e7f-8dae-52e3d73a05c9 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:08.347803 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-06f994ce-0568-4e7f-8dae-52e3d73a05c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:08.363917 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f994ce-0568-4e7f-8dae-52e3d73a05c9 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:08.369824 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa02607-626a-4fb0-a080-ff360b0e13cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:08.371930 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa02607-626a-4fb0-a080-ff360b0e13cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:08.372356 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa02607-626a-4fb0-a080-ff360b0e13cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:08.372756 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa02607-626a-4fb0-a080-ff360b0e13cb admin admin] PATH_INFO: `/v3/projects/7591e7b98a754b4fb9e7f3e679d2bb17` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:08.374175 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa02607-626a-4fb0-a080-ff360b0e13cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7591e7b98a754b4fb9e7f3e679d2bb17)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:08.376623 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa02607-626a-4fb0-a080-ff360b0e13cb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:08.427331 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1aa02607-626a-4fb0-a080-ff360b0e13cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7591e7b98a754b4fb9e7f3e679d2bb17', 'request_id': 'req-1aa02607-626a-4fb0-a080-ff360b0e13cb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:08.434832 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1aa02607-626a-4fb0-a080-ff360b0e13cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7591e7b98a754b4fb9e7f3e679d2bb17', 'request_id': 'req-1aa02607-626a-4fb0-a080-ff360b0e13cb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:08.441236 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1aa02607-626a-4fb0-a080-ff360b0e13cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7591e7b98a754b4fb9e7f3e679d2bb17', 'request_id': 'req-1aa02607-626a-4fb0-a080-ff360b0e13cb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:08.451980 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1aa02607-626a-4fb0-a080-ff360b0e13cb admin admin] The token cache is being invalidate because project 7591e7b98a754b4fb9e7f3e679d2bb17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:08.452334 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1aa02607-626a-4fb0-a080-ff360b0e13cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:08.452951 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1aa02607-626a-4fb0-a080-ff360b0e13cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:08.454522 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1107/2230] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:08 2022] DELETE /identity/v3/projects/7591e7b98a754b4fb9e7f3e679d2bb17 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:08.460015 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f91ea-3756-469d-ba07-55ee695fe91a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:08.460303 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f91ea-3756-469d-ba07-55ee695fe91a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:08.460584 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f91ea-3756-469d-ba07-55ee695fe91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:08.478455 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-893f91ea-3756-469d-ba07-55ee695fe91a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:08.479647 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-893f91ea-3756-469d-ba07-55ee695fe91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:08.536364 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1124/2231] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:08.544026 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ac29f-1a0c-4e0b-b5bd-0f6e6c7cd505 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:08.544317 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ac29f-1a0c-4e0b-b5bd-0f6e6c7cd505 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:08.544600 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ac29f-1a0c-4e0b-b5bd-0f6e6c7cd505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:08.562874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e13ac29f-1a0c-4e0b-b5bd-0f6e6c7cd505 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:08.564059 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e13ac29f-1a0c-4e0b-b5bd-0f6e6c7cd505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:08.572402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1108/2232] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:08.576659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f91ea-3756-469d-ba07-55ee695fe91a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:08.587031 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f91ea-3756-469d-ba07-55ee695fe91a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:08.591772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8dacd-09fa-414f-b2f2-fba1443d4187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:08.592437 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8dacd-09fa-414f-b2f2-fba1443d4187 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:08.592815 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8dacd-09fa-414f-b2f2-fba1443d4187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:08.592998 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8dacd-09fa-414f-b2f2-fba1443d4187 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:08.593718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8dacd-09fa-414f-b2f2-fba1443d4187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:07:08.594026 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8dacd-09fa-414f-b2f2-fba1443d4187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:08.595615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8dacd-09fa-414f-b2f2-fba1443d4187 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:08.607215 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1125/2233] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:07:08.617465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ac29f-1a0c-4e0b-b5bd-0f6e6c7cd505 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:08.627837 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ac29f-1a0c-4e0b-b5bd-0f6e6c7cd505 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:08.633719 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c18c7-4b27-4f1d-96fc-58f180bf9f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:08.634361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c18c7-4b27-4f1d-96fc-58f180bf9f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:08.634636 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c18c7-4b27-4f1d-96fc-58f180bf9f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:08.634908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c18c7-4b27-4f1d-96fc-58f180bf9f8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:08.635636 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c18c7-4b27-4f1d-96fc-58f180bf9f8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:08.637575 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c18c7-4b27-4f1d-96fc-58f180bf9f8a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:08.663222 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1109/2234] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:08 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:07:08.667440 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8dacd-09fa-414f-b2f2-fba1443d4187 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:08.677535 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8dacd-09fa-414f-b2f2-fba1443d4187 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:08.732334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4aa4d-3608-4fcb-b418-59b3c0adf6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:08.733033 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4aa4d-3608-4fcb-b418-59b3c0adf6b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:08.733377 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4aa4d-3608-4fcb-b418-59b3c0adf6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:08.733660 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4aa4d-3608-4fcb-b418-59b3c0adf6b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:08.734697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4aa4d-3608-4fcb-b418-59b3c0adf6b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:08.736665 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4aa4d-3608-4fcb-b418-59b3c0adf6b4 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:08.762011 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1126/2235] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:08 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:08.763424 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c18c7-4b27-4f1d-96fc-58f180bf9f8a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:08.774398 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c18c7-4b27-4f1d-96fc-58f180bf9f8a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:08.779073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3750f-eae1-44aa-ba93-9375df637d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:08.779734 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3750f-eae1-44aa-ba93-9375df637d9f admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:08.780017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3750f-eae1-44aa-ba93-9375df637d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:08.780295 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3750f-eae1-44aa-ba93-9375df637d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:08.781086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3750f-eae1-44aa-ba93-9375df637d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:08.782813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3750f-eae1-44aa-ba93-9375df637d9f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:08.796308 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1110/2236] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:08.797849 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4aa4d-3608-4fcb-b418-59b3c0adf6b4 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:08.809105 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4aa4d-3608-4fcb-b418-59b3c0adf6b4 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:08.814308 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a259d-5c75-4372-844e-ad47b9bef00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:08.815279 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a259d-5c75-4372-844e-ad47b9bef00b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:08.815631 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a259d-5c75-4372-844e-ad47b9bef00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:08.816136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a259d-5c75-4372-844e-ad47b9bef00b admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:08.816898 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a259d-5c75-4372-844e-ad47b9bef00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:08.819202 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a259d-5c75-4372-844e-ad47b9bef00b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:08.830221 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1127/2237] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:08.834721 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3750f-eae1-44aa-ba93-9375df637d9f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:08.846373 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3750f-eae1-44aa-ba93-9375df637d9f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:08.851049 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c5524-0024-449c-a76a-0be855f9e4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:08.851925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c5524-0024-449c-a76a-0be855f9e4a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:08.852203 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c5524-0024-449c-a76a-0be855f9e4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:08.852473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c5524-0024-449c-a76a-0be855f9e4a9 admin admin] PATH_INFO: `/v3/projects/8855d5fa35e74bb6845ad292321747dd/users/81af6fa92a79485483e20d51c176d726/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:08.868518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c5524-0024-449c-a76a-0be855f9e4a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8855d5fa35e74bb6845ad292321747dd, user_id=81af6fa92a79485483e20d51c176d726, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:08.871269 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c5524-0024-449c-a76a-0be855f9e4a9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:08.885203 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1111/2238] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:08 2022] PUT /identity/v3/projects/8855d5fa35e74bb6845ad292321747dd/users/81af6fa92a79485483e20d51c176d726/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:08.896392 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a217b-abd8-499d-a0cd-0ed304483af3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:08.896904 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a217b-abd8-499d-a0cd-0ed304483af3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:08.897005 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a217b-abd8-499d-a0cd-0ed304483af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:08.923162 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c07a217b-abd8-499d-a0cd-0ed304483af3 None None] MFA Rules not processed for user `81af6fa92a79485483e20d51c176d726`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:08.924360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c07a217b-abd8-499d-a0cd-0ed304483af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:08.987402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1128/2239] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:08.998553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c5524-0024-449c-a76a-0be855f9e4a9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:09.000180 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d34c5524-0024-449c-a76a-0be855f9e4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:09.056020 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c5524-0024-449c-a76a-0be855f9e4a9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:09.059472 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281d40e-a600-41f1-a235-edbf500abb60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:09.060100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281d40e-a600-41f1-a235-edbf500abb60 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:09.060376 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281d40e-a600-41f1-a235-edbf500abb60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:09.060645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281d40e-a600-41f1-a235-edbf500abb60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:09.069121 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281d40e-a600-41f1-a235-edbf500abb60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:09.070540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281d40e-a600-41f1-a235-edbf500abb60 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:09.078945 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1112/2240] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:10.831720 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a217b-abd8-499d-a0cd-0ed304483af3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:10.841890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a217b-abd8-499d-a0cd-0ed304483af3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:10.845449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672b5c5-7c04-4876-a996-d9735703998b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:10.846091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672b5c5-7c04-4876-a996-d9735703998b service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:10.846376 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672b5c5-7c04-4876-a996-d9735703998b service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:10.846658 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672b5c5-7c04-4876-a996-d9735703998b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:10.848443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-6672b5c5-7c04-4876-a996-d9735703998b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:10.914296 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672b5c5-7c04-4876-a996-d9735703998b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:10.915580 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672b5c5-7c04-4876-a996-d9735703998b service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:10.925733 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1129/2241] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:16.432034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281d40e-a600-41f1-a235-edbf500abb60 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:16.497793 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281d40e-a600-41f1-a235-edbf500abb60 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:16.503034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e26c6-4d03-4c19-a77a-67ef80fa58e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:16.504297 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e26c6-4d03-4c19-a77a-67ef80fa58e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:16.504600 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e26c6-4d03-4c19-a77a-67ef80fa58e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:16.504986 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e26c6-4d03-4c19-a77a-67ef80fa58e4 admin admin] PATH_INFO: `/v3/users/81af6fa92a79485483e20d51c176d726` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:16.506764 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e26c6-4d03-4c19-a77a-67ef80fa58e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81af6fa92a79485483e20d51c176d726)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:16.508770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e26c6-4d03-4c19-a77a-67ef80fa58e4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:16.558165 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ea5e26c6-4d03-4c19-a77a-67ef80fa58e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81af6fa92a79485483e20d51c176d726'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:16.558924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ea5e26c6-4d03-4c19-a77a-67ef80fa58e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81af6fa92a79485483e20d51c176d726'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:16.559595 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ea5e26c6-4d03-4c19-a77a-67ef80fa58e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81af6fa92a79485483e20d51c176d726'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:16.568928 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ea5e26c6-4d03-4c19-a77a-67ef80fa58e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81af6fa92a79485483e20d51c176d726'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:16.583332 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ea5e26c6-4d03-4c19-a77a-67ef80fa58e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81af6fa92a79485483e20d51c176d726'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:16.596137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1113/2242] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:16 2022] DELETE /identity/v3/users/81af6fa92a79485483e20d51c176d726 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:16.601527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f91582-2c6a-49b1-8f16-9b648e501692 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:16.602021 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f91582-2c6a-49b1-8f16-9b648e501692 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:16.602112 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f91582-2c6a-49b1-8f16-9b648e501692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:16.620990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-83f91582-2c6a-49b1-8f16-9b648e501692 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:16.622218 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-83f91582-2c6a-49b1-8f16-9b648e501692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:16.684049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1130/2243] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:07:16.694594 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e26c6-4d03-4c19-a77a-67ef80fa58e4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:16.696036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ea5e26c6-4d03-4c19-a77a-67ef80fa58e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:16.752063 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e26c6-4d03-4c19-a77a-67ef80fa58e4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:16.756512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c9ce3-cec4-4ae1-8880-1c89fa4c74c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:16.757189 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c9ce3-cec4-4ae1-8880-1c89fa4c74c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:16.757473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c9ce3-cec4-4ae1-8880-1c89fa4c74c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:16.757751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c9ce3-cec4-4ae1-8880-1c89fa4c74c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:16.767048 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c9ce3-cec4-4ae1-8880-1c89fa4c74c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:16.768610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c9ce3-cec4-4ae1-8880-1c89fa4c74c4 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:16.778881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1114/2244] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:17.064343 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f91582-2c6a-49b1-8f16-9b648e501692 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:17.066244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-83f91582-2c6a-49b1-8f16-9b648e501692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:17.087949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f91582-2c6a-49b1-8f16-9b648e501692 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:17.098507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9b4d6-d841-42fe-a7fe-d04867c467b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:17.099452 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9b4d6-d841-42fe-a7fe-d04867c467b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:17.099737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9b4d6-d841-42fe-a7fe-d04867c467b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:17.100120 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9b4d6-d841-42fe-a7fe-d04867c467b9 admin admin] PATH_INFO: `/v3/projects/8855d5fa35e74bb6845ad292321747dd` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:17.116539 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9b4d6-d841-42fe-a7fe-d04867c467b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8855d5fa35e74bb6845ad292321747dd)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:17.117681 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c9ce3-cec4-4ae1-8880-1c89fa4c74c4 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:17.119311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9f2c9ce3-cec4-4ae1-8880-1c89fa4c74c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:17.125246 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9b4d6-d841-42fe-a7fe-d04867c467b9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:17.141506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c9ce3-cec4-4ae1-8880-1c89fa4c74c4 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:17.149455 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5181a3-b474-4884-9b4d-99f5897351dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:17.153152 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5181a3-b474-4884-9b4d-99f5897351dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:17.153884 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5181a3-b474-4884-9b4d-99f5897351dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:17.154341 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5181a3-b474-4884-9b4d-99f5897351dd admin admin] PATH_INFO: `/v3/users/70081fc16c444dc8b1df9a734e55d1a0` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:17.156256 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5181a3-b474-4884-9b4d-99f5897351dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=70081fc16c444dc8b1df9a734e55d1a0)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:17.158591 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5181a3-b474-4884-9b4d-99f5897351dd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:17.196394 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-00c9b4d6-d841-42fe-a7fe-d04867c467b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8855d5fa35e74bb6845ad292321747dd', 'request_id': 'req-00c9b4d6-d841-42fe-a7fe-d04867c467b9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:17.204297 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-00c9b4d6-d841-42fe-a7fe-d04867c467b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8855d5fa35e74bb6845ad292321747dd', 'request_id': 'req-00c9b4d6-d841-42fe-a7fe-d04867c467b9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:17.214578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-00c9b4d6-d841-42fe-a7fe-d04867c467b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8855d5fa35e74bb6845ad292321747dd', 'request_id': 'req-00c9b4d6-d841-42fe-a7fe-d04867c467b9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:17.225348 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9d5181a3-b474-4884-9b4d-99f5897351dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70081fc16c444dc8b1df9a734e55d1a0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:17.226247 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9d5181a3-b474-4884-9b4d-99f5897351dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70081fc16c444dc8b1df9a734e55d1a0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:17.227040 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9d5181a3-b474-4884-9b4d-99f5897351dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70081fc16c444dc8b1df9a734e55d1a0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:17.230828 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-00c9b4d6-d841-42fe-a7fe-d04867c467b9 admin admin] The token cache is being invalidate because project 8855d5fa35e74bb6845ad292321747dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:17.231604 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-00c9b4d6-d841-42fe-a7fe-d04867c467b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:17.233121 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-00c9b4d6-d841-42fe-a7fe-d04867c467b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:17.235502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1131/2245] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:17 2022] DELETE /identity/v3/projects/8855d5fa35e74bb6845ad292321747dd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:17.237421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9d5181a3-b474-4884-9b4d-99f5897351dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70081fc16c444dc8b1df9a734e55d1a0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:17.252596 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d3f7d-2419-40cb-a9f3-aeabed654627 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:17.253159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d3f7d-2419-40cb-a9f3-aeabed654627 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:17.253920 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d3f7d-2419-40cb-a9f3-aeabed654627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:17.254260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9d5181a3-b474-4884-9b4d-99f5897351dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70081fc16c444dc8b1df9a734e55d1a0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:17.277136 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1115/2246] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:17 2022] DELETE /identity/v3/users/70081fc16c444dc8b1df9a734e55d1a0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:17.280303 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-147d3f7d-2419-40cb-a9f3-aeabed654627 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:17.282000 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54737819-8706-4e16-bef4-7ba231386878 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:17.282292 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54737819-8706-4e16-bef4-7ba231386878 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:17.282725 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54737819-8706-4e16-bef4-7ba231386878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:17.293260 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-147d3f7d-2419-40cb-a9f3-aeabed654627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:17.309552 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-54737819-8706-4e16-bef4-7ba231386878 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:17.311880 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-54737819-8706-4e16-bef4-7ba231386878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:17.399068 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1132/2247] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:17.407110 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe483f-4b21-43af-bca5-b3ad6de49cfa None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:17.407632 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe483f-4b21-43af-bca5-b3ad6de49cfa None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:17.408132 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe483f-4b21-43af-bca5-b3ad6de49cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:17.420420 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1116/2248] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:17.437041 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54737819-8706-4e16-bef4-7ba231386878 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:17.437041 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-54737819-8706-4e16-bef4-7ba231386878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:17.463419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4dfe483f-4b21-43af-bca5-b3ad6de49cfa None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:17.466124 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4dfe483f-4b21-43af-bca5-b3ad6de49cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:17.495376 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1133/2249] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:07:17.499420 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe483f-4b21-43af-bca5-b3ad6de49cfa None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:17.511502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe483f-4b21-43af-bca5-b3ad6de49cfa None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:17.516549 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a851139-c2e6-4fea-a8c8-3c2d273bc165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:17.517257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a851139-c2e6-4fea-a8c8-3c2d273bc165 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:17.517545 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a851139-c2e6-4fea-a8c8-3c2d273bc165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:17.517821 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a851139-c2e6-4fea-a8c8-3c2d273bc165 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:17.518616 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a851139-c2e6-4fea-a8c8-3c2d273bc165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:07:17.518920 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a851139-c2e6-4fea-a8c8-3c2d273bc165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:17.521643 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a851139-c2e6-4fea-a8c8-3c2d273bc165 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:17.523805 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54737819-8706-4e16-bef4-7ba231386878 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:17.527926 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667808b2-bbb2-45a8-bb4d-7ef303f8a038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:17.529062 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667808b2-bbb2-45a8-bb4d-7ef303f8a038 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:17.529062 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667808b2-bbb2-45a8-bb4d-7ef303f8a038 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:17.529062 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667808b2-bbb2-45a8-bb4d-7ef303f8a038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:17.536855 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1134/2250] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 05:07:17.539909 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a851139-c2e6-4fea-a8c8-3c2d273bc165 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:17.541667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667808b2-bbb2-45a8-bb4d-7ef303f8a038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:17.543201 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667808b2-bbb2-45a8-bb4d-7ef303f8a038 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:17.549946 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a851139-c2e6-4fea-a8c8-3c2d273bc165 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:17.552995 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1117/2251] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:17.555505 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d3d48-0205-40c4-be69-f6fd020b9e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:17.556269 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d3d48-0205-40c4-be69-f6fd020b9e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:17.556563 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d3d48-0205-40c4-be69-f6fd020b9e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:17.557288 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d3d48-0205-40c4-be69-f6fd020b9e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:17.557629 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d3d48-0205-40c4-be69-f6fd020b9e3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:17.559946 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d3d48-0205-40c4-be69-f6fd020b9e3e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:17.596563 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1135/2252] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:17 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:07:17.597709 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667808b2-bbb2-45a8-bb4d-7ef303f8a038 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:17.608891 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667808b2-bbb2-45a8-bb4d-7ef303f8a038 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:17.676137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d934c83-e45e-435c-874e-266c6382f746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:17.677483 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d934c83-e45e-435c-874e-266c6382f746 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:17.677764 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d934c83-e45e-435c-874e-266c6382f746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:17.678170 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d934c83-e45e-435c-874e-266c6382f746 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:17.680403 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d934c83-e45e-435c-874e-266c6382f746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:17.682451 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d934c83-e45e-435c-874e-266c6382f746 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:17.713427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1118/2253] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:17 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:17.714895 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d3d48-0205-40c4-be69-f6fd020b9e3e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:17.728750 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d3d48-0205-40c4-be69-f6fd020b9e3e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:17.736637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f2552-e91c-4929-a03b-cff20908703e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:17.737542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f2552-e91c-4929-a03b-cff20908703e admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:17.738011 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f2552-e91c-4929-a03b-cff20908703e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:17.738294 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f2552-e91c-4929-a03b-cff20908703e admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:17.739622 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f2552-e91c-4929-a03b-cff20908703e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:17.741434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f2552-e91c-4929-a03b-cff20908703e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:17.772502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1136/2254] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:17.775616 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d934c83-e45e-435c-874e-266c6382f746 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:17.799639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d934c83-e45e-435c-874e-266c6382f746 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:17.828926 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e9e8f-3fee-43dc-a6bb-3ffa4570add0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:17.829801 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e9e8f-3fee-43dc-a6bb-3ffa4570add0 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:17.830196 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e9e8f-3fee-43dc-a6bb-3ffa4570add0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:17.830597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e9e8f-3fee-43dc-a6bb-3ffa4570add0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:17.831454 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e9e8f-3fee-43dc-a6bb-3ffa4570add0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:17.833781 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e9e8f-3fee-43dc-a6bb-3ffa4570add0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:17.845309 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1119/2255] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:17.851184 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f2552-e91c-4929-a03b-cff20908703e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:17.867201 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f2552-e91c-4929-a03b-cff20908703e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:17.875395 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317005a5-1327-4a75-b150-90aa04e443bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:17.876611 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317005a5-1327-4a75-b150-90aa04e443bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:17.877170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317005a5-1327-4a75-b150-90aa04e443bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:17.877457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317005a5-1327-4a75-b150-90aa04e443bf admin admin] PATH_INFO: `/v3/projects/dcb4b76068524e6e98b7a9873dee6838/users/a70d97bfb1a7429db92baaa03b093d17/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:17.885667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e9e8f-3fee-43dc-a6bb-3ffa4570add0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:17.888894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d74e9e8f-3fee-43dc-a6bb-3ffa4570add0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:17.912925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317005a5-1327-4a75-b150-90aa04e443bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb4b76068524e6e98b7a9873dee6838, user_id=a70d97bfb1a7429db92baaa03b093d17, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:17.915912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317005a5-1327-4a75-b150-90aa04e443bf admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:17.930919 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e9e8f-3fee-43dc-a6bb-3ffa4570add0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:17.936363 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1137/2256] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:17 2022] PUT /identity/v3/projects/dcb4b76068524e6e98b7a9873dee6838/users/a70d97bfb1a7429db92baaa03b093d17/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:17.949078 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe75d6-0456-4e00-a1ce-52d1080e3c28 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:17.949636 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe75d6-0456-4e00-a1ce-52d1080e3c28 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:17.950295 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe75d6-0456-4e00-a1ce-52d1080e3c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:18.001927 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4cfe75d6-0456-4e00-a1ce-52d1080e3c28 None None] MFA Rules not processed for user `a70d97bfb1a7429db92baaa03b093d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:18.003272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4cfe75d6-0456-4e00-a1ce-52d1080e3c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:18.048904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d58f2-428e-4ca2-835d-67878654538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:18.049944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d58f2-428e-4ca2-835d-67878654538c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:18.050329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d58f2-428e-4ca2-835d-67878654538c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:18.050712 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d58f2-428e-4ca2-835d-67878654538c admin admin] PATH_INFO: `/v3/projects/97c9441584e04f0e957db3201caa80a8` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:18.052284 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d58f2-428e-4ca2-835d-67878654538c admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c9441584e04f0e957db3201caa80a8)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:18.054946 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d58f2-428e-4ca2-835d-67878654538c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:18.090205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1138/2257] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:07:18.108192 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-585d58f2-428e-4ca2-835d-67878654538c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c9441584e04f0e957db3201caa80a8', 'request_id': 'req-585d58f2-428e-4ca2-835d-67878654538c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:18.114761 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe75d6-0456-4e00-a1ce-52d1080e3c28 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:18.116449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4cfe75d6-0456-4e00-a1ce-52d1080e3c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:18.116945 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-585d58f2-428e-4ca2-835d-67878654538c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c9441584e04f0e957db3201caa80a8', 'request_id': 'req-585d58f2-428e-4ca2-835d-67878654538c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:18.123554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-585d58f2-428e-4ca2-835d-67878654538c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c9441584e04f0e957db3201caa80a8', 'request_id': 'req-585d58f2-428e-4ca2-835d-67878654538c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:18.135722 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-585d58f2-428e-4ca2-835d-67878654538c admin admin] The token cache is being invalidate because project 97c9441584e04f0e957db3201caa80a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:18.136018 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-585d58f2-428e-4ca2-835d-67878654538c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:18.136683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-585d58f2-428e-4ca2-835d-67878654538c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:18.138375 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1120/2258] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:17 2022] DELETE /identity/v3/projects/97c9441584e04f0e957db3201caa80a8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:18.142364 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d58f2-428e-4ca2-835d-67878654538c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:18.143837 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-585d58f2-428e-4ca2-835d-67878654538c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:18.177733 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe75d6-0456-4e00-a1ce-52d1080e3c28 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:18.206703 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d58f2-428e-4ca2-835d-67878654538c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:18.212275 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25972d-6071-4d7c-9d7d-9226643af6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:18.213186 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25972d-6071-4d7c-9d7d-9226643af6a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:18.213465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25972d-6071-4d7c-9d7d-9226643af6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:18.213736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25972d-6071-4d7c-9d7d-9226643af6a6 admin admin] PATH_INFO: `/v3/users/b36be791683c4fb08f41962442a5ee8e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:18.214942 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25972d-6071-4d7c-9d7d-9226643af6a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b36be791683c4fb08f41962442a5ee8e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:18.216979 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25972d-6071-4d7c-9d7d-9226643af6a6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:18.224828 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ee914-f83c-4777-abcd-f8cb952eec8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:18.225469 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ee914-f83c-4777-abcd-f8cb952eec8a service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:18.225743 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ee914-f83c-4777-abcd-f8cb952eec8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:18.226014 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ee914-f83c-4777-abcd-f8cb952eec8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:18.227781 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e30ee914-f83c-4777-abcd-f8cb952eec8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:18.263203 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ef25972d-6071-4d7c-9d7d-9226643af6a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b36be791683c4fb08f41962442a5ee8e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:18.263893 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ef25972d-6071-4d7c-9d7d-9226643af6a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b36be791683c4fb08f41962442a5ee8e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:18.264505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ef25972d-6071-4d7c-9d7d-9226643af6a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b36be791683c4fb08f41962442a5ee8e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:18.271587 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ef25972d-6071-4d7c-9d7d-9226643af6a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b36be791683c4fb08f41962442a5ee8e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:18.284619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ef25972d-6071-4d7c-9d7d-9226643af6a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b36be791683c4fb08f41962442a5ee8e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:18.287247 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ee914-f83c-4777-abcd-f8cb952eec8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:18.288702 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ee914-f83c-4777-abcd-f8cb952eec8a service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:18.297312 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1121/2259] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:18 2022] DELETE /identity/v3/users/b36be791683c4fb08f41962442a5ee8e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:18.298585 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1139/2260] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:18.718044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25972d-6071-4d7c-9d7d-9226643af6a6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:18.719308 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ef25972d-6071-4d7c-9d7d-9226643af6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:18.810509 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25972d-6071-4d7c-9d7d-9226643af6a6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:18.819423 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a4720-4615-4347-a8d9-509baad719be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:18.820468 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a4720-4615-4347-a8d9-509baad719be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:18.820749 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a4720-4615-4347-a8d9-509baad719be admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:18.821055 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a4720-4615-4347-a8d9-509baad719be admin admin] PATH_INFO: `/v3/projects/a57ed6c2ac184360ae98d9f27a09ec54` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:18.822344 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a4720-4615-4347-a8d9-509baad719be admin admin] RBAC: Authorizing `identity:delete_project(project_id=a57ed6c2ac184360ae98d9f27a09ec54)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:18.824488 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a4720-4615-4347-a8d9-509baad719be admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:18.880859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-251a4720-4615-4347-a8d9-509baad719be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a57ed6c2ac184360ae98d9f27a09ec54', 'request_id': 'req-251a4720-4615-4347-a8d9-509baad719be'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:18.889671 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-251a4720-4615-4347-a8d9-509baad719be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a57ed6c2ac184360ae98d9f27a09ec54', 'request_id': 'req-251a4720-4615-4347-a8d9-509baad719be'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:18.898935 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-251a4720-4615-4347-a8d9-509baad719be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a57ed6c2ac184360ae98d9f27a09ec54', 'request_id': 'req-251a4720-4615-4347-a8d9-509baad719be'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:18.910544 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-251a4720-4615-4347-a8d9-509baad719be admin admin] The token cache is being invalidate because project a57ed6c2ac184360ae98d9f27a09ec54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:18.910899 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-251a4720-4615-4347-a8d9-509baad719be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:18.912194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-251a4720-4615-4347-a8d9-509baad719be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:18.914535 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1122/2261] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:18 2022] DELETE /identity/v3/projects/a57ed6c2ac184360ae98d9f27a09ec54 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:18.918428 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ee914-f83c-4777-abcd-f8cb952eec8a service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:18.930561 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ee914-f83c-4777-abcd-f8cb952eec8a service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:18.996738 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c26b8-b0fb-42b7-84df-132faa93fde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:18.997638 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c26b8-b0fb-42b7-84df-132faa93fde3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:18.997991 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c26b8-b0fb-42b7-84df-132faa93fde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:18.998266 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c26b8-b0fb-42b7-84df-132faa93fde3 admin admin] PATH_INFO: `/v3/users/82a5ba471fc54fb7938c4be62dec251c` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:18.999586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c26b8-b0fb-42b7-84df-132faa93fde3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82a5ba471fc54fb7938c4be62dec251c)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:19.001685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c26b8-b0fb-42b7-84df-132faa93fde3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:19.049777 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ee6c26b8-b0fb-42b7-84df-132faa93fde3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82a5ba471fc54fb7938c4be62dec251c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:19.050816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ee6c26b8-b0fb-42b7-84df-132faa93fde3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82a5ba471fc54fb7938c4be62dec251c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:19.051017 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ee6c26b8-b0fb-42b7-84df-132faa93fde3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82a5ba471fc54fb7938c4be62dec251c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:19.060008 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ee6c26b8-b0fb-42b7-84df-132faa93fde3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82a5ba471fc54fb7938c4be62dec251c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:19.075116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-ee6c26b8-b0fb-42b7-84df-132faa93fde3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82a5ba471fc54fb7938c4be62dec251c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:19.091025 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1140/2262] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:18 2022] DELETE /identity/v3/users/82a5ba471fc54fb7938c4be62dec251c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:19.402007 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a4720-4615-4347-a8d9-509baad719be admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:19.403456 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-251a4720-4615-4347-a8d9-509baad719be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:19.418141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a4720-4615-4347-a8d9-509baad719be admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:19.476739 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d416a-b64c-492f-bc5d-b4058b8c221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:19.477691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d416a-b64c-492f-bc5d-b4058b8c221b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:19.477974 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d416a-b64c-492f-bc5d-b4058b8c221b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:19.478531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d416a-b64c-492f-bc5d-b4058b8c221b admin admin] PATH_INFO: `/v3/projects/b70928b0715e456e8ccecd7e9e27adbb` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:19.479730 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d416a-b64c-492f-bc5d-b4058b8c221b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b70928b0715e456e8ccecd7e9e27adbb)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:19.481985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d416a-b64c-492f-bc5d-b4058b8c221b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:19.529034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bc9d416a-b64c-492f-bc5d-b4058b8c221b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70928b0715e456e8ccecd7e9e27adbb', 'request_id': 'req-bc9d416a-b64c-492f-bc5d-b4058b8c221b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:19.536183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bc9d416a-b64c-492f-bc5d-b4058b8c221b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70928b0715e456e8ccecd7e9e27adbb', 'request_id': 'req-bc9d416a-b64c-492f-bc5d-b4058b8c221b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:19.542386 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bc9d416a-b64c-492f-bc5d-b4058b8c221b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70928b0715e456e8ccecd7e9e27adbb', 'request_id': 'req-bc9d416a-b64c-492f-bc5d-b4058b8c221b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:19.553150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bc9d416a-b64c-492f-bc5d-b4058b8c221b admin admin] The token cache is being invalidate because project b70928b0715e456e8ccecd7e9e27adbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:19.553430 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bc9d416a-b64c-492f-bc5d-b4058b8c221b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:19.554057 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bc9d416a-b64c-492f-bc5d-b4058b8c221b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:19.555645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1123/2263] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:19 2022] DELETE /identity/v3/projects/b70928b0715e456e8ccecd7e9e27adbb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:19.560881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1df58-0b1a-42cc-aae1-d950600af7a5 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:19.561366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1df58-0b1a-42cc-aae1-d950600af7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:19.561662 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1df58-0b1a-42cc-aae1-d950600af7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:19.580582 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-69c1df58-0b1a-42cc-aae1-d950600af7a5 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:19.581797 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-69c1df58-0b1a-42cc-aae1-d950600af7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:19.643923 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1141/2264] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:19.651686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d7d0e-1dbf-438a-afa6-5fc9d627ccda None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:19.651911 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d7d0e-1dbf-438a-afa6-5fc9d627ccda None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:19.652186 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d7d0e-1dbf-438a-afa6-5fc9d627ccda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:19.670270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-963d7d0e-1dbf-438a-afa6-5fc9d627ccda None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:19.671470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-963d7d0e-1dbf-438a-afa6-5fc9d627ccda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:19.680807 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1124/2265] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:19.685201 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1df58-0b1a-42cc-aae1-d950600af7a5 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:19.695905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1df58-0b1a-42cc-aae1-d950600af7a5 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:19.700748 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca5085-9656-4630-a249-9132ddf5ea95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:19.701502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca5085-9656-4630-a249-9132ddf5ea95 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:19.701786 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca5085-9656-4630-a249-9132ddf5ea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:19.702065 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca5085-9656-4630-a249-9132ddf5ea95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:19.702788 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca5085-9656-4630-a249-9132ddf5ea95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:07:19.703096 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca5085-9656-4630-a249-9132ddf5ea95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:19.704724 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca5085-9656-4630-a249-9132ddf5ea95 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:19.716891 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1142/2266] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:07:19.721111 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d7d0e-1dbf-438a-afa6-5fc9d627ccda None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:19.730317 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d7d0e-1dbf-438a-afa6-5fc9d627ccda None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:19.735058 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1bbafe-2c98-4e1e-800f-f41facaace18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:19.735706 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bbafe-2c98-4e1e-800f-f41facaace18 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:19.735984 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bbafe-2c98-4e1e-800f-f41facaace18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:19.736258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bbafe-2c98-4e1e-800f-f41facaace18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:19.736991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1bbafe-2c98-4e1e-800f-f41facaace18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:19.739441 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1bbafe-2c98-4e1e-800f-f41facaace18 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:19.769787 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1125/2267] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:19 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:19.771374 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca5085-9656-4630-a249-9132ddf5ea95 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:19.781825 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca5085-9656-4630-a249-9132ddf5ea95 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:19.844121 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d5e1c-b23d-4e65-8052-404a2d1f1df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:19.844812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d5e1c-b23d-4e65-8052-404a2d1f1df5 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:19.845104 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d5e1c-b23d-4e65-8052-404a2d1f1df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:19.845381 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d5e1c-b23d-4e65-8052-404a2d1f1df5 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:19.846193 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d5e1c-b23d-4e65-8052-404a2d1f1df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:19.848698 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d5e1c-b23d-4e65-8052-404a2d1f1df5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:19.870277 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1143/2268] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:19 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:19.874403 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1bbafe-2c98-4e1e-800f-f41facaace18 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:19.885075 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1bbafe-2c98-4e1e-800f-f41facaace18 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:19.889761 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157238da-d82a-4c2f-983b-67e8be9cafaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:19.890775 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157238da-d82a-4c2f-983b-67e8be9cafaa admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:19.891070 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157238da-d82a-4c2f-983b-67e8be9cafaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:19.891351 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157238da-d82a-4c2f-983b-67e8be9cafaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:19.892285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157238da-d82a-4c2f-983b-67e8be9cafaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:19.893920 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157238da-d82a-4c2f-983b-67e8be9cafaa admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:19.904750 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1126/2269] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:19.908498 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d5e1c-b23d-4e65-8052-404a2d1f1df5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:19.919054 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d5e1c-b23d-4e65-8052-404a2d1f1df5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:19.923685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d6f84-fe3c-49bf-abba-a6426d3009a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:19.924333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6f84-fe3c-49bf-abba-a6426d3009a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:19.924610 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6f84-fe3c-49bf-abba-a6426d3009a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:19.924918 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d6f84-fe3c-49bf-abba-a6426d3009a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:19.925642 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d6f84-fe3c-49bf-abba-a6426d3009a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:19.927926 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d6f84-fe3c-49bf-abba-a6426d3009a1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:19.937812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1144/2270] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:19.942038 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157238da-d82a-4c2f-983b-67e8be9cafaa admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:19.953921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157238da-d82a-4c2f-983b-67e8be9cafaa admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:19.962354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c67c04-56ca-40d5-a6ea-7a97964dd78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:19.963245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c67c04-56ca-40d5-a6ea-7a97964dd78e admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:19.963520 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c67c04-56ca-40d5-a6ea-7a97964dd78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:19.963798 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c67c04-56ca-40d5-a6ea-7a97964dd78e admin admin] PATH_INFO: `/v3/projects/17a3c669bab54e14864dab82f15213d5/users/4ee5a325a4894f239b299e74862250f6/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:19.981827 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c67c04-56ca-40d5-a6ea-7a97964dd78e admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a3c669bab54e14864dab82f15213d5, user_id=4ee5a325a4894f239b299e74862250f6, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:19.985371 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c67c04-56ca-40d5-a6ea-7a97964dd78e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:20.001890 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1127/2271] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:19 2022] PUT /identity/v3/projects/17a3c669bab54e14864dab82f15213d5/users/4ee5a325a4894f239b299e74862250f6/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:20.015959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a740c0-c9a5-4c60-a46e-0b785f405057 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:20.016527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a740c0-c9a5-4c60-a46e-0b785f405057 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:20.016846 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a740c0-c9a5-4c60-a46e-0b785f405057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:20.056543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-54a740c0-c9a5-4c60-a46e-0b785f405057 None None] MFA Rules not processed for user `4ee5a325a4894f239b299e74862250f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:20.058106 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-54a740c0-c9a5-4c60-a46e-0b785f405057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:20.126486 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1145/2272] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:20.131934 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c67c04-56ca-40d5-a6ea-7a97964dd78e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:20.207507 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c67c04-56ca-40d5-a6ea-7a97964dd78e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:20.212968 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6c2ea-70a2-4e7d-b674-9157090b2756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:20.213648 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6c2ea-70a2-4e7d-b674-9157090b2756 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:20.213970 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6c2ea-70a2-4e7d-b674-9157090b2756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:20.214201 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6c2ea-70a2-4e7d-b674-9157090b2756 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:20.214934 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6c2ea-70a2-4e7d-b674-9157090b2756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:20.216903 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6c2ea-70a2-4e7d-b674-9157090b2756 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:20.244828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1128/2273] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:20 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:20.248271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a740c0-c9a5-4c60-a46e-0b785f405057 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:20.260178 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a740c0-c9a5-4c60-a46e-0b785f405057 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:20.315620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b0910-5ae8-4b6a-84c0-aece5092016f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:20.316291 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b0910-5ae8-4b6a-84c0-aece5092016f admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:20.317752 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b0910-5ae8-4b6a-84c0-aece5092016f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:20.318253 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b0910-5ae8-4b6a-84c0-aece5092016f admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:20.319088 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b0910-5ae8-4b6a-84c0-aece5092016f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:20.321170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b0910-5ae8-4b6a-84c0-aece5092016f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:20.345034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1146/2274] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:20 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:20.349348 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6c2ea-70a2-4e7d-b674-9157090b2756 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:20.359701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6c2ea-70a2-4e7d-b674-9157090b2756 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:20.369172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99bdaf-f1ac-495a-8996-0178cbc7d2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:20.370565 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99bdaf-f1ac-495a-8996-0178cbc7d2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:20.371015 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99bdaf-f1ac-495a-8996-0178cbc7d2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:20.371705 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99bdaf-f1ac-495a-8996-0178cbc7d2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:20.373207 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99bdaf-f1ac-495a-8996-0178cbc7d2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:20.375157 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99bdaf-f1ac-495a-8996-0178cbc7d2f3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:20.389912 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1129/2275] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:20.393812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b0910-5ae8-4b6a-84c0-aece5092016f admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:20.404556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b0910-5ae8-4b6a-84c0-aece5092016f admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:20.410125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb01700-ec31-4e96-ad22-f098bafdb0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:20.412810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb01700-ec31-4e96-ad22-f098bafdb0ce admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:20.413140 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb01700-ec31-4e96-ad22-f098bafdb0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:20.413419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb01700-ec31-4e96-ad22-f098bafdb0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:20.414156 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb01700-ec31-4e96-ad22-f098bafdb0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:20.416455 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb01700-ec31-4e96-ad22-f098bafdb0ce admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:20.431748 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1147/2276] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:20.436727 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99bdaf-f1ac-495a-8996-0178cbc7d2f3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:20.452126 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99bdaf-f1ac-495a-8996-0178cbc7d2f3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:20.457682 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e78ef-9918-4c00-8b60-715b8b33ac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:20.458850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e78ef-9918-4c00-8b60-715b8b33ac32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:20.459303 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e78ef-9918-4c00-8b60-715b8b33ac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:20.459581 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e78ef-9918-4c00-8b60-715b8b33ac32 admin admin] PATH_INFO: `/v3/projects/9290345adf464329be6783c94197ee4f/users/97049bbcd1484caf921ad98c8a099059/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:20.478089 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e78ef-9918-4c00-8b60-715b8b33ac32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9290345adf464329be6783c94197ee4f, user_id=97049bbcd1484caf921ad98c8a099059, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:20.481053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e78ef-9918-4c00-8b60-715b8b33ac32 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:20.499392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1130/2277] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:20 2022] PUT /identity/v3/projects/9290345adf464329be6783c94197ee4f/users/97049bbcd1484caf921ad98c8a099059/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:20.512924 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8010e9-da7f-4577-96a1-f9c563912da1 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:20.513222 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8010e9-da7f-4577-96a1-f9c563912da1 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:20.513680 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8010e9-da7f-4577-96a1-f9c563912da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:20.563405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3d8010e9-da7f-4577-96a1-f9c563912da1 None None] MFA Rules not processed for user `97049bbcd1484caf921ad98c8a099059`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:20.565112 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3d8010e9-da7f-4577-96a1-f9c563912da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:20.648159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1148/2278] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:20.651078 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e78ef-9918-4c00-8b60-715b8b33ac32 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:20.741839 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e78ef-9918-4c00-8b60-715b8b33ac32 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:20.747674 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfeae2-41a1-4a2a-9df8-15ced62256e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:20.748333 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfeae2-41a1-4a2a-9df8-15ced62256e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:20.748670 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfeae2-41a1-4a2a-9df8-15ced62256e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:20.749053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfeae2-41a1-4a2a-9df8-15ced62256e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:20.749883 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfeae2-41a1-4a2a-9df8-15ced62256e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:20.751929 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfeae2-41a1-4a2a-9df8-15ced62256e2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:20.782284 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1131/2279] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:20 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:20.787330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8010e9-da7f-4577-96a1-f9c563912da1 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:20.799208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8010e9-da7f-4577-96a1-f9c563912da1 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:20.859155 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f4ce4-e22e-462b-a0a6-cf48be8007f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:20.859835 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4ce4-e22e-462b-a0a6-cf48be8007f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:20.860109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4ce4-e22e-462b-a0a6-cf48be8007f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:20.860442 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4ce4-e22e-462b-a0a6-cf48be8007f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:20.861237 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f4ce4-e22e-462b-a0a6-cf48be8007f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:20.863670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f4ce4-e22e-462b-a0a6-cf48be8007f4 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:20.884971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1149/2280] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:20 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:20.889061 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfeae2-41a1-4a2a-9df8-15ced62256e2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:20.900604 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfeae2-41a1-4a2a-9df8-15ced62256e2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:20.905403 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4b392-80ce-4a0f-bdf2-2bd4c36ee4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:20.906232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4b392-80ce-4a0f-bdf2-2bd4c36ee4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:20.906514 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4b392-80ce-4a0f-bdf2-2bd4c36ee4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:20.906789 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4b392-80ce-4a0f-bdf2-2bd4c36ee4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:20.907513 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4b392-80ce-4a0f-bdf2-2bd4c36ee4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:20.909204 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4b392-80ce-4a0f-bdf2-2bd4c36ee4b7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:20.921189 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1132/2281] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:20.925671 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f4ce4-e22e-462b-a0a6-cf48be8007f4 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:20.936809 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f4ce4-e22e-462b-a0a6-cf48be8007f4 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:20.941895 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49336a-fdde-4069-adb0-0bc425ba2a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:20.942827 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49336a-fdde-4069-adb0-0bc425ba2a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:20.943110 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49336a-fdde-4069-adb0-0bc425ba2a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:20.943726 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49336a-fdde-4069-adb0-0bc425ba2a28 admin admin] PATH_INFO: `/v3/projects/36a657d26e904eda8c2ca25a15318510/users/d1d66e05771440f7b758e1014b593874/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:20.961161 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49336a-fdde-4069-adb0-0bc425ba2a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a657d26e904eda8c2ca25a15318510, user_id=d1d66e05771440f7b758e1014b593874, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:20.963951 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49336a-fdde-4069-adb0-0bc425ba2a28 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:20.978937 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1150/2282] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:20 2022] PUT /identity/v3/projects/36a657d26e904eda8c2ca25a15318510/users/d1d66e05771440f7b758e1014b593874/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:20.983085 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4b392-80ce-4a0f-bdf2-2bd4c36ee4b7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:20.994710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4b392-80ce-4a0f-bdf2-2bd4c36ee4b7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:21.056111 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f0c64-1d6e-4e5b-88ed-50778a50fe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:21.056825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f0c64-1d6e-4e5b-88ed-50778a50fe8d admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:21.057119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f0c64-1d6e-4e5b-88ed-50778a50fe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:21.057396 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f0c64-1d6e-4e5b-88ed-50778a50fe8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:21.058134 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f0c64-1d6e-4e5b-88ed-50778a50fe8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:21.059765 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f0c64-1d6e-4e5b-88ed-50778a50fe8d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:21.071266 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1133/2283] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:21.075546 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49336a-fdde-4069-adb0-0bc425ba2a28 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:21.086482 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49336a-fdde-4069-adb0-0bc425ba2a28 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:21.091530 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aee43f-dbd8-4e35-8c48-2808727baf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:21.092462 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aee43f-dbd8-4e35-8c48-2808727baf36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:21.092741 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aee43f-dbd8-4e35-8c48-2808727baf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:21.093051 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aee43f-dbd8-4e35-8c48-2808727baf36 admin admin] PATH_INFO: `/v3/projects/36a657d26e904eda8c2ca25a15318510/users/d1d66e05771440f7b758e1014b593874/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:21.095109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aee43f-dbd8-4e35-8c48-2808727baf36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a657d26e904eda8c2ca25a15318510, user_id=d1d66e05771440f7b758e1014b593874, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:21.097861 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aee43f-dbd8-4e35-8c48-2808727baf36 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:21.105718 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f0c64-1d6e-4e5b-88ed-50778a50fe8d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:21.107521 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3e3f0c64-1d6e-4e5b-88ed-50778a50fe8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:21.109348 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1151/2284] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:21 2022] PUT /identity/v3/projects/36a657d26e904eda8c2ca25a15318510/users/d1d66e05771440f7b758e1014b593874/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:21.121001 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9d723-8d44-47b8-b92c-a60cfc12c36a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:21.121285 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9d723-8d44-47b8-b92c-a60cfc12c36a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:21.121743 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9d723-8d44-47b8-b92c-a60cfc12c36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:21.125753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f0c64-1d6e-4e5b-88ed-50778a50fe8d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:21.150864 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-fcd9d723-8d44-47b8-b92c-a60cfc12c36a None None] MFA Rules not processed for user `d1d66e05771440f7b758e1014b593874`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:21.152233 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fcd9d723-8d44-47b8-b92c-a60cfc12c36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:21.197402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec21cb7-6dfc-4f0e-bb41-b8101a2a3d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:21.199441 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec21cb7-6dfc-4f0e-bb41-b8101a2a3d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:21.200144 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec21cb7-6dfc-4f0e-bb41-b8101a2a3d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:21.200946 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec21cb7-6dfc-4f0e-bb41-b8101a2a3d0c admin admin] PATH_INFO: `/v3/users/c9bc1cd2f6fc4cb2bcb02d80b3e9a54b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:21.202922 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec21cb7-6dfc-4f0e-bb41-b8101a2a3d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9bc1cd2f6fc4cb2bcb02d80b3e9a54b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:21.205225 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec21cb7-6dfc-4f0e-bb41-b8101a2a3d0c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:21.230001 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1152/2285] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:07:21.247983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9d723-8d44-47b8-b92c-a60cfc12c36a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:21.252031 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fcd9d723-8d44-47b8-b92c-a60cfc12c36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:21.267285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fec21cb7-6dfc-4f0e-bb41-b8101a2a3d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9bc1cd2f6fc4cb2bcb02d80b3e9a54b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:21.268041 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fec21cb7-6dfc-4f0e-bb41-b8101a2a3d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9bc1cd2f6fc4cb2bcb02d80b3e9a54b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:21.269064 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fec21cb7-6dfc-4f0e-bb41-b8101a2a3d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9bc1cd2f6fc4cb2bcb02d80b3e9a54b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:21.281723 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fec21cb7-6dfc-4f0e-bb41-b8101a2a3d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9bc1cd2f6fc4cb2bcb02d80b3e9a54b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:21.311144 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fec21cb7-6dfc-4f0e-bb41-b8101a2a3d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9bc1cd2f6fc4cb2bcb02d80b3e9a54b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:21.325149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1134/2286] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:21 2022] DELETE /identity/v3/users/c9bc1cd2f6fc4cb2bcb02d80b3e9a54b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:21.326209 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9d723-8d44-47b8-b92c-a60cfc12c36a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:21.333691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726af48c-9ad7-4585-bcc4-f1d1188a3ad6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:21.333979 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726af48c-9ad7-4585-bcc4-f1d1188a3ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:21.334263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726af48c-9ad7-4585-bcc4-f1d1188a3ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:21.364422 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-726af48c-9ad7-4585-bcc4-f1d1188a3ad6 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:21.366020 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-726af48c-9ad7-4585-bcc4-f1d1188a3ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:21.408904 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77f448-4e5d-4327-8ec1-c10e8866c882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:21.409780 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77f448-4e5d-4327-8ec1-c10e8866c882 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:21.410398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77f448-4e5d-4327-8ec1-c10e8866c882 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:21.411375 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77f448-4e5d-4327-8ec1-c10e8866c882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:21.419355 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ab77f448-4e5d-4327-8ec1-c10e8866c882 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:21.457339 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1135/2287] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:07:21.467443 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726af48c-9ad7-4585-bcc4-f1d1188a3ad6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:21.468993 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-726af48c-9ad7-4585-bcc4-f1d1188a3ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:21.502666 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77f448-4e5d-4327-8ec1-c10e8866c882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:21.506217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77f448-4e5d-4327-8ec1-c10e8866c882 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:21.528882 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1153/2288] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:21.549402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726af48c-9ad7-4585-bcc4-f1d1188a3ad6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:21.553759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1e617-34b4-4367-94be-defb5974e79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:21.554687 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1e617-34b4-4367-94be-defb5974e79a service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:21.555074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1e617-34b4-4367-94be-defb5974e79a service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:21.555451 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1e617-34b4-4367-94be-defb5974e79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:21.571545 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1e617-34b4-4367-94be-defb5974e79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:21.573594 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1e617-34b4-4367-94be-defb5974e79a service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:21.594473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1136/2289] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:22.067916 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77f448-4e5d-4327-8ec1-c10e8866c882 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:22.070402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ab77f448-4e5d-4327-8ec1-c10e8866c882 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:22.087143 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77f448-4e5d-4327-8ec1-c10e8866c882 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:22.092507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbf8ba-9246-4be2-8a28-aa860be88f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:22.093419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbf8ba-9246-4be2-8a28-aa860be88f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:22.093897 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbf8ba-9246-4be2-8a28-aa860be88f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:22.094375 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbf8ba-9246-4be2-8a28-aa860be88f51 admin admin] PATH_INFO: `/v3/users/d4806f4ecc6548ce83d95d6bed9ff53f` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:22.095605 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbf8ba-9246-4be2-8a28-aa860be88f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4806f4ecc6548ce83d95d6bed9ff53f)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:22.097830 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbf8ba-9246-4be2-8a28-aa860be88f51 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:22.172292 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b6bbf8ba-9246-4be2-8a28-aa860be88f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4806f4ecc6548ce83d95d6bed9ff53f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.173370 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b6bbf8ba-9246-4be2-8a28-aa860be88f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4806f4ecc6548ce83d95d6bed9ff53f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.174521 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b6bbf8ba-9246-4be2-8a28-aa860be88f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4806f4ecc6548ce83d95d6bed9ff53f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.179532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1e617-34b4-4367-94be-defb5974e79a service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:22.183228 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d4d1e617-34b4-4367-94be-defb5974e79a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:22.184411 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b6bbf8ba-9246-4be2-8a28-aa860be88f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4806f4ecc6548ce83d95d6bed9ff53f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.202257 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1e617-34b4-4367-94be-defb5974e79a service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:22.211258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302649a-d386-48fc-a839-5a5fd9882e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:22.212320 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302649a-d386-48fc-a839-5a5fd9882e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:22.212751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302649a-d386-48fc-a839-5a5fd9882e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:22.213137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302649a-d386-48fc-a839-5a5fd9882e66 admin admin] PATH_INFO: `/v3/projects/d1ecad46c8144051a9b4125f7f169267` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:22.214481 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302649a-d386-48fc-a839-5a5fd9882e66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1ecad46c8144051a9b4125f7f169267)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:22.215977 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b6bbf8ba-9246-4be2-8a28-aa860be88f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4806f4ecc6548ce83d95d6bed9ff53f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.216926 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302649a-d386-48fc-a839-5a5fd9882e66 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:22.229618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1154/2290] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:22 2022] DELETE /identity/v3/users/d4806f4ecc6548ce83d95d6bed9ff53f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:22.288548 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1302649a-d386-48fc-a839-5a5fd9882e66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1ecad46c8144051a9b4125f7f169267', 'request_id': 'req-1302649a-d386-48fc-a839-5a5fd9882e66'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.297653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1302649a-d386-48fc-a839-5a5fd9882e66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1ecad46c8144051a9b4125f7f169267', 'request_id': 'req-1302649a-d386-48fc-a839-5a5fd9882e66'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.306984 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1302649a-d386-48fc-a839-5a5fd9882e66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1ecad46c8144051a9b4125f7f169267', 'request_id': 'req-1302649a-d386-48fc-a839-5a5fd9882e66'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.320979 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1302649a-d386-48fc-a839-5a5fd9882e66 admin admin] The token cache is being invalidate because project d1ecad46c8144051a9b4125f7f169267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:22.321637 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1302649a-d386-48fc-a839-5a5fd9882e66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.322525 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1302649a-d386-48fc-a839-5a5fd9882e66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.324372 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1137/2291] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:22 2022] DELETE /identity/v3/projects/d1ecad46c8144051a9b4125f7f169267 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:22.503355 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbf8ba-9246-4be2-8a28-aa860be88f51 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:22.506484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b6bbf8ba-9246-4be2-8a28-aa860be88f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:22.590280 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbf8ba-9246-4be2-8a28-aa860be88f51 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:22.645887 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67359620-a4a4-4878-aee8-58e2bbed4a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:22.646855 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67359620-a4a4-4878-aee8-58e2bbed4a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:22.647136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67359620-a4a4-4878-aee8-58e2bbed4a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:22.647408 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67359620-a4a4-4878-aee8-58e2bbed4a67 admin admin] PATH_INFO: `/v3/projects/bfc2f98fa2a24ec3b103535b10d6305e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:22.648594 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67359620-a4a4-4878-aee8-58e2bbed4a67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc2f98fa2a24ec3b103535b10d6305e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:22.650539 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67359620-a4a4-4878-aee8-58e2bbed4a67 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:22.696710 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-67359620-a4a4-4878-aee8-58e2bbed4a67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc2f98fa2a24ec3b103535b10d6305e', 'request_id': 'req-67359620-a4a4-4878-aee8-58e2bbed4a67'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.702633 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-67359620-a4a4-4878-aee8-58e2bbed4a67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc2f98fa2a24ec3b103535b10d6305e', 'request_id': 'req-67359620-a4a4-4878-aee8-58e2bbed4a67'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.710062 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-67359620-a4a4-4878-aee8-58e2bbed4a67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc2f98fa2a24ec3b103535b10d6305e', 'request_id': 'req-67359620-a4a4-4878-aee8-58e2bbed4a67'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.720563 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-67359620-a4a4-4878-aee8-58e2bbed4a67 admin admin] The token cache is being invalidate because project bfc2f98fa2a24ec3b103535b10d6305e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:22.720882 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-67359620-a4a4-4878-aee8-58e2bbed4a67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.721506 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-67359620-a4a4-4878-aee8-58e2bbed4a67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.723057 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1155/2292] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:22 2022] DELETE /identity/v3/projects/bfc2f98fa2a24ec3b103535b10d6305e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:22.727268 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302649a-d386-48fc-a839-5a5fd9882e66 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:22.728844 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1302649a-d386-48fc-a839-5a5fd9882e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:22.746244 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302649a-d386-48fc-a839-5a5fd9882e66 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:22.823556 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f70824-5f0d-429f-91b0-fc2c33124525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:22.824906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f70824-5f0d-429f-91b0-fc2c33124525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:22.825199 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f70824-5f0d-429f-91b0-fc2c33124525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:22.825474 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f70824-5f0d-429f-91b0-fc2c33124525 admin admin] PATH_INFO: `/v3/users/9bd94e7212d340518f688652fdda304b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:22.827951 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f70824-5f0d-429f-91b0-fc2c33124525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bd94e7212d340518f688652fdda304b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:22.831159 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f70824-5f0d-429f-91b0-fc2c33124525 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:22.899480 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b9f70824-5f0d-429f-91b0-fc2c33124525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bd94e7212d340518f688652fdda304b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.900366 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b9f70824-5f0d-429f-91b0-fc2c33124525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bd94e7212d340518f688652fdda304b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.901272 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b9f70824-5f0d-429f-91b0-fc2c33124525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bd94e7212d340518f688652fdda304b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.918395 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b9f70824-5f0d-429f-91b0-fc2c33124525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bd94e7212d340518f688652fdda304b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.938382 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b9f70824-5f0d-429f-91b0-fc2c33124525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bd94e7212d340518f688652fdda304b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:22.956947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1138/2293] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:22 2022] DELETE /identity/v3/users/9bd94e7212d340518f688652fdda304b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:23.203092 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67359620-a4a4-4878-aee8-58e2bbed4a67 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:23.205189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-67359620-a4a4-4878-aee8-58e2bbed4a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:23.238733 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67359620-a4a4-4878-aee8-58e2bbed4a67 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:23.350831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb6c37-627e-473a-8794-1c2abd7ceaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:23.351708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb6c37-627e-473a-8794-1c2abd7ceaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:23.352902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb6c37-627e-473a-8794-1c2abd7ceaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:23.353217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb6c37-627e-473a-8794-1c2abd7ceaa8 admin admin] PATH_INFO: `/v3/projects/33b2fbb0b63340f791f3e60ac78f7ddf` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:23.354411 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb6c37-627e-473a-8794-1c2abd7ceaa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b2fbb0b63340f791f3e60ac78f7ddf)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:23.356326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb6c37-627e-473a-8794-1c2abd7ceaa8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:23.402612 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f70824-5f0d-429f-91b0-fc2c33124525 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:23.407021 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b9f70824-5f0d-429f-91b0-fc2c33124525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:23.449510 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cdeb6c37-627e-473a-8794-1c2abd7ceaa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b2fbb0b63340f791f3e60ac78f7ddf', 'request_id': 'req-cdeb6c37-627e-473a-8794-1c2abd7ceaa8'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:23.458061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cdeb6c37-627e-473a-8794-1c2abd7ceaa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b2fbb0b63340f791f3e60ac78f7ddf', 'request_id': 'req-cdeb6c37-627e-473a-8794-1c2abd7ceaa8'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:23.476619 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cdeb6c37-627e-473a-8794-1c2abd7ceaa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b2fbb0b63340f791f3e60ac78f7ddf', 'request_id': 'req-cdeb6c37-627e-473a-8794-1c2abd7ceaa8'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:23.477676 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f70824-5f0d-429f-91b0-fc2c33124525 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:23.493395 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cdeb6c37-627e-473a-8794-1c2abd7ceaa8 admin admin] The token cache is being invalidate because project 33b2fbb0b63340f791f3e60ac78f7ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:23.494162 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cdeb6c37-627e-473a-8794-1c2abd7ceaa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:23.495301 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cdeb6c37-627e-473a-8794-1c2abd7ceaa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:23.497351 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1156/2294] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:23 2022] DELETE /identity/v3/projects/33b2fbb0b63340f791f3e60ac78f7ddf => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:23.505401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d12cb-dc75-486d-bc4d-37774f9f274a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:23.508378 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d12cb-dc75-486d-bc4d-37774f9f274a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:23.508943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d12cb-dc75-486d-bc4d-37774f9f274a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:23.545319 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-336d12cb-dc75-486d-bc4d-37774f9f274a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:23.547042 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-336d12cb-dc75-486d-bc4d-37774f9f274a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:23.576068 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a3b75-21ab-48b7-a8dd-23cf9683942c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:23.576746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a3b75-21ab-48b7-a8dd-23cf9683942c service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:23.577048 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a3b75-21ab-48b7-a8dd-23cf9683942c service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:23.577325 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a3b75-21ab-48b7-a8dd-23cf9683942c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:23.584512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ab2a3b75-21ab-48b7-a8dd-23cf9683942c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:23.663472 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1157/2295] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:23.677653 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ab62e-9924-4567-a463-f3a1ea891647 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:23.677943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ab62e-9924-4567-a463-f3a1ea891647 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:23.688997 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ab62e-9924-4567-a463-f3a1ea891647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:23.706400 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a23ab62e-9924-4567-a463-f3a1ea891647 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:23.709280 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a23ab62e-9924-4567-a463-f3a1ea891647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:23.713259 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a3b75-21ab-48b7-a8dd-23cf9683942c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:23.714847 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a3b75-21ab-48b7-a8dd-23cf9683942c service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:23.722485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1158/2296] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:23.722884 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ab62e-9924-4567-a463-f3a1ea891647 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:23.727121 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1139/2297] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:07:23.734629 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ab62e-9924-4567-a463-f3a1ea891647 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:23.740052 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a54c0d-d2af-4b2b-876f-592b95d97ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:23.741121 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a54c0d-d2af-4b2b-876f-592b95d97ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:23.741813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a54c0d-d2af-4b2b-876f-592b95d97ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:23.741924 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a54c0d-d2af-4b2b-876f-592b95d97ae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:23.742985 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a54c0d-d2af-4b2b-876f-592b95d97ae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:07:23.743306 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a54c0d-d2af-4b2b-876f-592b95d97ae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:23.746833 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a54c0d-d2af-4b2b-876f-592b95d97ae0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:23.772342 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1159/2298] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:07:23.776751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a3b75-21ab-48b7-a8dd-23cf9683942c service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:23.791354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a3b75-21ab-48b7-a8dd-23cf9683942c service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:23.797281 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fca4d-3858-457e-b495-64a73f8ce4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:23.798103 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fca4d-3858-457e-b495-64a73f8ce4ce admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:23.798403 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fca4d-3858-457e-b495-64a73f8ce4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:23.798668 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fca4d-3858-457e-b495-64a73f8ce4ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:23.799476 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fca4d-3858-457e-b495-64a73f8ce4ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:23.801622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fca4d-3858-457e-b495-64a73f8ce4ce admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:23.865670 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1140/2299] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:23 2022] POST /identity/v3/projects => generated 363 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:23.866970 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a54c0d-d2af-4b2b-876f-592b95d97ae0 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:23.882051 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a54c0d-d2af-4b2b-876f-592b95d97ae0 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:23.967419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9cf62-b592-403b-84f6-422b40074e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:23.969052 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9cf62-b592-403b-84f6-422b40074e26 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:23.970669 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9cf62-b592-403b-84f6-422b40074e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:23.971231 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9cf62-b592-403b-84f6-422b40074e26 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:23.973692 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9cf62-b592-403b-84f6-422b40074e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:23.977164 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9cf62-b592-403b-84f6-422b40074e26 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:24.018682 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1160/2300] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:23 2022] POST /identity/v3/users => generated 282 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:07:24.019450 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fca4d-3858-457e-b495-64a73f8ce4ce admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:24.034848 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fca4d-3858-457e-b495-64a73f8ce4ce admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:24.042414 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2630d-7d1c-4e8e-b9f9-d06b019e4301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:24.043639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2630d-7d1c-4e8e-b9f9-d06b019e4301 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:24.043639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2630d-7d1c-4e8e-b9f9-d06b019e4301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:24.043923 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2630d-7d1c-4e8e-b9f9-d06b019e4301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:24.044654 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2630d-7d1c-4e8e-b9f9-d06b019e4301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:24.048358 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2630d-7d1c-4e8e-b9f9-d06b019e4301 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:24.090015 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1141/2301] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:24.093692 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9cf62-b592-403b-84f6-422b40074e26 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:24.111837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9cf62-b592-403b-84f6-422b40074e26 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:24.127651 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4fb4d-e5a6-4bc7-afdd-e9dd62fccd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:24.128618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4fb4d-e5a6-4bc7-afdd-e9dd62fccd38 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:24.130056 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4fb4d-e5a6-4bc7-afdd-e9dd62fccd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:24.130513 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4fb4d-e5a6-4bc7-afdd-e9dd62fccd38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:24.131469 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4fb4d-e5a6-4bc7-afdd-e9dd62fccd38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:24.133265 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4fb4d-e5a6-4bc7-afdd-e9dd62fccd38 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:24.154587 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1161/2302] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:07:24.156213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2630d-7d1c-4e8e-b9f9-d06b019e4301 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:24.173261 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2630d-7d1c-4e8e-b9f9-d06b019e4301 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:24.181783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef013f5-945f-4d0e-a63e-b811d563a38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:24.184840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef013f5-945f-4d0e-a63e-b811d563a38c admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:24.186441 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef013f5-945f-4d0e-a63e-b811d563a38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:24.188998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef013f5-945f-4d0e-a63e-b811d563a38c admin admin] PATH_INFO: `/v3/projects/504ed062d7374c07a5fcd5588ea11938/users/c55737c3b76142b0b8e33797add1baa8/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:24.220251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef013f5-945f-4d0e-a63e-b811d563a38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=504ed062d7374c07a5fcd5588ea11938, user_id=c55737c3b76142b0b8e33797add1baa8, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:24.227183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef013f5-945f-4d0e-a63e-b811d563a38c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:24.276765 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1142/2303] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:24 2022] PUT /identity/v3/projects/504ed062d7374c07a5fcd5588ea11938/users/c55737c3b76142b0b8e33797add1baa8/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:24.291272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59996d73-e375-4bfb-b3c4-99c063acdcf4 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:24.292228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59996d73-e375-4bfb-b3c4-99c063acdcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:24.292862 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59996d73-e375-4bfb-b3c4-99c063acdcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:24.358919 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-59996d73-e375-4bfb-b3c4-99c063acdcf4 None None] MFA Rules not processed for user `c55737c3b76142b0b8e33797add1baa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:24.361802 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-59996d73-e375-4bfb-b3c4-99c063acdcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:24.469424 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef013f5-945f-4d0e-a63e-b811d563a38c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:24.472534 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5ef013f5-945f-4d0e-a63e-b811d563a38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:24.513279 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1162/2304] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:24.567720 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59996d73-e375-4bfb-b3c4-99c063acdcf4 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:24.569635 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-59996d73-e375-4bfb-b3c4-99c063acdcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:24.607910 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef013f5-945f-4d0e-a63e-b811d563a38c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:24.613310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd528923-00bf-45c9-91ce-5d517ec0b5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:24.614577 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd528923-00bf-45c9-91ce-5d517ec0b5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:24.614933 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd528923-00bf-45c9-91ce-5d517ec0b5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:24.615331 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd528923-00bf-45c9-91ce-5d517ec0b5b3 admin admin] PATH_INFO: `/v3/users/9bc476d9a39c440fa6f8db3a6b2e3711` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:24.616732 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd528923-00bf-45c9-91ce-5d517ec0b5b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bc476d9a39c440fa6f8db3a6b2e3711)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:24.618853 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd528923-00bf-45c9-91ce-5d517ec0b5b3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:24.680364 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bd528923-00bf-45c9-91ce-5d517ec0b5b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bc476d9a39c440fa6f8db3a6b2e3711'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:24.681209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bd528923-00bf-45c9-91ce-5d517ec0b5b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bc476d9a39c440fa6f8db3a6b2e3711'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:24.681962 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bd528923-00bf-45c9-91ce-5d517ec0b5b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bc476d9a39c440fa6f8db3a6b2e3711'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:24.700710 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59996d73-e375-4bfb-b3c4-99c063acdcf4 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:24.701656 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bd528923-00bf-45c9-91ce-5d517ec0b5b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bc476d9a39c440fa6f8db3a6b2e3711'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:24.712588 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038288dc-337e-43e5-bf00-0a5b5c74b809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:24.713186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038288dc-337e-43e5-bf00-0a5b5c74b809 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:24.713466 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038288dc-337e-43e5-bf00-0a5b5c74b809 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:24.713740 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038288dc-337e-43e5-bf00-0a5b5c74b809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:24.715544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-038288dc-337e-43e5-bf00-0a5b5c74b809 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:24.728150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bd528923-00bf-45c9-91ce-5d517ec0b5b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bc476d9a39c440fa6f8db3a6b2e3711'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:24.746262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038288dc-337e-43e5-bf00-0a5b5c74b809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:24.747745 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038288dc-337e-43e5-bf00-0a5b5c74b809 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:24.759988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1143/2305] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:24 2022] DELETE /identity/v3/users/9bc476d9a39c440fa6f8db3a6b2e3711 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:24.764284 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36d359-edf2-4ca9-9020-bae5321af0bc None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:24.764574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36d359-edf2-4ca9-9020-bae5321af0bc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:24.764879 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36d359-edf2-4ca9-9020-bae5321af0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:24.776746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1163/2306] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:24 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:07:24.787798 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5e36d359-edf2-4ca9-9020-bae5321af0bc None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:24.789116 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5e36d359-edf2-4ca9-9020-bae5321af0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:24.840129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038288dc-337e-43e5-bf00-0a5b5c74b809 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:24.841668 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-038288dc-337e-43e5-bf00-0a5b5c74b809 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:24.855232 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038288dc-337e-43e5-bf00-0a5b5c74b809 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:24.896270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1144/2307] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:07:24.904038 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36d359-edf2-4ca9-9020-bae5321af0bc None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:24.906091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5e36d359-edf2-4ca9-9020-bae5321af0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:24.964735 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f407f38-85aa-4a33-b38b-57b2c0ed7097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:24.965758 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f407f38-85aa-4a33-b38b-57b2c0ed7097 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:24.966196 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f407f38-85aa-4a33-b38b-57b2c0ed7097 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:24.966565 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f407f38-85aa-4a33-b38b-57b2c0ed7097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:24.968940 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0f407f38-85aa-4a33-b38b-57b2c0ed7097 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:25.015274 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36d359-edf2-4ca9-9020-bae5321af0bc None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:25.020402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbe055-0a88-4d87-9899-c9391910473e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:25.021712 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbe055-0a88-4d87-9899-c9391910473e service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:25.022362 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbe055-0a88-4d87-9899-c9391910473e service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:25.022858 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbe055-0a88-4d87-9899-c9391910473e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:25.034715 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbe055-0a88-4d87-9899-c9391910473e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:25.036657 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbe055-0a88-4d87-9899-c9391910473e service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:25.054185 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1145/2308] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:07:25.096048 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f407f38-85aa-4a33-b38b-57b2c0ed7097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:25.098210 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f407f38-85aa-4a33-b38b-57b2c0ed7097 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:25.113051 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1164/2309] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:25.547176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbe055-0a88-4d87-9899-c9391910473e service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:25.548766 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a3bbe055-0a88-4d87-9899-c9391910473e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:25.577187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbe055-0a88-4d87-9899-c9391910473e service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:25.594639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb9169-1ce2-4b9d-b671-77da77945ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:25.599085 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb9169-1ce2-4b9d-b671-77da77945ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:25.599681 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb9169-1ce2-4b9d-b671-77da77945ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:25.599996 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb9169-1ce2-4b9d-b671-77da77945ce7 admin admin] PATH_INFO: `/v3/projects/92636337d1fc42088d2211ddd9011f9b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:25.601823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb9169-1ce2-4b9d-b671-77da77945ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92636337d1fc42088d2211ddd9011f9b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:25.603833 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb9169-1ce2-4b9d-b671-77da77945ce7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:25.669011 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-10eb9169-1ce2-4b9d-b671-77da77945ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92636337d1fc42088d2211ddd9011f9b', 'request_id': 'req-10eb9169-1ce2-4b9d-b671-77da77945ce7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:25.675413 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-10eb9169-1ce2-4b9d-b671-77da77945ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92636337d1fc42088d2211ddd9011f9b', 'request_id': 'req-10eb9169-1ce2-4b9d-b671-77da77945ce7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:25.688697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-10eb9169-1ce2-4b9d-b671-77da77945ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92636337d1fc42088d2211ddd9011f9b', 'request_id': 'req-10eb9169-1ce2-4b9d-b671-77da77945ce7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:25.700913 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-10eb9169-1ce2-4b9d-b671-77da77945ce7 admin admin] The token cache is being invalidate because project 92636337d1fc42088d2211ddd9011f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:25.701295 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-10eb9169-1ce2-4b9d-b671-77da77945ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:25.702046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-10eb9169-1ce2-4b9d-b671-77da77945ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:25.703691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1146/2310] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:25 2022] DELETE /identity/v3/projects/92636337d1fc42088d2211ddd9011f9b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:25.709732 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc430f0-0637-4c78-9806-75812bf71ec5 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:25.710949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc430f0-0637-4c78-9806-75812bf71ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:25.711406 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc430f0-0637-4c78-9806-75812bf71ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:25.746973 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9dc430f0-0637-4c78-9806-75812bf71ec5 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:25.749680 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9dc430f0-0637-4c78-9806-75812bf71ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:25.847227 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1165/2311] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:25.856109 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd288ef-b973-4a2c-a098-0331be8557e7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:25.856419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd288ef-b973-4a2c-a098-0331be8557e7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:25.856667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd288ef-b973-4a2c-a098-0331be8557e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:25.879127 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-bbd288ef-b973-4a2c-a098-0331be8557e7 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:25.880833 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bbd288ef-b973-4a2c-a098-0331be8557e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:25.894185 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc430f0-0637-4c78-9806-75812bf71ec5 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:25.894708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1147/2312] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:25.907240 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc430f0-0637-4c78-9806-75812bf71ec5 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:25.915926 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0caa9-2111-4c2f-bb5c-61b3bc44b033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:25.918396 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0caa9-2111-4c2f-bb5c-61b3bc44b033 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:25.919467 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0caa9-2111-4c2f-bb5c-61b3bc44b033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:25.919826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0caa9-2111-4c2f-bb5c-61b3bc44b033 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:25.921164 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0caa9-2111-4c2f-bb5c-61b3bc44b033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:07:25.924773 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0caa9-2111-4c2f-bb5c-61b3bc44b033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:25.930497 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0caa9-2111-4c2f-bb5c-61b3bc44b033 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:25.949274 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1166/2313] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:07:25.951231 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd288ef-b973-4a2c-a098-0331be8557e7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:25.960621 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd288ef-b973-4a2c-a098-0331be8557e7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:25.973576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bb8e7-a1d0-45bd-86d0-ac66ec3806ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:25.974264 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bb8e7-a1d0-45bd-86d0-ac66ec3806ad admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:25.974541 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bb8e7-a1d0-45bd-86d0-ac66ec3806ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:25.974814 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bb8e7-a1d0-45bd-86d0-ac66ec3806ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:25.975516 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bb8e7-a1d0-45bd-86d0-ac66ec3806ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:25.977479 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bb8e7-a1d0-45bd-86d0-ac66ec3806ad admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:26.019202 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1148/2314] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:25 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:26.022003 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0caa9-2111-4c2f-bb5c-61b3bc44b033 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:26.038963 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0caa9-2111-4c2f-bb5c-61b3bc44b033 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:26.137638 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f3b99-2f02-46af-a3fe-9e5ff8cf109a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:26.138431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3b99-2f02-46af-a3fe-9e5ff8cf109a admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:26.138869 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3b99-2f02-46af-a3fe-9e5ff8cf109a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:26.139176 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3b99-2f02-46af-a3fe-9e5ff8cf109a admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:26.140302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f3b99-2f02-46af-a3fe-9e5ff8cf109a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:26.142654 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f3b99-2f02-46af-a3fe-9e5ff8cf109a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:26.186491 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1167/2315] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:26 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:26.186935 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bb8e7-a1d0-45bd-86d0-ac66ec3806ad admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:26.199792 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bb8e7-a1d0-45bd-86d0-ac66ec3806ad admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:26.217536 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72532072-20ca-429d-8af8-95abc0cd6a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:26.218514 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532072-20ca-429d-8af8-95abc0cd6a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:26.219428 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532072-20ca-429d-8af8-95abc0cd6a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:26.219428 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72532072-20ca-429d-8af8-95abc0cd6a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:26.220469 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72532072-20ca-429d-8af8-95abc0cd6a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:26.222617 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72532072-20ca-429d-8af8-95abc0cd6a5c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:26.244589 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1149/2316] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:26.248282 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f3b99-2f02-46af-a3fe-9e5ff8cf109a admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:26.264622 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f3b99-2f02-46af-a3fe-9e5ff8cf109a admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:26.285408 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59c3c9-cf78-453e-8930-efff122d96ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:26.288234 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59c3c9-cf78-453e-8930-efff122d96ae admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:26.289206 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59c3c9-cf78-453e-8930-efff122d96ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:26.290521 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59c3c9-cf78-453e-8930-efff122d96ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:26.291495 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59c3c9-cf78-453e-8930-efff122d96ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:26.293402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59c3c9-cf78-453e-8930-efff122d96ae admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:26.323572 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1168/2317] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:26.324105 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72532072-20ca-429d-8af8-95abc0cd6a5c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:26.335484 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72532072-20ca-429d-8af8-95abc0cd6a5c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:26.345612 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ae5bb-0183-4c7e-b10d-83de5ed30449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:26.346835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ae5bb-0183-4c7e-b10d-83de5ed30449 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:26.347675 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ae5bb-0183-4c7e-b10d-83de5ed30449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:26.348764 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ae5bb-0183-4c7e-b10d-83de5ed30449 admin admin] PATH_INFO: `/v3/projects/6f9bc037cd2b4387be10eee570bf5248/users/743884bf3ffa4e00b87c5169747eea77/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:26.382055 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ae5bb-0183-4c7e-b10d-83de5ed30449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9bc037cd2b4387be10eee570bf5248, user_id=743884bf3ffa4e00b87c5169747eea77, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:26.386588 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ae5bb-0183-4c7e-b10d-83de5ed30449 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:26.421037 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1150/2318] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:26 2022] PUT /identity/v3/projects/6f9bc037cd2b4387be10eee570bf5248/users/743884bf3ffa4e00b87c5169747eea77/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:26.425118 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e9aa8-24e1-4f45-86bf-7f338dbeeabb None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:26.425412 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e9aa8-24e1-4f45-86bf-7f338dbeeabb None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:26.425697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e9aa8-24e1-4f45-86bf-7f338dbeeabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:26.481655 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-608e9aa8-24e1-4f45-86bf-7f338dbeeabb None None] MFA Rules not processed for user `743884bf3ffa4e00b87c5169747eea77`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:26.484047 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-608e9aa8-24e1-4f45-86bf-7f338dbeeabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:26.671588 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1169/2319] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:26.681725 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ae5bb-0183-4c7e-b10d-83de5ed30449 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:26.772412 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ae5bb-0183-4c7e-b10d-83de5ed30449 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:26.780911 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e406fb-b401-479c-968e-b5d3f9d9cdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:26.781665 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e406fb-b401-479c-968e-b5d3f9d9cdf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:26.781954 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e406fb-b401-479c-968e-b5d3f9d9cdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:26.783581 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e406fb-b401-479c-968e-b5d3f9d9cdf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:26.784501 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e406fb-b401-479c-968e-b5d3f9d9cdf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:26.788381 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e406fb-b401-479c-968e-b5d3f9d9cdf3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:26.824426 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e9aa8-24e1-4f45-86bf-7f338dbeeabb None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:26.826003 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-608e9aa8-24e1-4f45-86bf-7f338dbeeabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:26.854868 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e9aa8-24e1-4f45-86bf-7f338dbeeabb None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:26.855715 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1151/2320] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:26 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:26.859840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e406fb-b401-479c-968e-b5d3f9d9cdf3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:27.007298 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c5c51-3b07-4839-902e-d0f2bbbf5014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:27.008370 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c5c51-3b07-4839-902e-d0f2bbbf5014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:27.008653 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c5c51-3b07-4839-902e-d0f2bbbf5014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:27.009035 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c5c51-3b07-4839-902e-d0f2bbbf5014 admin admin] PATH_INFO: `/v3/users/86f1f7433c86479a88c84b9176bcbb3f` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:27.010272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c5c51-3b07-4839-902e-d0f2bbbf5014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86f1f7433c86479a88c84b9176bcbb3f)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:27.012440 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c5c51-3b07-4839-902e-d0f2bbbf5014 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:27.014085 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e406fb-b401-479c-968e-b5d3f9d9cdf3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:27.025763 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446719f1-2248-4d6e-bb6b-3c75345f3403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:27.026685 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446719f1-2248-4d6e-bb6b-3c75345f3403 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:27.028050 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446719f1-2248-4d6e-bb6b-3c75345f3403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:27.028852 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446719f1-2248-4d6e-bb6b-3c75345f3403 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:27.029756 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446719f1-2248-4d6e-bb6b-3c75345f3403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:27.032722 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446719f1-2248-4d6e-bb6b-3c75345f3403 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:27.066057 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1152/2321] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:26 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:27.071488 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446719f1-2248-4d6e-bb6b-3c75345f3403 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:27.074618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-9a9c5c51-3b07-4839-902e-d0f2bbbf5014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86f1f7433c86479a88c84b9176bcbb3f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:27.075444 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-9a9c5c51-3b07-4839-902e-d0f2bbbf5014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86f1f7433c86479a88c84b9176bcbb3f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:27.076049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-9a9c5c51-3b07-4839-902e-d0f2bbbf5014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86f1f7433c86479a88c84b9176bcbb3f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:27.084908 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-9a9c5c51-3b07-4839-902e-d0f2bbbf5014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86f1f7433c86479a88c84b9176bcbb3f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:27.087670 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446719f1-2248-4d6e-bb6b-3c75345f3403 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:27.092546 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0a314-e0f1-4a06-8b69-eadaa3c5bcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:27.093360 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a314-e0f1-4a06-8b69-eadaa3c5bcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:27.093645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a314-e0f1-4a06-8b69-eadaa3c5bcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:27.093923 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0a314-e0f1-4a06-8b69-eadaa3c5bcf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:27.094646 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0a314-e0f1-4a06-8b69-eadaa3c5bcf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:27.096375 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0a314-e0f1-4a06-8b69-eadaa3c5bcf9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:27.101078 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-9a9c5c51-3b07-4839-902e-d0f2bbbf5014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86f1f7433c86479a88c84b9176bcbb3f'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:27.108645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1153/2322] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:27.112755 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0a314-e0f1-4a06-8b69-eadaa3c5bcf9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:27.114941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-75a0a314-e0f1-4a06-8b69-eadaa3c5bcf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:27.120179 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1170/2323] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:26 2022] DELETE /identity/v3/users/86f1f7433c86479a88c84b9176bcbb3f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:27.132990 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0a314-e0f1-4a06-8b69-eadaa3c5bcf9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:27.222191 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194dd11-09f5-4ea9-9009-88d75156e19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:27.223908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194dd11-09f5-4ea9-9009-88d75156e19c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:27.224317 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194dd11-09f5-4ea9-9009-88d75156e19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:27.224662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194dd11-09f5-4ea9-9009-88d75156e19c admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:27.225545 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194dd11-09f5-4ea9-9009-88d75156e19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:27.227433 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194dd11-09f5-4ea9-9009-88d75156e19c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:27.250398 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1154/2324] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:07:27.255913 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c5c51-3b07-4839-902e-d0f2bbbf5014 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:27.273100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c5c51-3b07-4839-902e-d0f2bbbf5014 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:27.294828 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46539-5f2d-496e-8591-59883129346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:27.296702 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46539-5f2d-496e-8591-59883129346a admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:27.297091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46539-5f2d-496e-8591-59883129346a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:27.297376 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46539-5f2d-496e-8591-59883129346a admin admin] PATH_INFO: `/v3/projects/f00f8bcdd82d4cd3a2e4ac9bd284f13d/users/9b418be587924bf697628888a252caba/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:27.355732 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e46539-5f2d-496e-8591-59883129346a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f00f8bcdd82d4cd3a2e4ac9bd284f13d, user_id=9b418be587924bf697628888a252caba, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:27.359277 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e46539-5f2d-496e-8591-59883129346a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:27.373213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194dd11-09f5-4ea9-9009-88d75156e19c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:27.375010 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b194dd11-09f5-4ea9-9009-88d75156e19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:27.393046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194dd11-09f5-4ea9-9009-88d75156e19c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:27.407921 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1171/2325] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:27 2022] PUT /identity/v3/projects/f00f8bcdd82d4cd3a2e4ac9bd284f13d/users/9b418be587924bf697628888a252caba/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:27.419892 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd1196-83d0-4c2f-a646-f2051b86aac6 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:27.420186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd1196-83d0-4c2f-a646-f2051b86aac6 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:27.420460 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd1196-83d0-4c2f-a646-f2051b86aac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:27.454640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b9fd1196-83d0-4c2f-a646-f2051b86aac6 None None] MFA Rules not processed for user `9b418be587924bf697628888a252caba`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:27.455972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b9fd1196-83d0-4c2f-a646-f2051b86aac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:27.479864 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b4caa-938d-4dca-9da8-cb1ff7cb4452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:27.482006 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b4caa-938d-4dca-9da8-cb1ff7cb4452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:27.482297 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b4caa-938d-4dca-9da8-cb1ff7cb4452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:27.482831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b4caa-938d-4dca-9da8-cb1ff7cb4452 admin admin] PATH_INFO: `/v3/projects/87b71717e9a341c285b3c63925612c77` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:27.486296 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b4caa-938d-4dca-9da8-cb1ff7cb4452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b71717e9a341c285b3c63925612c77)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:27.488589 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b4caa-938d-4dca-9da8-cb1ff7cb4452 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:27.568443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1172/2326] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:07:27.573409 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd1196-83d0-4c2f-a646-f2051b86aac6 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:27.573727 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ad8b4caa-938d-4dca-9da8-cb1ff7cb4452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b71717e9a341c285b3c63925612c77', 'request_id': 'req-ad8b4caa-938d-4dca-9da8-cb1ff7cb4452'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:27.583697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ad8b4caa-938d-4dca-9da8-cb1ff7cb4452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b71717e9a341c285b3c63925612c77', 'request_id': 'req-ad8b4caa-938d-4dca-9da8-cb1ff7cb4452'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:27.591540 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd1196-83d0-4c2f-a646-f2051b86aac6 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:27.591964 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ad8b4caa-938d-4dca-9da8-cb1ff7cb4452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b71717e9a341c285b3c63925612c77', 'request_id': 'req-ad8b4caa-938d-4dca-9da8-cb1ff7cb4452'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:27.604504 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ad8b4caa-938d-4dca-9da8-cb1ff7cb4452 admin admin] The token cache is being invalidate because project 87b71717e9a341c285b3c63925612c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:27.605464 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ad8b4caa-938d-4dca-9da8-cb1ff7cb4452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:27.606177 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ad8b4caa-938d-4dca-9da8-cb1ff7cb4452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:27.608187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1155/2327] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:27 2022] DELETE /identity/v3/projects/87b71717e9a341c285b3c63925612c77 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:27.612952 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e956a-3114-472d-aa15-9ecf71184ead None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:27.613245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e956a-3114-472d-aa15-9ecf71184ead None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:27.613552 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e956a-3114-472d-aa15-9ecf71184ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:27.636536 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-991e956a-3114-472d-aa15-9ecf71184ead None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:27.638729 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-991e956a-3114-472d-aa15-9ecf71184ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:27.658453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c576d-0d73-4bb3-84c7-5adb6e569ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:27.659190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c576d-0d73-4bb3-84c7-5adb6e569ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:27.659551 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c576d-0d73-4bb3-84c7-5adb6e569ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:27.659893 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c576d-0d73-4bb3-84c7-5adb6e569ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:27.662848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c576d-0d73-4bb3-84c7-5adb6e569ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:27.663464 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c576d-0d73-4bb3-84c7-5adb6e569ab3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:27.695433 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1173/2328] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:27 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:07:27.696614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c576d-0d73-4bb3-84c7-5adb6e569ab3 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:27.698844 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-590c576d-0d73-4bb3-84c7-5adb6e569ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:27.716009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1156/2329] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:27.725805 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d0aaf-72bd-46c4-bf69-0225933ce3bb None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:27.726350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d0aaf-72bd-46c4-bf69-0225933ce3bb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:27.726794 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d0aaf-72bd-46c4-bf69-0225933ce3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:27.755479 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-926d0aaf-72bd-46c4-bf69-0225933ce3bb None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:27.757325 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-926d0aaf-72bd-46c4-bf69-0225933ce3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:27.781748 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c576d-0d73-4bb3-84c7-5adb6e569ab3 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:27.788106 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b13ed3-a237-4692-81f5-c95c9b1dc6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:27.789029 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b13ed3-a237-4692-81f5-c95c9b1dc6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:27.789366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b13ed3-a237-4692-81f5-c95c9b1dc6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:27.789706 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b13ed3-a237-4692-81f5-c95c9b1dc6f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:27.790547 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b13ed3-a237-4692-81f5-c95c9b1dc6f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:27.792672 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b13ed3-a237-4692-81f5-c95c9b1dc6f9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:27.816182 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1174/2330] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:27 2022] POST /identity/v3/users => generated 298 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:07:27.819765 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b13ed3-a237-4692-81f5-c95c9b1dc6f9 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:27.828474 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1157/2331] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:27.829655 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b13ed3-a237-4692-81f5-c95c9b1dc6f9 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:27.833102 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d0aaf-72bd-46c4-bf69-0225933ce3bb None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:27.836291 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfb46b-5879-4c39-b223-3046b8f907fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:27.837195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfb46b-5879-4c39-b223-3046b8f907fb admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:27.837837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfb46b-5879-4c39-b223-3046b8f907fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:27.838275 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfb46b-5879-4c39-b223-3046b8f907fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:27.839160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfb46b-5879-4c39-b223-3046b8f907fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:27.840957 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecfb46b-5879-4c39-b223-3046b8f907fb admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:27.843422 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d0aaf-72bd-46c4-bf69-0225933ce3bb None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:27.849053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b608e1-d3ff-4fac-9160-9c4ab172601c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:27.849972 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b608e1-d3ff-4fac-9160-9c4ab172601c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:27.850425 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b608e1-d3ff-4fac-9160-9c4ab172601c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:27.850527 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b608e1-d3ff-4fac-9160-9c4ab172601c admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:27.851354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b608e1-d3ff-4fac-9160-9c4ab172601c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:07:27.851659 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b608e1-d3ff-4fac-9160-9c4ab172601c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:27.853275 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b608e1-d3ff-4fac-9160-9c4ab172601c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:27.853775 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1175/2332] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:27.857729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfb46b-5879-4c39-b223-3046b8f907fb admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:27.878433 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecfb46b-5879-4c39-b223-3046b8f907fb admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:27.878565 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1158/2333] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 05:07:27.878565 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b608e1-d3ff-4fac-9160-9c4ab172601c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:27.879006 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb308d-1b8e-48b7-8bd6-ee861049b7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:27.879006 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb308d-1b8e-48b7-8bd6-ee861049b7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:27.879006 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb308d-1b8e-48b7-8bd6-ee861049b7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:27.879006 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb308d-1b8e-48b7-8bd6-ee861049b7ed admin admin] PATH_INFO: `/v3/projects/6bc361f62811445b98071f4e06ae2bb8/users/fdb6de9e0ebe469d956b140660f3ae45/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:27.882418 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b608e1-d3ff-4fac-9160-9c4ab172601c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:27.887032 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841edb19-e95a-41df-a70d-0dffeb511b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:27.887731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841edb19-e95a-41df-a70d-0dffeb511b5c admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:27.888039 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841edb19-e95a-41df-a70d-0dffeb511b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:27.888311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841edb19-e95a-41df-a70d-0dffeb511b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:27.889058 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841edb19-e95a-41df-a70d-0dffeb511b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:27.891263 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb308d-1b8e-48b7-8bd6-ee861049b7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc361f62811445b98071f4e06ae2bb8, user_id=fdb6de9e0ebe469d956b140660f3ae45, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:27.891702 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841edb19-e95a-41df-a70d-0dffeb511b5c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:27.893988 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb308d-1b8e-48b7-8bd6-ee861049b7ed admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:27.908529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1176/2334] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:27 2022] PUT /identity/v3/projects/6bc361f62811445b98071f4e06ae2bb8/users/fdb6de9e0ebe469d956b140660f3ae45/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:27.913457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb308d-1b8e-48b7-8bd6-ee861049b7ed admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:27.919272 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1159/2335] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:27 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:27.923120 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841edb19-e95a-41df-a70d-0dffeb511b5c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:27.980490 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb308d-1b8e-48b7-8bd6-ee861049b7ed admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:27.985435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca1667-fb9a-48f4-9a6d-e602f78829c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:27.986104 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca1667-fb9a-48f4-9a6d-e602f78829c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:27.986385 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca1667-fb9a-48f4-9a6d-e602f78829c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:27.986718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca1667-fb9a-48f4-9a6d-e602f78829c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:27.987446 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca1667-fb9a-48f4-9a6d-e602f78829c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:27.988826 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841edb19-e95a-41df-a70d-0dffeb511b5c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:27.989091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca1667-fb9a-48f4-9a6d-e602f78829c7 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:28.001558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1177/2336] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:07:28.006262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca1667-fb9a-48f4-9a6d-e602f78829c7 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:28.007220 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4041a-9445-4be0-aadb-65d292bb7721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:28.007972 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4041a-9445-4be0-aadb-65d292bb7721 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:28.008262 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4041a-9445-4be0-aadb-65d292bb7721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:28.008562 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4041a-9445-4be0-aadb-65d292bb7721 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:28.009293 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4041a-9445-4be0-aadb-65d292bb7721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:28.011320 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4041a-9445-4be0-aadb-65d292bb7721 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:28.015852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca1667-fb9a-48f4-9a6d-e602f78829c7 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:28.023118 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfe979-4311-4b0f-9b02-048913fbefb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:28.023990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfe979-4311-4b0f-9b02-048913fbefb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:28.024266 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfe979-4311-4b0f-9b02-048913fbefb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:28.024537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfe979-4311-4b0f-9b02-048913fbefb0 admin admin] PATH_INFO: `/v3/projects/6bc361f62811445b98071f4e06ae2bb8/users/fdb6de9e0ebe469d956b140660f3ae45/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:28.026560 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfe979-4311-4b0f-9b02-048913fbefb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc361f62811445b98071f4e06ae2bb8, user_id=fdb6de9e0ebe469d956b140660f3ae45, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:28.029323 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfe979-4311-4b0f-9b02-048913fbefb0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:28.037911 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1160/2337] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:27 2022] POST /identity/v3/users => generated 295 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:07:28.040528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1178/2338] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:28 2022] PUT /identity/v3/projects/6bc361f62811445b98071f4e06ae2bb8/users/fdb6de9e0ebe469d956b140660f3ae45/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:28.041867 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4041a-9445-4be0-aadb-65d292bb7721 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:28.050767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5fffa-b0dc-46fd-b033-20f3ef68786d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:28.051081 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5fffa-b0dc-46fd-b033-20f3ef68786d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:28.051529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5fffa-b0dc-46fd-b033-20f3ef68786d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:28.052227 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4041a-9445-4be0-aadb-65d292bb7721 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:28.092003 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1dd5fffa-b0dc-46fd-b033-20f3ef68786d None None] MFA Rules not processed for user `fdb6de9e0ebe469d956b140660f3ae45`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:28.093244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1dd5fffa-b0dc-46fd-b033-20f3ef68786d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:28.129680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fe557-2d30-4d50-81c1-d7492a39b863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:28.129680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fe557-2d30-4d50-81c1-d7492a39b863 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:28.129680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fe557-2d30-4d50-81c1-d7492a39b863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:28.129680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fe557-2d30-4d50-81c1-d7492a39b863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:28.130037 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fe557-2d30-4d50-81c1-d7492a39b863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:28.130037 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fe557-2d30-4d50-81c1-d7492a39b863 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:28.133497 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1161/2339] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:07:28.137797 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fe557-2d30-4d50-81c1-d7492a39b863 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:28.149043 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fe557-2d30-4d50-81c1-d7492a39b863 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:28.153569 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3205e80-0df8-41d7-9e58-38ca957ca22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:28.154228 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3205e80-0df8-41d7-9e58-38ca957ca22c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:28.154550 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3205e80-0df8-41d7-9e58-38ca957ca22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:28.154783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3205e80-0df8-41d7-9e58-38ca957ca22c admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:28.155517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3205e80-0df8-41d7-9e58-38ca957ca22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:28.157190 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3205e80-0df8-41d7-9e58-38ca957ca22c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:28.168358 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1162/2340] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:28.172422 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3205e80-0df8-41d7-9e58-38ca957ca22c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:28.173972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1179/2341] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:28.183971 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3205e80-0df8-41d7-9e58-38ca957ca22c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:28.187120 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5fffa-b0dc-46fd-b033-20f3ef68786d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:28.188631 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1dd5fffa-b0dc-46fd-b033-20f3ef68786d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:28.193648 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a82293-0725-47d8-87cd-6e157197bd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:28.194548 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a82293-0725-47d8-87cd-6e157197bd59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:28.194829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a82293-0725-47d8-87cd-6e157197bd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:28.195111 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a82293-0725-47d8-87cd-6e157197bd59 admin admin] PATH_INFO: `/v3/projects/b8550668d08c4227904042b8a49bc261/users/e5cb068154f04e93b2a301d46164d001/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:28.213192 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a82293-0725-47d8-87cd-6e157197bd59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8550668d08c4227904042b8a49bc261, user_id=e5cb068154f04e93b2a301d46164d001, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:28.216033 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a82293-0725-47d8-87cd-6e157197bd59 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:28.234718 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1163/2342] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:28 2022] PUT /identity/v3/projects/b8550668d08c4227904042b8a49bc261/users/e5cb068154f04e93b2a301d46164d001/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:28.236171 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2dafc-eeb5-4e87-bc4a-d89b5c2da620 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:28.236508 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2dafc-eeb5-4e87-bc4a-d89b5c2da620 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:28.236857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2dafc-eeb5-4e87-bc4a-d89b5c2da620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:28.256981 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5fffa-b0dc-46fd-b033-20f3ef68786d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:28.258035 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-07c2dafc-eeb5-4e87-bc4a-d89b5c2da620 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:28.259335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-07c2dafc-eeb5-4e87-bc4a-d89b5c2da620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:28.317504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368240ca-f905-4afa-ad41-926f6bb3b013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:28.318500 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368240ca-f905-4afa-ad41-926f6bb3b013 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:28.318832 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368240ca-f905-4afa-ad41-926f6bb3b013 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:28.319117 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368240ca-f905-4afa-ad41-926f6bb3b013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:28.321553 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-368240ca-f905-4afa-ad41-926f6bb3b013 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:28.323183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1164/2343] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:07:28.332769 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2dafc-eeb5-4e87-bc4a-d89b5c2da620 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:28.337427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-07c2dafc-eeb5-4e87-bc4a-d89b5c2da620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:28.400091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368240ca-f905-4afa-ad41-926f6bb3b013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:28.401784 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368240ca-f905-4afa-ad41-926f6bb3b013 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:28.412389 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1180/2344] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:07:28.422372 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2dafc-eeb5-4e87-bc4a-d89b5c2da620 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:28.428926 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e319e2e-e61e-487d-a8d9-7b5fce036d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:28.428926 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e319e2e-e61e-487d-a8d9-7b5fce036d31 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:28.428926 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e319e2e-e61e-487d-a8d9-7b5fce036d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:28.429343 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e319e2e-e61e-487d-a8d9-7b5fce036d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:28.438860 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e319e2e-e61e-487d-a8d9-7b5fce036d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:28.440297 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e319e2e-e61e-487d-a8d9-7b5fce036d31 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:28.450643 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1165/2345] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:07:29.521148 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368240ca-f905-4afa-ad41-926f6bb3b013 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:29.523920 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-368240ca-f905-4afa-ad41-926f6bb3b013 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:29.545841 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368240ca-f905-4afa-ad41-926f6bb3b013 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:29.553383 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcf01f-a079-4791-961e-11c7e803d7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:29.554615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcf01f-a079-4791-961e-11c7e803d7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:29.557718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcf01f-a079-4791-961e-11c7e803d7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:29.558736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcf01f-a079-4791-961e-11c7e803d7c3 admin admin] PATH_INFO: `/v3/users/4ee5a325a4894f239b299e74862250f6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:29.560334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcf01f-a079-4791-961e-11c7e803d7c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee5a325a4894f239b299e74862250f6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:29.563783 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcf01f-a079-4791-961e-11c7e803d7c3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:29.652118 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-95dcf01f-a079-4791-961e-11c7e803d7c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee5a325a4894f239b299e74862250f6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:29.653209 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-95dcf01f-a079-4791-961e-11c7e803d7c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee5a325a4894f239b299e74862250f6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:29.654331 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-95dcf01f-a079-4791-961e-11c7e803d7c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee5a325a4894f239b299e74862250f6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:29.667826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-95dcf01f-a079-4791-961e-11c7e803d7c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee5a325a4894f239b299e74862250f6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:29.685761 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-95dcf01f-a079-4791-961e-11c7e803d7c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee5a325a4894f239b299e74862250f6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:29.702878 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1181/2346] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:29 2022] DELETE /identity/v3/users/4ee5a325a4894f239b299e74862250f6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:29.708834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfad908-0f05-4b35-901d-cc578b334343 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:29.708834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfad908-0f05-4b35-901d-cc578b334343 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:29.708834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfad908-0f05-4b35-901d-cc578b334343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:29.730389 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-bbfad908-0f05-4b35-901d-cc578b334343 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:29.731718 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bbfad908-0f05-4b35-901d-cc578b334343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:29.840841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1166/2347] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:29.860642 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcf01f-a079-4791-961e-11c7e803d7c3 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:29.862432 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-95dcf01f-a079-4791-961e-11c7e803d7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:30.003287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcf01f-a079-4791-961e-11c7e803d7c3 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:30.010848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be3d41-a4f3-44d1-b86e-7bcbaa6794f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:30.011522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be3d41-a4f3-44d1-b86e-7bcbaa6794f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:30.011850 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be3d41-a4f3-44d1-b86e-7bcbaa6794f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:30.012729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be3d41-a4f3-44d1-b86e-7bcbaa6794f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:30.035177 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be3d41-a4f3-44d1-b86e-7bcbaa6794f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:30.036964 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be3d41-a4f3-44d1-b86e-7bcbaa6794f7 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:30.069572 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1182/2348] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:30.131277 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfad908-0f05-4b35-901d-cc578b334343 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:30.133393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bbfad908-0f05-4b35-901d-cc578b334343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:30.237278 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfad908-0f05-4b35-901d-cc578b334343 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:30.243241 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54889652-cce6-41aa-98ef-318bc6baed86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:30.244669 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54889652-cce6-41aa-98ef-318bc6baed86 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:30.244886 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54889652-cce6-41aa-98ef-318bc6baed86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:30.245302 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54889652-cce6-41aa-98ef-318bc6baed86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:30.254896 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-54889652-cce6-41aa-98ef-318bc6baed86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:30.366041 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54889652-cce6-41aa-98ef-318bc6baed86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:30.367684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54889652-cce6-41aa-98ef-318bc6baed86 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:30.378548 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1167/2349] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:30.509583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be3d41-a4f3-44d1-b86e-7bcbaa6794f7 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:30.511346 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f6be3d41-a4f3-44d1-b86e-7bcbaa6794f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:30.587351 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be3d41-a4f3-44d1-b86e-7bcbaa6794f7 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:30.594113 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae2685-8317-402f-90e8-7ca2d9db7ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:30.595078 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae2685-8317-402f-90e8-7ca2d9db7ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:30.595621 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae2685-8317-402f-90e8-7ca2d9db7ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:30.596156 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae2685-8317-402f-90e8-7ca2d9db7ac6 admin admin] PATH_INFO: `/v3/projects/17a3c669bab54e14864dab82f15213d5` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:30.597760 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae2685-8317-402f-90e8-7ca2d9db7ac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a3c669bab54e14864dab82f15213d5)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:30.600101 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae2685-8317-402f-90e8-7ca2d9db7ac6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:30.671730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bbae2685-8317-402f-90e8-7ca2d9db7ac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a3c669bab54e14864dab82f15213d5', 'request_id': 'req-bbae2685-8317-402f-90e8-7ca2d9db7ac6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:30.680439 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bbae2685-8317-402f-90e8-7ca2d9db7ac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a3c669bab54e14864dab82f15213d5', 'request_id': 'req-bbae2685-8317-402f-90e8-7ca2d9db7ac6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:30.689460 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bbae2685-8317-402f-90e8-7ca2d9db7ac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a3c669bab54e14864dab82f15213d5', 'request_id': 'req-bbae2685-8317-402f-90e8-7ca2d9db7ac6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:30.704062 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bbae2685-8317-402f-90e8-7ca2d9db7ac6 admin admin] The token cache is being invalidate because project 17a3c669bab54e14864dab82f15213d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:30.704443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bbae2685-8317-402f-90e8-7ca2d9db7ac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:30.705171 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-bbae2685-8317-402f-90e8-7ca2d9db7ac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:30.706897 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1183/2350] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:30 2022] DELETE /identity/v3/projects/17a3c669bab54e14864dab82f15213d5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:30.711119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54889652-cce6-41aa-98ef-318bc6baed86 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:30.722782 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54889652-cce6-41aa-98ef-318bc6baed86 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:30.787857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba88e4a-a3d1-4cbb-8a94-8a5b6da8a736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:30.788761 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba88e4a-a3d1-4cbb-8a94-8a5b6da8a736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:30.789075 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba88e4a-a3d1-4cbb-8a94-8a5b6da8a736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:30.789348 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba88e4a-a3d1-4cbb-8a94-8a5b6da8a736 admin admin] PATH_INFO: `/v3/users/97049bbcd1484caf921ad98c8a099059` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:30.790599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba88e4a-a3d1-4cbb-8a94-8a5b6da8a736 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97049bbcd1484caf921ad98c8a099059)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:30.792582 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba88e4a-a3d1-4cbb-8a94-8a5b6da8a736 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:30.832222 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae2685-8317-402f-90e8-7ca2d9db7ac6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:30.836367 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-bbae2685-8317-402f-90e8-7ca2d9db7ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:30.856983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae2685-8317-402f-90e8-7ca2d9db7ac6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:30.859472 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-aba88e4a-a3d1-4cbb-8a94-8a5b6da8a736 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97049bbcd1484caf921ad98c8a099059'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:30.860464 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-aba88e4a-a3d1-4cbb-8a94-8a5b6da8a736 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97049bbcd1484caf921ad98c8a099059'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:30.861585 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-aba88e4a-a3d1-4cbb-8a94-8a5b6da8a736 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97049bbcd1484caf921ad98c8a099059'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:30.874831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-aba88e4a-a3d1-4cbb-8a94-8a5b6da8a736 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97049bbcd1484caf921ad98c8a099059'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:30.883327 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04369bee-257d-4cf3-9ddb-8244a6cd9bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:30.884335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04369bee-257d-4cf3-9ddb-8244a6cd9bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:30.884684 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04369bee-257d-4cf3-9ddb-8244a6cd9bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:30.885704 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04369bee-257d-4cf3-9ddb-8244a6cd9bb0 admin admin] PATH_INFO: `/v3/users/a70d97bfb1a7429db92baaa03b093d17` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:30.889369 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04369bee-257d-4cf3-9ddb-8244a6cd9bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a70d97bfb1a7429db92baaa03b093d17)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:30.893914 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04369bee-257d-4cf3-9ddb-8244a6cd9bb0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:30.896034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-aba88e4a-a3d1-4cbb-8a94-8a5b6da8a736 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97049bbcd1484caf921ad98c8a099059'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:30.910367 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1168/2351] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:30 2022] DELETE /identity/v3/users/97049bbcd1484caf921ad98c8a099059 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:31.009195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-04369bee-257d-4cf3-9ddb-8244a6cd9bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a70d97bfb1a7429db92baaa03b093d17'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:31.010500 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-04369bee-257d-4cf3-9ddb-8244a6cd9bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a70d97bfb1a7429db92baaa03b093d17'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:31.011532 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-04369bee-257d-4cf3-9ddb-8244a6cd9bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a70d97bfb1a7429db92baaa03b093d17'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:31.023165 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-04369bee-257d-4cf3-9ddb-8244a6cd9bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a70d97bfb1a7429db92baaa03b093d17'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:31.049645 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-04369bee-257d-4cf3-9ddb-8244a6cd9bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a70d97bfb1a7429db92baaa03b093d17'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:31.096876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1184/2352] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:30 2022] DELETE /identity/v3/users/a70d97bfb1a7429db92baaa03b093d17 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:31.101978 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574bbcc-1897-4a1c-8191-c0dd771ddddd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:31.102147 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574bbcc-1897-4a1c-8191-c0dd771ddddd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:31.102438 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574bbcc-1897-4a1c-8191-c0dd771ddddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:31.153756 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8574bbcc-1897-4a1c-8191-c0dd771ddddd None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:31.154991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8574bbcc-1897-4a1c-8191-c0dd771ddddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:31.222666 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04369bee-257d-4cf3-9ddb-8244a6cd9bb0 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:31.226647 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-04369bee-257d-4cf3-9ddb-8244a6cd9bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:31.373364 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1169/2353] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:31.409285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574bbcc-1897-4a1c-8191-c0dd771ddddd None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:31.411366 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8574bbcc-1897-4a1c-8191-c0dd771ddddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:31.418369 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04369bee-257d-4cf3-9ddb-8244a6cd9bb0 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:31.429661 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bce2f-637e-41e8-8f8b-a0f9c1414b91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:31.434945 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bce2f-637e-41e8-8f8b-a0f9c1414b91 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:31.435620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bce2f-637e-41e8-8f8b-a0f9c1414b91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:31.436121 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bce2f-637e-41e8-8f8b-a0f9c1414b91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:31.443716 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1d7bce2f-637e-41e8-8f8b-a0f9c1414b91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:31.548520 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574bbcc-1897-4a1c-8191-c0dd771ddddd None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:31.554200 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e483e-1f06-472f-9c5e-f9f51c3630ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:31.555008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e483e-1f06-472f-9c5e-f9f51c3630ea service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:31.555389 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e483e-1f06-472f-9c5e-f9f51c3630ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:31.555794 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e483e-1f06-472f-9c5e-f9f51c3630ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:31.570815 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e483e-1f06-472f-9c5e-f9f51c3630ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:31.572684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e483e-1f06-472f-9c5e-f9f51c3630ea service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:31.583853 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7bce2f-637e-41e8-8f8b-a0f9c1414b91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:31.586060 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7bce2f-637e-41e8-8f8b-a0f9c1414b91 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:31.590758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1170/2354] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:07:31.605973 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1185/2355] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:31.885810 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e483e-1f06-472f-9c5e-f9f51c3630ea service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:31.887896 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-973e483e-1f06-472f-9c5e-f9f51c3630ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:31.906188 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e483e-1f06-472f-9c5e-f9f51c3630ea service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:31.914052 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:31.915185 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:31.915525 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:31.915906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7 admin admin] PATH_INFO: `/v3/projects/9290345adf464329be6783c94197ee4f` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:31.917544 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9290345adf464329be6783c94197ee4f)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:31.919895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:31.993844 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9290345adf464329be6783c94197ee4f', 'request_id': 'req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:32.006639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9290345adf464329be6783c94197ee4f', 'request_id': 'req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:32.016639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9290345adf464329be6783c94197ee4f', 'request_id': 'req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:32.034989 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7 admin admin] The token cache is being invalidate because project 9290345adf464329be6783c94197ee4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:32.036198 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:32.037470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:32.045798 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bce2f-637e-41e8-8f8b-a0f9c1414b91 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:32.047256 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1171/2356] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:31 2022] DELETE /identity/v3/projects/9290345adf464329be6783c94197ee4f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:32.067371 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bce2f-637e-41e8-8f8b-a0f9c1414b91 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:32.194750 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbe573-c128-494c-b70b-cadc952d7ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:32.196411 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbe573-c128-494c-b70b-cadc952d7ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:32.197097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbe573-c128-494c-b70b-cadc952d7ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:32.198985 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbe573-c128-494c-b70b-cadc952d7ac0 admin admin] PATH_INFO: `/v3/users/d1d66e05771440f7b758e1014b593874` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:32.200743 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbe573-c128-494c-b70b-cadc952d7ac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d66e05771440f7b758e1014b593874)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:32.205778 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbe573-c128-494c-b70b-cadc952d7ac0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:32.291811 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-efdbe573-c128-494c-b70b-cadc952d7ac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d66e05771440f7b758e1014b593874'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:32.292611 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-efdbe573-c128-494c-b70b-cadc952d7ac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d66e05771440f7b758e1014b593874'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:32.293302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-efdbe573-c128-494c-b70b-cadc952d7ac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d66e05771440f7b758e1014b593874'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:32.304999 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-efdbe573-c128-494c-b70b-cadc952d7ac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d66e05771440f7b758e1014b593874'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:32.330249 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-efdbe573-c128-494c-b70b-cadc952d7ac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d66e05771440f7b758e1014b593874'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:32.350720 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1186/2357] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:32 2022] DELETE /identity/v3/users/d1d66e05771440f7b758e1014b593874 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:32.448823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:32.450904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:32.475686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8bb5d-58dd-4767-9da8-803abde6bbd7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:32.585267 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2e348-a53c-416f-abce-c56fbf55e40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:32.586225 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2e348-a53c-416f-abce-c56fbf55e40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:32.586506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2e348-a53c-416f-abce-c56fbf55e40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:32.588058 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2e348-a53c-416f-abce-c56fbf55e40a admin admin] PATH_INFO: `/v3/projects/dcb4b76068524e6e98b7a9873dee6838` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:32.591384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2e348-a53c-416f-abce-c56fbf55e40a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb4b76068524e6e98b7a9873dee6838)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:32.593970 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2e348-a53c-416f-abce-c56fbf55e40a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:32.697068 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-70e2e348-a53c-416f-abce-c56fbf55e40a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb4b76068524e6e98b7a9873dee6838', 'request_id': 'req-70e2e348-a53c-416f-abce-c56fbf55e40a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:32.713153 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-70e2e348-a53c-416f-abce-c56fbf55e40a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb4b76068524e6e98b7a9873dee6838', 'request_id': 'req-70e2e348-a53c-416f-abce-c56fbf55e40a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:32.726563 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-70e2e348-a53c-416f-abce-c56fbf55e40a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb4b76068524e6e98b7a9873dee6838', 'request_id': 'req-70e2e348-a53c-416f-abce-c56fbf55e40a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:32.773657 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-70e2e348-a53c-416f-abce-c56fbf55e40a admin admin] The token cache is being invalidate because project dcb4b76068524e6e98b7a9873dee6838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:32.773657 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-70e2e348-a53c-416f-abce-c56fbf55e40a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:32.776930 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-70e2e348-a53c-416f-abce-c56fbf55e40a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:32.778129 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1172/2358] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:32 2022] DELETE /identity/v3/projects/dcb4b76068524e6e98b7a9873dee6838 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:32.783800 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5e553-9f46-4cbc-8757-078ee9349454 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:32.784617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5e553-9f46-4cbc-8757-078ee9349454 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:32.786030 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5e553-9f46-4cbc-8757-078ee9349454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:32.814347 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-69c5e553-9f46-4cbc-8757-078ee9349454 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:32.815595 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-69c5e553-9f46-4cbc-8757-078ee9349454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:32.899156 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1187/2359] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:32.907136 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e3fe3-a3bd-47b2-a2f7-4d47e1b0424a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:32.907633 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e3fe3-a3bd-47b2-a2f7-4d47e1b0424a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:32.907735 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e3fe3-a3bd-47b2-a2f7-4d47e1b0424a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:32.941004 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a08e3fe3-a3bd-47b2-a2f7-4d47e1b0424a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:32.942097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a08e3fe3-a3bd-47b2-a2f7-4d47e1b0424a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:32.952909 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1173/2360] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:32.955085 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5e553-9f46-4cbc-8757-078ee9349454 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:32.973911 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5e553-9f46-4cbc-8757-078ee9349454 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:32.985885 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87324b-57ed-49ef-ad55-27188b1bf8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:32.987186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87324b-57ed-49ef-ad55-27188b1bf8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:32.987475 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87324b-57ed-49ef-ad55-27188b1bf8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:32.987755 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87324b-57ed-49ef-ad55-27188b1bf8d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:32.993019 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87324b-57ed-49ef-ad55-27188b1bf8d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:07:32.993019 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87324b-57ed-49ef-ad55-27188b1bf8d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:32.993019 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f87324b-57ed-49ef-ad55-27188b1bf8d1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:33.023182 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1188/2361] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:07:33.027699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e3fe3-a3bd-47b2-a2f7-4d47e1b0424a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:33.043764 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e3fe3-a3bd-47b2-a2f7-4d47e1b0424a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:33.049524 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b2416-3258-4f6b-9e2d-84a6ba45a47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:33.050442 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b2416-3258-4f6b-9e2d-84a6ba45a47e admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:33.051239 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b2416-3258-4f6b-9e2d-84a6ba45a47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:33.051812 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b2416-3258-4f6b-9e2d-84a6ba45a47e admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:33.052885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b2416-3258-4f6b-9e2d-84a6ba45a47e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:33.055676 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b2416-3258-4f6b-9e2d-84a6ba45a47e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:33.080218 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87324b-57ed-49ef-ad55-27188b1bf8d1 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:33.083637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8f87324b-57ed-49ef-ad55-27188b1bf8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:33.114091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87324b-57ed-49ef-ad55-27188b1bf8d1 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:33.132985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1174/2362] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:33 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:33.134169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf830b-c2e2-4825-8322-d34eaeee8e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:33.138608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf830b-c2e2-4825-8322-d34eaeee8e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:33.139824 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b2416-3258-4f6b-9e2d-84a6ba45a47e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:33.142451 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf830b-c2e2-4825-8322-d34eaeee8e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:33.143649 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf830b-c2e2-4825-8322-d34eaeee8e39 admin admin] PATH_INFO: `/v3/projects/36a657d26e904eda8c2ca25a15318510` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:33.149215 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf830b-c2e2-4825-8322-d34eaeee8e39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a657d26e904eda8c2ca25a15318510)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:33.154392 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf830b-c2e2-4825-8322-d34eaeee8e39 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:33.299491 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b2416-3258-4f6b-9e2d-84a6ba45a47e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:33.339697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-16bf830b-c2e2-4825-8322-d34eaeee8e39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a657d26e904eda8c2ca25a15318510', 'request_id': 'req-16bf830b-c2e2-4825-8322-d34eaeee8e39'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:33.351657 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-16bf830b-c2e2-4825-8322-d34eaeee8e39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a657d26e904eda8c2ca25a15318510', 'request_id': 'req-16bf830b-c2e2-4825-8322-d34eaeee8e39'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:33.393388 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-16bf830b-c2e2-4825-8322-d34eaeee8e39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a657d26e904eda8c2ca25a15318510', 'request_id': 'req-16bf830b-c2e2-4825-8322-d34eaeee8e39'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:33.433683 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-16bf830b-c2e2-4825-8322-d34eaeee8e39 admin admin] The token cache is being invalidate because project 36a657d26e904eda8c2ca25a15318510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:33.434066 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-16bf830b-c2e2-4825-8322-d34eaeee8e39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:33.438071 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-16bf830b-c2e2-4825-8322-d34eaeee8e39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:33.443431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1189/2363] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:33 2022] DELETE /identity/v3/projects/36a657d26e904eda8c2ca25a15318510 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:07:33.448351 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e3d54-47e5-4b0e-b380-8a46a32c55f8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:33.448646 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e3d54-47e5-4b0e-b380-8a46a32c55f8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:33.448952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e3d54-47e5-4b0e-b380-8a46a32c55f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:33.456582 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e825f1-372b-4834-80dc-6c633c3097a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:33.458349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e825f1-372b-4834-80dc-6c633c3097a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:33.458848 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e825f1-372b-4834-80dc-6c633c3097a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:33.459388 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e825f1-372b-4834-80dc-6c633c3097a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:33.460393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e825f1-372b-4834-80dc-6c633c3097a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:33.463044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e825f1-372b-4834-80dc-6c633c3097a6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:33.487769 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ea3e3d54-47e5-4b0e-b380-8a46a32c55f8 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:33.489207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ea3e3d54-47e5-4b0e-b380-8a46a32c55f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:33.509012 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1190/2364] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:07:33.516709 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e761b-4817-47aa-a22d-ad57be69c8ee None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:33.517019 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e761b-4817-47aa-a22d-ad57be69c8ee None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:33.517309 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e761b-4817-47aa-a22d-ad57be69c8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:33.533356 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1175/2365] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:33 2022] POST /identity/v3/users => generated 286 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:33.538262 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e825f1-372b-4834-80dc-6c633c3097a6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:33.544489 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-73e825f1-372b-4834-80dc-6c633c3097a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:33.576694 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d80e761b-4817-47aa-a22d-ad57be69c8ee None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:33.577805 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d80e761b-4817-47aa-a22d-ad57be69c8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:33.585030 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e825f1-372b-4834-80dc-6c633c3097a6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:33.593630 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96752fe6-67fa-452c-9489-45b7feaf617f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:33.594334 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96752fe6-67fa-452c-9489-45b7feaf617f admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:33.594619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96752fe6-67fa-452c-9489-45b7feaf617f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:33.594900 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96752fe6-67fa-452c-9489-45b7feaf617f admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:33.595763 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96752fe6-67fa-452c-9489-45b7feaf617f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:33.597500 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96752fe6-67fa-452c-9489-45b7feaf617f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:33.597627 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1191/2366] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:07:33.602002 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e761b-4817-47aa-a22d-ad57be69c8ee None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:33.619717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1176/2367] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:33.620944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96752fe6-67fa-452c-9489-45b7feaf617f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:33.624970 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e761b-4817-47aa-a22d-ad57be69c8ee None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:33.636964 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96752fe6-67fa-452c-9489-45b7feaf617f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:33.638208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff832c-e591-4df2-aa12-b7d061e53053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:33.639048 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff832c-e591-4df2-aa12-b7d061e53053 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:33.639400 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff832c-e591-4df2-aa12-b7d061e53053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:33.640241 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff832c-e591-4df2-aa12-b7d061e53053 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:33.641940 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff832c-e591-4df2-aa12-b7d061e53053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:07:33.641940 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff832c-e591-4df2-aa12-b7d061e53053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:33.642435 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf8a8d-8100-4af4-93af-d5950df95835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:33.643445 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf8a8d-8100-4af4-93af-d5950df95835 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:33.643566 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff832c-e591-4df2-aa12-b7d061e53053 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:33.643805 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf8a8d-8100-4af4-93af-d5950df95835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:33.644161 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf8a8d-8100-4af4-93af-d5950df95835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:33.645210 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf8a8d-8100-4af4-93af-d5950df95835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:33.647207 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf8a8d-8100-4af4-93af-d5950df95835 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:33.666114 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1177/2368] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:33.670518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf8a8d-8100-4af4-93af-d5950df95835 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:33.673319 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1192/2369] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 05:07:33.680929 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff832c-e591-4df2-aa12-b7d061e53053 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:33.689081 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf8a8d-8100-4af4-93af-d5950df95835 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:33.698812 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbb3d5-3684-42b3-aec7-06ce06c1093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:33.700242 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbb3d5-3684-42b3-aec7-06ce06c1093b admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:33.700531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbb3d5-3684-42b3-aec7-06ce06c1093b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:33.700883 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbb3d5-3684-42b3-aec7-06ce06c1093b admin admin] PATH_INFO: `/v3/projects/89ea28915f6a4a6ba8ed6b4fda932212/users/2157c03cac6840f59445dc43877c4b62/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:33.708337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff832c-e591-4df2-aa12-b7d061e53053 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:33.720984 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec9b7b-e79d-4228-8a3b-f43e11637c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:33.722190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec9b7b-e79d-4228-8a3b-f43e11637c32 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:33.722475 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec9b7b-e79d-4228-8a3b-f43e11637c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:33.722781 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec9b7b-e79d-4228-8a3b-f43e11637c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:33.722949 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbb3d5-3684-42b3-aec7-06ce06c1093b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ea28915f6a4a6ba8ed6b4fda932212, user_id=2157c03cac6840f59445dc43877c4b62, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:33.723897 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec9b7b-e79d-4228-8a3b-f43e11637c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:33.727304 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbb3d5-3684-42b3-aec7-06ce06c1093b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:33.731141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec9b7b-e79d-4228-8a3b-f43e11637c32 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:33.750374 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1178/2370] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:33 2022] PUT /identity/v3/projects/89ea28915f6a4a6ba8ed6b4fda932212/users/2157c03cac6840f59445dc43877c4b62/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:33.762980 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbffd44-3bc6-4b26-b65a-23f79fbded65 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:33.763596 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbffd44-3bc6-4b26-b65a-23f79fbded65 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:33.764069 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbffd44-3bc6-4b26-b65a-23f79fbded65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:33.801078 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1193/2371] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:33 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:33.805158 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec9b7b-e79d-4228-8a3b-f43e11637c32 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:33.811515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4fbffd44-3bc6-4b26-b65a-23f79fbded65 None None] MFA Rules not processed for user `2157c03cac6840f59445dc43877c4b62`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:33.813086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4fbffd44-3bc6-4b26-b65a-23f79fbded65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:33.912881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec9b7b-e79d-4228-8a3b-f43e11637c32 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:33.918938 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c94d43-9602-476f-8042-17aac4af33aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:33.919721 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c94d43-9602-476f-8042-17aac4af33aa admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:33.920129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c94d43-9602-476f-8042-17aac4af33aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:33.920483 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c94d43-9602-476f-8042-17aac4af33aa admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:33.921301 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c94d43-9602-476f-8042-17aac4af33aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:33.927325 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c94d43-9602-476f-8042-17aac4af33aa admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:33.930764 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1179/2372] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:07:33.947652 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbffd44-3bc6-4b26-b65a-23f79fbded65 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:33.949775 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4fbffd44-3bc6-4b26-b65a-23f79fbded65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:33.961572 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1194/2373] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:33 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:07:33.962960 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c94d43-9602-476f-8042-17aac4af33aa admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:33.975600 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c94d43-9602-476f-8042-17aac4af33aa admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:33.980879 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b5210-d753-4bc1-bee9-58630900ac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:33.981827 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b5210-d753-4bc1-bee9-58630900ac82 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:33.982207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b5210-d753-4bc1-bee9-58630900ac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:33.982821 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b5210-d753-4bc1-bee9-58630900ac82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:33.983344 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b5210-d753-4bc1-bee9-58630900ac82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:33.985800 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b5210-d753-4bc1-bee9-58630900ac82 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:34.006398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1195/2374] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:07:34.007483 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b5210-d753-4bc1-bee9-58630900ac82 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:34.019608 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b5210-d753-4bc1-bee9-58630900ac82 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:34.024281 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbffd44-3bc6-4b26-b65a-23f79fbded65 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:34.027736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be99948-c104-467a-9308-cdbbcec368d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:34.028415 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be99948-c104-467a-9308-cdbbcec368d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:34.028774 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be99948-c104-467a-9308-cdbbcec368d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:34.029096 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be99948-c104-467a-9308-cdbbcec368d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:34.029615 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01d6fc-1a2a-422a-a786-037d3a837e29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:34.030500 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01d6fc-1a2a-422a-a786-037d3a837e29 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:34.030500 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01d6fc-1a2a-422a-a786-037d3a837e29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:34.030796 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01d6fc-1a2a-422a-a786-037d3a837e29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:34.031394 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be99948-c104-467a-9308-cdbbcec368d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:34.033141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be99948-c104-467a-9308-cdbbcec368d5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:34.042698 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01d6fc-1a2a-422a-a786-037d3a837e29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:34.045137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01d6fc-1a2a-422a-a786-037d3a837e29 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:34.052422 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1196/2375] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:34.053937 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be99948-c104-467a-9308-cdbbcec368d5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:34.060977 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1180/2376] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:07:34.079836 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be99948-c104-467a-9308-cdbbcec368d5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:34.092648 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca3ab4-1b45-4423-bc1e-51fac692f182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:34.093583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca3ab4-1b45-4423-bc1e-51fac692f182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:34.093873 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca3ab4-1b45-4423-bc1e-51fac692f182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:34.094151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca3ab4-1b45-4423-bc1e-51fac692f182 admin admin] PATH_INFO: `/v3/projects/26ce15b3149546f489d15ae2fef48f6a/users/22ae50841ebe4758bae584ddd4dcf33f/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:34.131187 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca3ab4-1b45-4423-bc1e-51fac692f182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ce15b3149546f489d15ae2fef48f6a, user_id=22ae50841ebe4758bae584ddd4dcf33f, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:34.136370 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca3ab4-1b45-4423-bc1e-51fac692f182 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:34.162398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1197/2377] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:34 2022] PUT /identity/v3/projects/26ce15b3149546f489d15ae2fef48f6a/users/22ae50841ebe4758bae584ddd4dcf33f/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:34.172148 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a871c12-6693-4fe4-8652-87fd362aa3ed None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:34.172438 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a871c12-6693-4fe4-8652-87fd362aa3ed None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:34.172717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a871c12-6693-4fe4-8652-87fd362aa3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:34.203468 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4a871c12-6693-4fe4-8652-87fd362aa3ed None None] MFA Rules not processed for user `22ae50841ebe4758bae584ddd4dcf33f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:34.206067 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4a871c12-6693-4fe4-8652-87fd362aa3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:34.304758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1181/2378] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:34.382406 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca3ab4-1b45-4423-bc1e-51fac692f182 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:34.761938 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca3ab4-1b45-4423-bc1e-51fac692f182 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:34.765973 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef7b76-f24e-4c1d-8fc9-71abb16b3663 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:34.766914 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef7b76-f24e-4c1d-8fc9-71abb16b3663 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:34.767299 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef7b76-f24e-4c1d-8fc9-71abb16b3663 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:34.767674 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef7b76-f24e-4c1d-8fc9-71abb16b3663 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:34.778675 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef7b76-f24e-4c1d-8fc9-71abb16b3663 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:34.780282 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef7b76-f24e-4c1d-8fc9-71abb16b3663 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:34.793820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1198/2379] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:34.915368 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b5aab-209e-45f9-badc-d61c14f59ea8 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:34.915659 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b5aab-209e-45f9-badc-d61c14f59ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:34.915941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b5aab-209e-45f9-badc-d61c14f59ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:34.947020 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5b6b5aab-209e-45f9-badc-d61c14f59ea8 None None] MFA Rules not processed for user `e5cb068154f04e93b2a301d46164d001`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:34.948241 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5b6b5aab-209e-45f9-badc-d61c14f59ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:35.022878 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1182/2380] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:35.037423 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef7b76-f24e-4c1d-8fc9-71abb16b3663 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:35.038932 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0eef7b76-f24e-4c1d-8fc9-71abb16b3663 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:35.125607 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef7b76-f24e-4c1d-8fc9-71abb16b3663 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:35.133510 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850edf14-ba6a-430b-8d33-058393520bef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:35.134519 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850edf14-ba6a-430b-8d33-058393520bef service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:35.134891 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850edf14-ba6a-430b-8d33-058393520bef service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:35.135066 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850edf14-ba6a-430b-8d33-058393520bef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:35.149403 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850edf14-ba6a-430b-8d33-058393520bef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:35.152500 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850edf14-ba6a-430b-8d33-058393520bef service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:35.173048 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1199/2381] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:36.564263 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3e00f-66c8-4149-a3bd-5fc39c1069ff None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:36.564762 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3e00f-66c8-4149-a3bd-5fc39c1069ff None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:36.565003 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3e00f-66c8-4149-a3bd-5fc39c1069ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:36.584150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b0b3e00f-66c8-4149-a3bd-5fc39c1069ff None None] MFA Rules not processed for user `e5cb068154f04e93b2a301d46164d001`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:36.585408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b0b3e00f-66c8-4149-a3bd-5fc39c1069ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:36.592383 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1183/2382] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:37.728984 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b001b-1b86-45d1-894a-f3fc80d630e2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:37.729465 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b001b-1b86-45d1-894a-f3fc80d630e2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:37.729589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b001b-1b86-45d1-894a-f3fc80d630e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:37.762429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c89b001b-1b86-45d1-894a-f3fc80d630e2 None None] MFA Rules not processed for user `2157c03cac6840f59445dc43877c4b62`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:37.763438 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c89b001b-1b86-45d1-894a-f3fc80d630e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:37.858419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1200/2383] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:38.651166 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3e00f-66c8-4149-a3bd-5fc39c1069ff None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:38.736472 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3e00f-66c8-4149-a3bd-5fc39c1069ff None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:38.750107 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0eed2-bb39-47a2-94dc-a38fc41cbc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:38.751695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0eed2-bb39-47a2-94dc-a38fc41cbc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:38.752201 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0eed2-bb39-47a2-94dc-a38fc41cbc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:38.752505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0eed2-bb39-47a2-94dc-a38fc41cbc01 admin admin] PATH_INFO: `/v3/users/22ae50841ebe4758bae584ddd4dcf33f` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:38.754763 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0eed2-bb39-47a2-94dc-a38fc41cbc01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22ae50841ebe4758bae584ddd4dcf33f)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:38.758710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0eed2-bb39-47a2-94dc-a38fc41cbc01 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:38.842788 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d4c0eed2-bb39-47a2-94dc-a38fc41cbc01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22ae50841ebe4758bae584ddd4dcf33f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:38.843482 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d4c0eed2-bb39-47a2-94dc-a38fc41cbc01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22ae50841ebe4758bae584ddd4dcf33f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:38.844147 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d4c0eed2-bb39-47a2-94dc-a38fc41cbc01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22ae50841ebe4758bae584ddd4dcf33f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:38.859800 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d4c0eed2-bb39-47a2-94dc-a38fc41cbc01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22ae50841ebe4758bae584ddd4dcf33f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:38.894268 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d4c0eed2-bb39-47a2-94dc-a38fc41cbc01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22ae50841ebe4758bae584ddd4dcf33f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:38.925383 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1184/2384] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:38 2022] DELETE /identity/v3/users/22ae50841ebe4758bae584ddd4dcf33f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:38.930662 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a1f35-7dd4-4dda-aaac-8eaa6504ff27 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:38.931308 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a1f35-7dd4-4dda-aaac-8eaa6504ff27 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:38.931308 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a1f35-7dd4-4dda-aaac-8eaa6504ff27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:38.996749 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-068a1f35-7dd4-4dda-aaac-8eaa6504ff27 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:39.002864 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-068a1f35-7dd4-4dda-aaac-8eaa6504ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:39.109708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1201/2385] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:39.120665 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0eed2-bb39-47a2-94dc-a38fc41cbc01 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:39.122247 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d4c0eed2-bb39-47a2-94dc-a38fc41cbc01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:39.199376 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0eed2-bb39-47a2-94dc-a38fc41cbc01 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:39.204551 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8e445-54b0-41de-b3e7-729c045d49bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:39.205187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8e445-54b0-41de-b3e7-729c045d49bf service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:39.205384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8e445-54b0-41de-b3e7-729c045d49bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:39.205679 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8e445-54b0-41de-b3e7-729c045d49bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:39.218283 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8e445-54b0-41de-b3e7-729c045d49bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:39.219799 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8e445-54b0-41de-b3e7-729c045d49bf service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:39.231670 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1185/2386] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:07:39.724149 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a1f35-7dd4-4dda-aaac-8eaa6504ff27 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:39.726624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-068a1f35-7dd4-4dda-aaac-8eaa6504ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:39.747251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a1f35-7dd4-4dda-aaac-8eaa6504ff27 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:39.752330 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8e445-54b0-41de-b3e7-729c045d49bf service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:39.756017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-31d8e445-54b0-41de-b3e7-729c045d49bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:39.770320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab2c3a-3905-408c-9f2b-1d1b5281d788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:39.771381 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab2c3a-3905-408c-9f2b-1d1b5281d788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:39.772936 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab2c3a-3905-408c-9f2b-1d1b5281d788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:39.773443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab2c3a-3905-408c-9f2b-1d1b5281d788 admin admin] PATH_INFO: `/v3/projects/26ce15b3149546f489d15ae2fef48f6a` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:39.776572 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab2c3a-3905-408c-9f2b-1d1b5281d788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ce15b3149546f489d15ae2fef48f6a)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:39.781195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab2c3a-3905-408c-9f2b-1d1b5281d788 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:39.788385 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8e445-54b0-41de-b3e7-729c045d49bf service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:39.816234 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd63139-0003-46cc-b59d-f6d41d45d315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:39.817549 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd63139-0003-46cc-b59d-f6d41d45d315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:39.818807 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd63139-0003-46cc-b59d-f6d41d45d315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:39.819089 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd63139-0003-46cc-b59d-f6d41d45d315 admin admin] PATH_INFO: `/v3/users/743884bf3ffa4e00b87c5169747eea77` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:39.822599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd63139-0003-46cc-b59d-f6d41d45d315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=743884bf3ffa4e00b87c5169747eea77)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:39.829964 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd63139-0003-46cc-b59d-f6d41d45d315 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:39.880665 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-38ab2c3a-3905-408c-9f2b-1d1b5281d788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ce15b3149546f489d15ae2fef48f6a', 'request_id': 'req-38ab2c3a-3905-408c-9f2b-1d1b5281d788'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:39.891681 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-38ab2c3a-3905-408c-9f2b-1d1b5281d788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ce15b3149546f489d15ae2fef48f6a', 'request_id': 'req-38ab2c3a-3905-408c-9f2b-1d1b5281d788'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:39.917666 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-38ab2c3a-3905-408c-9f2b-1d1b5281d788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ce15b3149546f489d15ae2fef48f6a', 'request_id': 'req-38ab2c3a-3905-408c-9f2b-1d1b5281d788'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:39.943561 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-38ab2c3a-3905-408c-9f2b-1d1b5281d788 admin admin] The token cache is being invalidate because project 26ce15b3149546f489d15ae2fef48f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:39.944054 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-38ab2c3a-3905-408c-9f2b-1d1b5281d788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:39.944401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-38ab2c3a-3905-408c-9f2b-1d1b5281d788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:39.946507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1202/2387] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:39 2022] DELETE /identity/v3/projects/26ce15b3149546f489d15ae2fef48f6a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:39.952326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa76d8-ae9e-45f8-9b60-fa05cc80eda9 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:39.959337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa76d8-ae9e-45f8-9b60-fa05cc80eda9 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:39.960945 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa76d8-ae9e-45f8-9b60-fa05cc80eda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:39.962042 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0bd63139-0003-46cc-b59d-f6d41d45d315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '743884bf3ffa4e00b87c5169747eea77'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:39.962951 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0bd63139-0003-46cc-b59d-f6d41d45d315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '743884bf3ffa4e00b87c5169747eea77'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:39.963790 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0bd63139-0003-46cc-b59d-f6d41d45d315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '743884bf3ffa4e00b87c5169747eea77'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:39.986658 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0bd63139-0003-46cc-b59d-f6d41d45d315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '743884bf3ffa4e00b87c5169747eea77'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:40.002528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3afa76d8-ae9e-45f8-9b60-fa05cc80eda9 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:40.003807 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3afa76d8-ae9e-45f8-9b60-fa05cc80eda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:40.009481 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0bd63139-0003-46cc-b59d-f6d41d45d315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '743884bf3ffa4e00b87c5169747eea77'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:40.028989 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1186/2388] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:39 2022] DELETE /identity/v3/users/743884bf3ffa4e00b87c5169747eea77 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:40.032259 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628f281-ba57-4bd2-8040-ad0935b72bc5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:40.033141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628f281-ba57-4bd2-8040-ad0935b72bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:40.033401 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628f281-ba57-4bd2-8040-ad0935b72bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:40.059613 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7628f281-ba57-4bd2-8040-ad0935b72bc5 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:40.061253 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7628f281-ba57-4bd2-8040-ad0935b72bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:40.109441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1203/2389] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:40.112717 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9f7ac-6dda-478f-90f4-da6d15dcd792 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:40.114733 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9f7ac-6dda-478f-90f4-da6d15dcd792 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:40.115137 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9f7ac-6dda-478f-90f4-da6d15dcd792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:40.140959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8fb9f7ac-6dda-478f-90f4-da6d15dcd792 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:40.142215 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8fb9f7ac-6dda-478f-90f4-da6d15dcd792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:40.165161 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1187/2390] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:40.185098 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628f281-ba57-4bd2-8040-ad0935b72bc5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:40.192931 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7628f281-ba57-4bd2-8040-ad0935b72bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:40.227228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1204/2391] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:40.231169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9f7ac-6dda-478f-90f4-da6d15dcd792 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:40.241948 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9f7ac-6dda-478f-90f4-da6d15dcd792 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:40.247336 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8b7ee-fe83-4efb-b35f-b84ab60be295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:40.248212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8b7ee-fe83-4efb-b35f-b84ab60be295 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:40.248703 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8b7ee-fe83-4efb-b35f-b84ab60be295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:40.249083 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8b7ee-fe83-4efb-b35f-b84ab60be295 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:40.249876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8b7ee-fe83-4efb-b35f-b84ab60be295 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:07:40.250257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8b7ee-fe83-4efb-b35f-b84ab60be295 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:40.251952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8b7ee-fe83-4efb-b35f-b84ab60be295 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:40.265417 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1205/2392] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 05:07:40.270984 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8b7ee-fe83-4efb-b35f-b84ab60be295 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:40.284125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8b7ee-fe83-4efb-b35f-b84ab60be295 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:40.287936 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628f281-ba57-4bd2-8040-ad0935b72bc5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:40.291800 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7687d-2012-4dc1-ab9a-9b8c23bcaba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:40.292241 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074991d-f2a7-4a98-8d42-9cfe872d79f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:40.292484 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7687d-2012-4dc1-ab9a-9b8c23bcaba5 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:40.293399 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7687d-2012-4dc1-ab9a-9b8c23bcaba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:40.293399 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7687d-2012-4dc1-ab9a-9b8c23bcaba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:40.297533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074991d-f2a7-4a98-8d42-9cfe872d79f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:40.298005 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074991d-f2a7-4a98-8d42-9cfe872d79f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:40.299070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074991d-f2a7-4a98-8d42-9cfe872d79f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:40.306173 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7687d-2012-4dc1-ab9a-9b8c23bcaba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:40.307935 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7687d-2012-4dc1-ab9a-9b8c23bcaba5 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:40.313746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074991d-f2a7-4a98-8d42-9cfe872d79f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:40.319161 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074991d-f2a7-4a98-8d42-9cfe872d79f6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:40.322282 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1188/2393] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:40.358205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1206/2394] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:40 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:40.372446 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7687d-2012-4dc1-ab9a-9b8c23bcaba5 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:40.396169 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7687d-2012-4dc1-ab9a-9b8c23bcaba5 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:40.485596 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415a261-f3f7-43d7-9533-065d45199c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:40.486289 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415a261-f3f7-43d7-9533-065d45199c6d admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:40.486566 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415a261-f3f7-43d7-9533-065d45199c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:40.487009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415a261-f3f7-43d7-9533-065d45199c6d admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:40.488003 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415a261-f3f7-43d7-9533-065d45199c6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:40.492613 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415a261-f3f7-43d7-9533-065d45199c6d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:40.516551 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1189/2395] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:40 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:40.520872 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074991d-f2a7-4a98-8d42-9cfe872d79f6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:40.531468 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074991d-f2a7-4a98-8d42-9cfe872d79f6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:40.538476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd59fa8-2417-4dd3-a723-4ef87a742683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:40.539590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd59fa8-2417-4dd3-a723-4ef87a742683 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:40.540070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd59fa8-2417-4dd3-a723-4ef87a742683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:40.540627 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd59fa8-2417-4dd3-a723-4ef87a742683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:40.541529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd59fa8-2417-4dd3-a723-4ef87a742683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:40.548331 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd59fa8-2417-4dd3-a723-4ef87a742683 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:40.568151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1207/2396] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:40.572940 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415a261-f3f7-43d7-9533-065d45199c6d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:40.584853 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415a261-f3f7-43d7-9533-065d45199c6d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:40.594491 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142a063-43f5-4894-b905-329f12e0963b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:40.595521 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142a063-43f5-4894-b905-329f12e0963b admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:40.596015 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142a063-43f5-4894-b905-329f12e0963b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:40.596508 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142a063-43f5-4894-b905-329f12e0963b admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:40.597726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142a063-43f5-4894-b905-329f12e0963b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:40.600252 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142a063-43f5-4894-b905-329f12e0963b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:40.621787 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd59fa8-2417-4dd3-a723-4ef87a742683 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:40.631155 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1190/2397] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:07:40.640440 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd59fa8-2417-4dd3-a723-4ef87a742683 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:40.649845 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca66146-1e71-45b7-85e7-cd12960dbb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:40.651160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca66146-1e71-45b7-85e7-cd12960dbb7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:40.651477 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca66146-1e71-45b7-85e7-cd12960dbb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:40.651918 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca66146-1e71-45b7-85e7-cd12960dbb7a admin admin] PATH_INFO: `/v3/projects/ab193c5d90314047a98f17a4eca607cd/users/ac5ed3a769a043469fedf176615be2d0/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:40.672169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca66146-1e71-45b7-85e7-cd12960dbb7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab193c5d90314047a98f17a4eca607cd, user_id=ac5ed3a769a043469fedf176615be2d0, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:40.674867 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca66146-1e71-45b7-85e7-cd12960dbb7a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:40.707777 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1208/2398] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:40 2022] PUT /identity/v3/projects/ab193c5d90314047a98f17a4eca607cd/users/ac5ed3a769a043469fedf176615be2d0/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:40.709755 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86b30f-0fe6-467e-8aea-19a733822cab None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:40.710055 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86b30f-0fe6-467e-8aea-19a733822cab None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:40.710919 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86b30f-0fe6-467e-8aea-19a733822cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:40.749505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8f86b30f-0fe6-467e-8aea-19a733822cab None None] MFA Rules not processed for user `ac5ed3a769a043469fedf176615be2d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:40.750768 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8f86b30f-0fe6-467e-8aea-19a733822cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:40.823322 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1191/2399] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:40.838759 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca66146-1e71-45b7-85e7-cd12960dbb7a admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:40.841237 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-bca66146-1e71-45b7-85e7-cd12960dbb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:40.922198 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca66146-1e71-45b7-85e7-cd12960dbb7a admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:40.928936 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c8352-1e81-49b7-b125-2470536f7452 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e04bf8c51c4d89bbb45e96223e7409', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:40.929582 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c8352-1e81-49b7-b125-2470536f7452 service glance] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:40.929869 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c8352-1e81-49b7-b125-2470536f7452 service glance] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:40.930147 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c8352-1e81-49b7-b125-2470536f7452 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:40.941000 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c8352-1e81-49b7-b125-2470536f7452 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:40.943556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c8352-1e81-49b7-b125-2470536f7452 service glance] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:40.959423 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1209/2400] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:07:41.051857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86b30f-0fe6-467e-8aea-19a733822cab None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:41.054036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8f86b30f-0fe6-467e-8aea-19a733822cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:41.219667 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86b30f-0fe6-467e-8aea-19a733822cab None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:41.230857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:41.233848 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:41.234452 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:41.234916 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a admin admin] PATH_INFO: `/v3/projects/6f9bc037cd2b4387be10eee570bf5248` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:41.236343 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f9bc037cd2b4387be10eee570bf5248)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:41.240268 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:41.363154 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f9bc037cd2b4387be10eee570bf5248', 'request_id': 'req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:41.399908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f9bc037cd2b4387be10eee570bf5248', 'request_id': 'req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:41.417069 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f9bc037cd2b4387be10eee570bf5248', 'request_id': 'req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:41.431964 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a admin admin] The token cache is being invalidate because project 6f9bc037cd2b4387be10eee570bf5248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:41.433931 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:41.434611 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:41.440274 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1192/2401] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:41 2022] DELETE /identity/v3/projects/6f9bc037cd2b4387be10eee570bf5248 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:41.441473 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c8352-1e81-49b7-b125-2470536f7452 service glance] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:41.465916 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c8352-1e81-49b7-b125-2470536f7452 service glance] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:41.578790 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e282e7-5f48-46e1-89f5-1b6fd44dcf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:41.579952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e282e7-5f48-46e1-89f5-1b6fd44dcf87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:41.580513 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e282e7-5f48-46e1-89f5-1b6fd44dcf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:41.581028 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e282e7-5f48-46e1-89f5-1b6fd44dcf87 admin admin] PATH_INFO: `/v3/users/9b418be587924bf697628888a252caba` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:41.582754 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e282e7-5f48-46e1-89f5-1b6fd44dcf87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b418be587924bf697628888a252caba)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:41.585213 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e282e7-5f48-46e1-89f5-1b6fd44dcf87 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:41.668634 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b2e282e7-5f48-46e1-89f5-1b6fd44dcf87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b418be587924bf697628888a252caba'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:41.669532 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b2e282e7-5f48-46e1-89f5-1b6fd44dcf87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b418be587924bf697628888a252caba'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:41.670366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b2e282e7-5f48-46e1-89f5-1b6fd44dcf87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b418be587924bf697628888a252caba'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:41.685404 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b2e282e7-5f48-46e1-89f5-1b6fd44dcf87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b418be587924bf697628888a252caba'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:41.707965 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-b2e282e7-5f48-46e1-89f5-1b6fd44dcf87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b418be587924bf697628888a252caba'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:41.732870 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1210/2402] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:41 2022] DELETE /identity/v3/users/9b418be587924bf697628888a252caba => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:42.555267 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:42.556896 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:42.608418 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831dcb0-f7b9-4c5e-ad39-e1b9034c821a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:42.731341 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00908f-4de4-48eb-9adf-869b22c47791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:42.732718 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00908f-4de4-48eb-9adf-869b22c47791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:42.733260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00908f-4de4-48eb-9adf-869b22c47791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:42.733515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00908f-4de4-48eb-9adf-869b22c47791 admin admin] PATH_INFO: `/v3/projects/f00f8bcdd82d4cd3a2e4ac9bd284f13d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:42.735212 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00908f-4de4-48eb-9adf-869b22c47791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f00f8bcdd82d4cd3a2e4ac9bd284f13d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:42.742371 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00908f-4de4-48eb-9adf-869b22c47791 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:42.843934 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7a00908f-4de4-48eb-9adf-869b22c47791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f00f8bcdd82d4cd3a2e4ac9bd284f13d', 'request_id': 'req-7a00908f-4de4-48eb-9adf-869b22c47791'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:42.874858 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7a00908f-4de4-48eb-9adf-869b22c47791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f00f8bcdd82d4cd3a2e4ac9bd284f13d', 'request_id': 'req-7a00908f-4de4-48eb-9adf-869b22c47791'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:42.884412 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7a00908f-4de4-48eb-9adf-869b22c47791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f00f8bcdd82d4cd3a2e4ac9bd284f13d', 'request_id': 'req-7a00908f-4de4-48eb-9adf-869b22c47791'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:42.897384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7a00908f-4de4-48eb-9adf-869b22c47791 admin admin] The token cache is being invalidate because project f00f8bcdd82d4cd3a2e4ac9bd284f13d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:42.897683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7a00908f-4de4-48eb-9adf-869b22c47791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:42.898347 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7a00908f-4de4-48eb-9adf-869b22c47791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:42.900236 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1193/2403] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:42 2022] DELETE /identity/v3/projects/f00f8bcdd82d4cd3a2e4ac9bd284f13d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:42.904435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e282e7-5f48-46e1-89f5-1b6fd44dcf87 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:42.906152 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b2e282e7-5f48-46e1-89f5-1b6fd44dcf87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:42.930467 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e282e7-5f48-46e1-89f5-1b6fd44dcf87 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:43.010881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a1fb8-322d-422a-9b45-a3ac7c9496a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:43.012168 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a1fb8-322d-422a-9b45-a3ac7c9496a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:43.012468 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a1fb8-322d-422a-9b45-a3ac7c9496a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:43.012732 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a1fb8-322d-422a-9b45-a3ac7c9496a2 admin admin] PATH_INFO: `/v3/users/fdb6de9e0ebe469d956b140660f3ae45` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:43.014102 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a1fb8-322d-422a-9b45-a3ac7c9496a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb6de9e0ebe469d956b140660f3ae45)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:43.016238 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a1fb8-322d-422a-9b45-a3ac7c9496a2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:43.106962 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0c3a1fb8-322d-422a-9b45-a3ac7c9496a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb6de9e0ebe469d956b140660f3ae45'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:43.107880 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0c3a1fb8-322d-422a-9b45-a3ac7c9496a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb6de9e0ebe469d956b140660f3ae45'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:43.108556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0c3a1fb8-322d-422a-9b45-a3ac7c9496a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb6de9e0ebe469d956b140660f3ae45'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:43.118163 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0c3a1fb8-322d-422a-9b45-a3ac7c9496a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb6de9e0ebe469d956b140660f3ae45'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:43.134152 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0c3a1fb8-322d-422a-9b45-a3ac7c9496a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb6de9e0ebe469d956b140660f3ae45'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:43.154159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1211/2404] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:07:42 2022] DELETE /identity/v3/users/fdb6de9e0ebe469d956b140660f3ae45 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:43.597448 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00908f-4de4-48eb-9adf-869b22c47791 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:43.599253 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7a00908f-4de4-48eb-9adf-869b22c47791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:43.613121 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00908f-4de4-48eb-9adf-869b22c47791 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:43.678814 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dea483-ff78-4d4f-b7f4-25854dbf8e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:43.679804 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dea483-ff78-4d4f-b7f4-25854dbf8e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:43.680044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dea483-ff78-4d4f-b7f4-25854dbf8e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:43.680326 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dea483-ff78-4d4f-b7f4-25854dbf8e19 admin admin] PATH_INFO: `/v3/projects/6bc361f62811445b98071f4e06ae2bb8` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:43.681702 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dea483-ff78-4d4f-b7f4-25854dbf8e19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc361f62811445b98071f4e06ae2bb8)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:43.683832 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dea483-ff78-4d4f-b7f4-25854dbf8e19 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:43.734837 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-13dea483-ff78-4d4f-b7f4-25854dbf8e19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc361f62811445b98071f4e06ae2bb8', 'request_id': 'req-13dea483-ff78-4d4f-b7f4-25854dbf8e19'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:43.749679 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-13dea483-ff78-4d4f-b7f4-25854dbf8e19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc361f62811445b98071f4e06ae2bb8', 'request_id': 'req-13dea483-ff78-4d4f-b7f4-25854dbf8e19'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:43.757559 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-13dea483-ff78-4d4f-b7f4-25854dbf8e19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc361f62811445b98071f4e06ae2bb8', 'request_id': 'req-13dea483-ff78-4d4f-b7f4-25854dbf8e19'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:43.776700 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-13dea483-ff78-4d4f-b7f4-25854dbf8e19 admin admin] The token cache is being invalidate because project 6bc361f62811445b98071f4e06ae2bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:07:43.777024 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-13dea483-ff78-4d4f-b7f4-25854dbf8e19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:43.777744 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-13dea483-ff78-4d4f-b7f4-25854dbf8e19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:07:43.779346 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1194/2405] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:07:43 2022] DELETE /identity/v3/projects/6bc361f62811445b98071f4e06ae2bb8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:43.784248 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686cbf0-0d64-4beb-a086-50a6cc38e05a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:43.784542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686cbf0-0d64-4beb-a086-50a6cc38e05a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:43.784844 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686cbf0-0d64-4beb-a086-50a6cc38e05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:43.804928 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c686cbf0-0d64-4beb-a086-50a6cc38e05a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:43.806383 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c686cbf0-0d64-4beb-a086-50a6cc38e05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:43.870189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1212/2406] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:07:43.878045 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf6772-13ab-449b-809d-d3bfb0e7b804 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:43.878341 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf6772-13ab-449b-809d-d3bfb0e7b804 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:43.878697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf6772-13ab-449b-809d-d3bfb0e7b804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:43.898795 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-71cf6772-13ab-449b-809d-d3bfb0e7b804 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:43.899997 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-71cf6772-13ab-449b-809d-d3bfb0e7b804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:43.915777 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1195/2407] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:43.917484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686cbf0-0d64-4beb-a086-50a6cc38e05a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:43.931835 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686cbf0-0d64-4beb-a086-50a6cc38e05a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:43.937233 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f171eb1-3962-4630-8776-24238eb37a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:43.938113 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f171eb1-3962-4630-8776-24238eb37a7b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:43.938403 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f171eb1-3962-4630-8776-24238eb37a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:43.939136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f171eb1-3962-4630-8776-24238eb37a7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:43.940250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f171eb1-3962-4630-8776-24238eb37a7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:07:43.940561 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f171eb1-3962-4630-8776-24238eb37a7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:43.943004 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f171eb1-3962-4630-8776-24238eb37a7b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:43.960605 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1213/2408] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:07:43.961145 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf6772-13ab-449b-809d-d3bfb0e7b804 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:43.972209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf6772-13ab-449b-809d-d3bfb0e7b804 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:43.977867 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee81fb0-a44e-455f-bd3f-7974deed3ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:43.978550 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee81fb0-a44e-455f-bd3f-7974deed3ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:43.978832 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee81fb0-a44e-455f-bd3f-7974deed3ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:43.979108 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee81fb0-a44e-455f-bd3f-7974deed3ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:43.979822 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee81fb0-a44e-455f-bd3f-7974deed3ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:43.981968 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee81fb0-a44e-455f-bd3f-7974deed3ac3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:44.018627 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1196/2409] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:07:43 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:07:44.023789 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f171eb1-3962-4630-8776-24238eb37a7b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:44.041052 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f171eb1-3962-4630-8776-24238eb37a7b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:44.119770 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01101560-49b7-483e-8650-6f3b36c8ff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:44.120711 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01101560-49b7-483e-8650-6f3b36c8ff4a admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:44.120967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01101560-49b7-483e-8650-6f3b36c8ff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:44.121243 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01101560-49b7-483e-8650-6f3b36c8ff4a admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:44.121956 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01101560-49b7-483e-8650-6f3b36c8ff4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:44.124838 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01101560-49b7-483e-8650-6f3b36c8ff4a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:44.151714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1214/2410] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:07:44 2022] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:07:44.155517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee81fb0-a44e-455f-bd3f-7974deed3ac3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:44.167017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee81fb0-a44e-455f-bd3f-7974deed3ac3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:44.172095 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6add6-2044-4010-920e-3db01b84051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:44.172740 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6add6-2044-4010-920e-3db01b84051d admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:44.173074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6add6-2044-4010-920e-3db01b84051d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:44.173320 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6add6-2044-4010-920e-3db01b84051d admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:44.174047 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6add6-2044-4010-920e-3db01b84051d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:44.175673 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6add6-2044-4010-920e-3db01b84051d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:44.196844 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1197/2411] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:07:44.200038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01101560-49b7-483e-8650-6f3b36c8ff4a admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:44.212682 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01101560-49b7-483e-8650-6f3b36c8ff4a admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:44.217983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c9c74-b395-4bc7-b1e9-832e62dea0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:44.218650 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c9c74-b395-4bc7-b1e9-832e62dea0ce admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:44.218945 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c9c74-b395-4bc7-b1e9-832e62dea0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:44.219244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c9c74-b395-4bc7-b1e9-832e62dea0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:44.220293 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c9c74-b395-4bc7-b1e9-832e62dea0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:44.222015 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c9c74-b395-4bc7-b1e9-832e62dea0ce admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:44.235530 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1215/2412] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:07:44.240719 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6add6-2044-4010-920e-3db01b84051d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:44.257204 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6add6-2044-4010-920e-3db01b84051d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:44.263354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a2706-7778-48f0-a286-c9d4482e39db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:44.264253 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a2706-7778-48f0-a286-c9d4482e39db admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:44.264537 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a2706-7778-48f0-a286-c9d4482e39db admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:44.265347 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a2706-7778-48f0-a286-c9d4482e39db admin admin] PATH_INFO: `/v3/projects/66edadd0ebde4bcb963b0d446ec33920/users/f8c6b9202b334a8d95102f996de7fe6f/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:44.284142 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a2706-7778-48f0-a286-c9d4482e39db admin admin] RBAC: Authorizing `identity:create_grant(project_id=66edadd0ebde4bcb963b0d446ec33920, user_id=f8c6b9202b334a8d95102f996de7fe6f, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:44.287009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a2706-7778-48f0-a286-c9d4482e39db admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:44.313391 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1198/2413] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:07:44 2022] PUT /identity/v3/projects/66edadd0ebde4bcb963b0d446ec33920/users/f8c6b9202b334a8d95102f996de7fe6f/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:07:44.324445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b07ba-2466-4c58-8de8-94c86705ab8b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:44.325143 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b07ba-2466-4c58-8de8-94c86705ab8b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:44.325143 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b07ba-2466-4c58-8de8-94c86705ab8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:44.367811 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-961b07ba-2466-4c58-8de8-94c86705ab8b None None] MFA Rules not processed for user `f8c6b9202b334a8d95102f996de7fe6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:44.369050 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-961b07ba-2466-4c58-8de8-94c86705ab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:44.462558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1216/2414] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:55.510164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe1961-a69b-4579-a1cb-da0e11d5fd02 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:55.510632 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe1961-a69b-4579-a1cb-da0e11d5fd02 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:55.510806 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe1961-a69b-4579-a1cb-da0e11d5fd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:55.528732 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4efe1961-a69b-4579-a1cb-da0e11d5fd02 None None] MFA Rules not processed for user `6a6685057ae24345b4067cffb06b7f63`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:55.529974 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4efe1961-a69b-4579-a1cb-da0e11d5fd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:55.587265 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1199/2415] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:07:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:57.827990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b07ba-2466-4c58-8de8-94c86705ab8b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:57.829423 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-961b07ba-2466-4c58-8de8-94c86705ab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:57.887719 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b07ba-2466-4c58-8de8-94c86705ab8b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:57.891243 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52be1a3-dcc5-4041-ab08-1e5c46e663a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e04bf8c51c4d89bbb45e96223e7409', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:57.891877 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52be1a3-dcc5-4041-ab08-1e5c46e663a0 service glance] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:57.892151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52be1a3-dcc5-4041-ab08-1e5c46e663a0 service glance] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:57.892419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52be1a3-dcc5-4041-ab08-1e5c46e663a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:57.900713 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52be1a3-dcc5-4041-ab08-1e5c46e663a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:57.902243 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52be1a3-dcc5-4041-ab08-1e5c46e663a0 service glance] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:57.911410 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1217/2416] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:07:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:07:58.105037 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbd3fd-f20e-48b0-b35f-de65c52dc2c9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:58.105443 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbd3fd-f20e-48b0-b35f-de65c52dc2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:58.105599 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbd3fd-f20e-48b0-b35f-de65c52dc2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:58.124964 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b0cbd3fd-f20e-48b0-b35f-de65c52dc2c9 None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:58.126183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b0cbd3fd-f20e-48b0-b35f-de65c52dc2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:58.182921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1200/2417] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 27 05:07:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:58.226403 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52be1a3-dcc5-4041-ab08-1e5c46e663a0 service glance] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:58.227854 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e52be1a3-dcc5-4041-ab08-1e5c46e663a0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:58.297086 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52be1a3-dcc5-4041-ab08-1e5c46e663a0 service glance] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:58.304628 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9b34c-72bc-43f7-bd3a-c5277eedf00d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:58.305318 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9b34c-72bc-43f7-bd3a-c5277eedf00d service swift] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:58.305601 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9b34c-72bc-43f7-bd3a-c5277eedf00d service swift] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:58.305871 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9b34c-72bc-43f7-bd3a-c5277eedf00d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:58.314389 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9b34c-72bc-43f7-bd3a-c5277eedf00d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:58.315972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9b34c-72bc-43f7-bd3a-c5277eedf00d service swift] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:58.324434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1218/2418] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 05:07:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 05:07:59.018606 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5070f5-7925-4605-bb48-95ee53f99862 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:59.019119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5070f5-7925-4605-bb48-95ee53f99862 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:59.019587 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5070f5-7925-4605-bb48-95ee53f99862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:59.046297 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8e5070f5-7925-4605-bb48-95ee53f99862 None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:59.047833 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8e5070f5-7925-4605-bb48-95ee53f99862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:59.070214 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1201/2419] 10.222.0.27 () {58 vars in 967 bytes} [Tue Sep 27 05:07:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:59.086989 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9b34c-72bc-43f7-bd3a-c5277eedf00d service swift] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:59.105903 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9b34c-72bc-43f7-bd3a-c5277eedf00d service swift] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:59.121746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fae2f7-e50d-4e27-a62b-675b0e9d6337 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:59.122415 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fae2f7-e50d-4e27-a62b-675b0e9d6337 service swift] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:59.122687 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fae2f7-e50d-4e27-a62b-675b0e9d6337 service swift] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:59.122959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fae2f7-e50d-4e27-a62b-675b0e9d6337 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:59.135703 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fae2f7-e50d-4e27-a62b-675b0e9d6337 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:59.137591 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fae2f7-e50d-4e27-a62b-675b0e9d6337 service swift] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:59.150245 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1219/2420] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 05:07:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 05:07:59.462228 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3183f1-9d78-4ba5-8a92-947699665b48 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:59.462706 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3183f1-9d78-4ba5-8a92-947699665b48 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:59.462805 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3183f1-9d78-4ba5-8a92-947699665b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:59.481966 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3d3183f1-9d78-4ba5-8a92-947699665b48 None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:59.483164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3d3183f1-9d78-4ba5-8a92-947699665b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:59.491286 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1202/2421] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 27 05:07:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:59.504905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fae2f7-e50d-4e27-a62b-675b0e9d6337 service swift] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:59.516153 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fae2f7-e50d-4e27-a62b-675b0e9d6337 service swift] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:59.523441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450d4c-eeb2-4576-a136-6d705e4f701c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:59.524169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450d4c-eeb2-4576-a136-6d705e4f701c service swift] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:59.524521 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450d4c-eeb2-4576-a136-6d705e4f701c service swift] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:59.524903 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450d4c-eeb2-4576-a136-6d705e4f701c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:59.535906 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6450d4c-eeb2-4576-a136-6d705e4f701c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:59.537976 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6450d4c-eeb2-4576-a136-6d705e4f701c service swift] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:07:59.547258 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1220/2422] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 05:07:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 05:07:59.924398 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d89dd7-f5b8-48bd-a168-73093a00dad5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:59.924685 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d89dd7-f5b8-48bd-a168-73093a00dad5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:59.924998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d89dd7-f5b8-48bd-a168-73093a00dad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:59.943549 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-49d89dd7-f5b8-48bd-a168-73093a00dad5 None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:07:59.944730 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-49d89dd7-f5b8-48bd-a168-73093a00dad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:07:59.952023 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1203/2423] 10.222.0.27 () {58 vars in 967 bytes} [Tue Sep 27 05:07:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:07:59.965920 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450d4c-eeb2-4576-a136-6d705e4f701c service swift] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:07:59.976568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450d4c-eeb2-4576-a136-6d705e4f701c service swift] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:07:59.981746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116a97a-d7c1-4049-96c8-df57d177ff8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:07:59.982473 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116a97a-d7c1-4049-96c8-df57d177ff8f service swift] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:07:59.982775 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116a97a-d7c1-4049-96c8-df57d177ff8f service swift] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:07:59.983050 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116a97a-d7c1-4049-96c8-df57d177ff8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:07:59.994040 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116a97a-d7c1-4049-96c8-df57d177ff8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:07:59.995665 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116a97a-d7c1-4049-96c8-df57d177ff8f service swift] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:00.007369 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1221/2424] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 05:07:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 05:08:02.264046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d89dd7-f5b8-48bd-a168-73093a00dad5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:02.265697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-49d89dd7-f5b8-48bd-a168-73093a00dad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:02.370070 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d89dd7-f5b8-48bd-a168-73093a00dad5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:02.377967 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033f70b-8357-40f0-9e2e-99df1d042fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:02.379959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033f70b-8357-40f0-9e2e-99df1d042fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:02.380431 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033f70b-8357-40f0-9e2e-99df1d042fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:02.380934 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033f70b-8357-40f0-9e2e-99df1d042fd2 admin admin] PATH_INFO: `/v3/users/2157c03cac6840f59445dc43877c4b62` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:02.382693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033f70b-8357-40f0-9e2e-99df1d042fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2157c03cac6840f59445dc43877c4b62)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:02.385985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033f70b-8357-40f0-9e2e-99df1d042fd2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:02.446153 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3033f70b-8357-40f0-9e2e-99df1d042fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2157c03cac6840f59445dc43877c4b62'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:02.446873 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3033f70b-8357-40f0-9e2e-99df1d042fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2157c03cac6840f59445dc43877c4b62'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:02.447501 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3033f70b-8357-40f0-9e2e-99df1d042fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2157c03cac6840f59445dc43877c4b62'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:02.455870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3033f70b-8357-40f0-9e2e-99df1d042fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2157c03cac6840f59445dc43877c4b62'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:02.468736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3033f70b-8357-40f0-9e2e-99df1d042fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2157c03cac6840f59445dc43877c4b62'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:02.481564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1204/2425] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:08:02 2022] DELETE /identity/v3/users/2157c03cac6840f59445dc43877c4b62 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:08:02.485983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc829ee-c28c-4450-ae4b-0545fefb0472 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:02.486504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc829ee-c28c-4450-ae4b-0545fefb0472 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:02.486504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc829ee-c28c-4450-ae4b-0545fefb0472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:02.506178 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-afc829ee-c28c-4450-ae4b-0545fefb0472 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:08:02.507774 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-afc829ee-c28c-4450-ae4b-0545fefb0472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:02.574139 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1222/2426] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:08:02.584440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033f70b-8357-40f0-9e2e-99df1d042fd2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:02.586034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3033f70b-8357-40f0-9e2e-99df1d042fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:02.650854 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033f70b-8357-40f0-9e2e-99df1d042fd2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:02.654770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea30a7e-3d5e-4d1a-8dc6-8e91c206cdc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:02.655502 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea30a7e-3d5e-4d1a-8dc6-8e91c206cdc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:02.655859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea30a7e-3d5e-4d1a-8dc6-8e91c206cdc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:02.656140 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea30a7e-3d5e-4d1a-8dc6-8e91c206cdc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:02.677248 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea30a7e-3d5e-4d1a-8dc6-8e91c206cdc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:02.678869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea30a7e-3d5e-4d1a-8dc6-8e91c206cdc2 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:02.691725 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1205/2427] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:08:02.984372 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc829ee-c28c-4450-ae4b-0545fefb0472 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:02.987533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-afc829ee-c28c-4450-ae4b-0545fefb0472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:03.010655 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc829ee-c28c-4450-ae4b-0545fefb0472 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:03.015580 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbabe1a-ec5e-4c89-85e3-6890c888d926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:03.016520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbabe1a-ec5e-4c89-85e3-6890c888d926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:03.017037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbabe1a-ec5e-4c89-85e3-6890c888d926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:03.017492 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbabe1a-ec5e-4c89-85e3-6890c888d926 admin admin] PATH_INFO: `/v3/projects/89ea28915f6a4a6ba8ed6b4fda932212` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:03.018809 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbabe1a-ec5e-4c89-85e3-6890c888d926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ea28915f6a4a6ba8ed6b4fda932212)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:03.021728 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbabe1a-ec5e-4c89-85e3-6890c888d926 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:03.070912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cbbabe1a-ec5e-4c89-85e3-6890c888d926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ea28915f6a4a6ba8ed6b4fda932212', 'request_id': 'req-cbbabe1a-ec5e-4c89-85e3-6890c888d926'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:03.080778 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cbbabe1a-ec5e-4c89-85e3-6890c888d926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ea28915f6a4a6ba8ed6b4fda932212', 'request_id': 'req-cbbabe1a-ec5e-4c89-85e3-6890c888d926'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:03.092647 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cbbabe1a-ec5e-4c89-85e3-6890c888d926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ea28915f6a4a6ba8ed6b4fda932212', 'request_id': 'req-cbbabe1a-ec5e-4c89-85e3-6890c888d926'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:03.111613 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cbbabe1a-ec5e-4c89-85e3-6890c888d926 admin admin] The token cache is being invalidate because project 89ea28915f6a4a6ba8ed6b4fda932212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:08:03.112034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cbbabe1a-ec5e-4c89-85e3-6890c888d926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:03.113491 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cbbabe1a-ec5e-4c89-85e3-6890c888d926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:03.115562 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1223/2428] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:08:02 2022] DELETE /identity/v3/projects/89ea28915f6a4a6ba8ed6b4fda932212 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:08:03.121080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c608fe9-37d1-45b6-a232-7c87405ac627 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:03.121368 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c608fe9-37d1-45b6-a232-7c87405ac627 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:03.121874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c608fe9-37d1-45b6-a232-7c87405ac627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:03.142135 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1c608fe9-37d1-45b6-a232-7c87405ac627 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:08:03.143584 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1c608fe9-37d1-45b6-a232-7c87405ac627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:03.219951 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1206/2429] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:08:03.228548 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c47fb-a22e-44c4-90cc-4167feeadd87 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:03.228863 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c47fb-a22e-44c4-90cc-4167feeadd87 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:03.229141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c47fb-a22e-44c4-90cc-4167feeadd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:03.247838 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9f3c47fb-a22e-44c4-90cc-4167feeadd87 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:08:03.249062 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9f3c47fb-a22e-44c4-90cc-4167feeadd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:03.258348 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1224/2430] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:08:03.263168 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c608fe9-37d1-45b6-a232-7c87405ac627 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:03.274315 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c608fe9-37d1-45b6-a232-7c87405ac627 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:03.278921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d0246-7142-4960-9106-29e3d6113de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:03.279876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d0246-7142-4960-9106-29e3d6113de4 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:03.280647 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d0246-7142-4960-9106-29e3d6113de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:03.280974 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d0246-7142-4960-9106-29e3d6113de4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:03.281997 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d0246-7142-4960-9106-29e3d6113de4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:08:03.282308 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d0246-7142-4960-9106-29e3d6113de4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:03.283895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d0246-7142-4960-9106-29e3d6113de4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:03.301439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1207/2431] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:08:03.303036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c47fb-a22e-44c4-90cc-4167feeadd87 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:03.313232 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c47fb-a22e-44c4-90cc-4167feeadd87 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:03.318449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff1d6d-5e3e-4da8-b442-df38765f4772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:03.319090 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff1d6d-5e3e-4da8-b442-df38765f4772 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:03.319370 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff1d6d-5e3e-4da8-b442-df38765f4772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:03.319642 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff1d6d-5e3e-4da8-b442-df38765f4772 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:03.320320 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff1d6d-5e3e-4da8-b442-df38765f4772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:03.322240 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff1d6d-5e3e-4da8-b442-df38765f4772 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:03.350281 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1225/2432] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:08:03 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:08:03.355257 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d0246-7142-4960-9106-29e3d6113de4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:03.367150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d0246-7142-4960-9106-29e3d6113de4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:03.439368 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa52e6-e1f9-4085-a27a-04141d221e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:03.440041 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa52e6-e1f9-4085-a27a-04141d221e23 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:03.440322 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa52e6-e1f9-4085-a27a-04141d221e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:03.440601 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa52e6-e1f9-4085-a27a-04141d221e23 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:03.442049 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa52e6-e1f9-4085-a27a-04141d221e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:03.443985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa52e6-e1f9-4085-a27a-04141d221e23 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:03.464998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1208/2433] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:08:03 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:08:03.470738 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff1d6d-5e3e-4da8-b442-df38765f4772 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:03.481101 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff1d6d-5e3e-4da8-b442-df38765f4772 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:03.485673 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cc127-e166-4042-bd7a-c9ecf1a13733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:03.486331 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cc127-e166-4042-bd7a-c9ecf1a13733 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:03.486875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cc127-e166-4042-bd7a-c9ecf1a13733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:03.486875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cc127-e166-4042-bd7a-c9ecf1a13733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:03.487580 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cc127-e166-4042-bd7a-c9ecf1a13733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:03.489223 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cc127-e166-4042-bd7a-c9ecf1a13733 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:03.499259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1226/2434] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:08:03.503332 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa52e6-e1f9-4085-a27a-04141d221e23 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:03.514168 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa52e6-e1f9-4085-a27a-04141d221e23 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:03.518664 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2b779-6871-438a-a337-6bd921ab87a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:03.520067 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2b779-6871-438a-a337-6bd921ab87a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:03.520351 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2b779-6871-438a-a337-6bd921ab87a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:03.520627 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2b779-6871-438a-a337-6bd921ab87a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:03.521392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2b779-6871-438a-a337-6bd921ab87a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:03.522989 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2b779-6871-438a-a337-6bd921ab87a9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:03.532484 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1209/2435] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:08:03.536525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cc127-e166-4042-bd7a-c9ecf1a13733 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:03.546569 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cc127-e166-4042-bd7a-c9ecf1a13733 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:03.551578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d3caa-59ae-496d-b25a-2b4f71b020da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:03.552433 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d3caa-59ae-496d-b25a-2b4f71b020da admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:03.552711 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d3caa-59ae-496d-b25a-2b4f71b020da admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:03.553013 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d3caa-59ae-496d-b25a-2b4f71b020da admin admin] PATH_INFO: `/v3/projects/26e17082ae5342d29732e14c7d59f44c/users/6ec6cd63c03c4ba29bc1eff1086f70fd/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:03.568326 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d3caa-59ae-496d-b25a-2b4f71b020da admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e17082ae5342d29732e14c7d59f44c, user_id=6ec6cd63c03c4ba29bc1eff1086f70fd, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:03.570996 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d3caa-59ae-496d-b25a-2b4f71b020da admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:03.584664 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1227/2436] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:08:03 2022] PUT /identity/v3/projects/26e17082ae5342d29732e14c7d59f44c/users/6ec6cd63c03c4ba29bc1eff1086f70fd/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:08:03.589992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af101-4732-4807-aa8a-8895f52bc497 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:03.590276 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af101-4732-4807-aa8a-8895f52bc497 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:03.590551 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75af101-4732-4807-aa8a-8895f52bc497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:03.608459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a75af101-4732-4807-aa8a-8895f52bc497 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:08:03.609670 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a75af101-4732-4807-aa8a-8895f52bc497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:03.672113 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1210/2437] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:08:03.683783 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d3caa-59ae-496d-b25a-2b4f71b020da admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:03.685644 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ce1d3caa-59ae-496d-b25a-2b4f71b020da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:03.745685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d3caa-59ae-496d-b25a-2b4f71b020da admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:03.749346 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d4d1d-cef3-4bb4-a05d-fe27157256e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:03.749987 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d4d1d-cef3-4bb4-a05d-fe27157256e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:03.750267 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d4d1d-cef3-4bb4-a05d-fe27157256e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:03.750541 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d4d1d-cef3-4bb4-a05d-fe27157256e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:03.760643 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d4d1d-cef3-4bb4-a05d-fe27157256e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:03.762102 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d4d1d-cef3-4bb4-a05d-fe27157256e2 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:03.772087 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1228/2438] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:08:04.479803 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d3ff1-115f-4c7a-bd2d-6cb8439a64c6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:04.480401 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d3ff1-115f-4c7a-bd2d-6cb8439a64c6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:04.480870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d3ff1-115f-4c7a-bd2d-6cb8439a64c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:04.507819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4a9d3ff1-115f-4c7a-bd2d-6cb8439a64c6 None None] MFA Rules not processed for user `6ec6cd63c03c4ba29bc1eff1086f70fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:08:04.509180 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4a9d3ff1-115f-4c7a-bd2d-6cb8439a64c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:04.577447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1211/2439] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:08:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:08:04.588586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d4d1d-cef3-4bb4-a05d-fe27157256e2 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:04.590198 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-358d4d1d-cef3-4bb4-a05d-fe27157256e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:04.649229 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d4d1d-cef3-4bb4-a05d-fe27157256e2 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:04.654225 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410abbb-d87e-40b6-8986-45f0d97ebe98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:04.655055 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410abbb-d87e-40b6-8986-45f0d97ebe98 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:04.655439 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410abbb-d87e-40b6-8986-45f0d97ebe98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:04.655713 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410abbb-d87e-40b6-8986-45f0d97ebe98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:04.665361 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410abbb-d87e-40b6-8986-45f0d97ebe98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:04.666778 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410abbb-d87e-40b6-8986-45f0d97ebe98 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:04.676928 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1229/2440] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:08:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:08:06.057317 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a12879-3dc3-4ded-a2d1-99b2ed587f54 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:06.057750 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a12879-3dc3-4ded-a2d1-99b2ed587f54 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:06.057932 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a12879-3dc3-4ded-a2d1-99b2ed587f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:06.075991 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-92a12879-3dc3-4ded-a2d1-99b2ed587f54 None None] MFA Rules not processed for user `6ec6cd63c03c4ba29bc1eff1086f70fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:08:06.077231 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-92a12879-3dc3-4ded-a2d1-99b2ed587f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:06.084716 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1212/2441] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:08:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:08:09.033650 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365271b-7d06-4aee-9ded-16cf915db2a5 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:09.034429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365271b-7d06-4aee-9ded-16cf915db2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:09.035183 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365271b-7d06-4aee-9ded-16cf915db2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:09.056145 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0365271b-7d06-4aee-9ded-16cf915db2a5 None None] MFA Rules not processed for user `43aeedbf8ef94c969eba750306890f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:08:09.057379 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0365271b-7d06-4aee-9ded-16cf915db2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:09.127670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1230/2442] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:08:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:08:13.935468 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a12879-3dc3-4ded-a2d1-99b2ed587f54 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:13.936922 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-92a12879-3dc3-4ded-a2d1-99b2ed587f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:14.023501 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a12879-3dc3-4ded-a2d1-99b2ed587f54 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:14.029268 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec776e-27db-4c48-9138-80f629f20bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:14.030164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec776e-27db-4c48-9138-80f629f20bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:14.030521 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec776e-27db-4c48-9138-80f629f20bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:14.030824 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec776e-27db-4c48-9138-80f629f20bd8 admin admin] PATH_INFO: `/v3/users/c55737c3b76142b0b8e33797add1baa8` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:14.032047 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec776e-27db-4c48-9138-80f629f20bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c55737c3b76142b0b8e33797add1baa8)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:14.034100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec776e-27db-4c48-9138-80f629f20bd8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:14.083270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1bec776e-27db-4c48-9138-80f629f20bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c55737c3b76142b0b8e33797add1baa8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:14.084894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1bec776e-27db-4c48-9138-80f629f20bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c55737c3b76142b0b8e33797add1baa8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:14.085526 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1bec776e-27db-4c48-9138-80f629f20bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c55737c3b76142b0b8e33797add1baa8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:14.093540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1bec776e-27db-4c48-9138-80f629f20bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c55737c3b76142b0b8e33797add1baa8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:14.105868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1bec776e-27db-4c48-9138-80f629f20bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c55737c3b76142b0b8e33797add1baa8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:14.118857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1213/2443] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:08:13 2022] DELETE /identity/v3/users/c55737c3b76142b0b8e33797add1baa8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:08:14.123245 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b695e43-0b5b-46a8-b6d7-903f4b394603 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:14.123800 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b695e43-0b5b-46a8-b6d7-903f4b394603 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:14.123800 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b695e43-0b5b-46a8-b6d7-903f4b394603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:14.154539 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-5b695e43-0b5b-46a8-b6d7-903f4b394603 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:08:14.155745 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5b695e43-0b5b-46a8-b6d7-903f4b394603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:14.221560 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1231/2444] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:08:14.232022 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec776e-27db-4c48-9138-80f629f20bd8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:14.233816 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1bec776e-27db-4c48-9138-80f629f20bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:14.341036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec776e-27db-4c48-9138-80f629f20bd8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:14.344554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6625777-e9b2-4294-b63f-7c5048b0d511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:14.345231 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6625777-e9b2-4294-b63f-7c5048b0d511 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:14.345505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6625777-e9b2-4294-b63f-7c5048b0d511 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:14.345795 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6625777-e9b2-4294-b63f-7c5048b0d511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:14.356344 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6625777-e9b2-4294-b63f-7c5048b0d511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:14.357836 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6625777-e9b2-4294-b63f-7c5048b0d511 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:14.368679 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1214/2445] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:08:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:08:14.656352 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b695e43-0b5b-46a8-b6d7-903f4b394603 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:14.657876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5b695e43-0b5b-46a8-b6d7-903f4b394603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:14.670411 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b695e43-0b5b-46a8-b6d7-903f4b394603 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:14.675649 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20aefa-df6e-435b-b1c6-fb171efa0e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:14.676520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20aefa-df6e-435b-b1c6-fb171efa0e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:14.677100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20aefa-df6e-435b-b1c6-fb171efa0e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:14.677589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20aefa-df6e-435b-b1c6-fb171efa0e0e admin admin] PATH_INFO: `/v3/projects/504ed062d7374c07a5fcd5588ea11938` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:14.679609 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20aefa-df6e-435b-b1c6-fb171efa0e0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=504ed062d7374c07a5fcd5588ea11938)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:14.683167 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20aefa-df6e-435b-b1c6-fb171efa0e0e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:14.755867 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4b20aefa-df6e-435b-b1c6-fb171efa0e0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504ed062d7374c07a5fcd5588ea11938', 'request_id': 'req-4b20aefa-df6e-435b-b1c6-fb171efa0e0e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:14.761982 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4b20aefa-df6e-435b-b1c6-fb171efa0e0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504ed062d7374c07a5fcd5588ea11938', 'request_id': 'req-4b20aefa-df6e-435b-b1c6-fb171efa0e0e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:14.770192 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4b20aefa-df6e-435b-b1c6-fb171efa0e0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504ed062d7374c07a5fcd5588ea11938', 'request_id': 'req-4b20aefa-df6e-435b-b1c6-fb171efa0e0e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:14.782708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4b20aefa-df6e-435b-b1c6-fb171efa0e0e admin admin] The token cache is being invalidate because project 504ed062d7374c07a5fcd5588ea11938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:08:14.783111 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4b20aefa-df6e-435b-b1c6-fb171efa0e0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:14.784262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4b20aefa-df6e-435b-b1c6-fb171efa0e0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:14.786690 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1232/2446] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:08:14 2022] DELETE /identity/v3/projects/504ed062d7374c07a5fcd5588ea11938 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:08:14.796743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd3029-7f80-4d61-acb2-66f59e7414db None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:14.799056 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd3029-7f80-4d61-acb2-66f59e7414db None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:14.800593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd3029-7f80-4d61-acb2-66f59e7414db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:14.833295 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8cfd3029-7f80-4d61-acb2-66f59e7414db None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:08:14.834490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8cfd3029-7f80-4d61-acb2-66f59e7414db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:14.903669 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1215/2447] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:08:14.912993 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4308b-32a8-4172-9a1a-c94c659f612c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:14.913556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4308b-32a8-4172-9a1a-c94c659f612c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:14.913993 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4308b-32a8-4172-9a1a-c94c659f612c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:14.931839 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd3029-7f80-4d61-acb2-66f59e7414db None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:14.937621 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8cfd3029-7f80-4d61-acb2-66f59e7414db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:14.947106 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4ff4308b-32a8-4172-9a1a-c94c659f612c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:08:14.948344 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4ff4308b-32a8-4172-9a1a-c94c659f612c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:14.955898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd3029-7f80-4d61-acb2-66f59e7414db None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:14.959131 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1233/2448] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:08:14.962253 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab089b02-3ddc-413e-b3fa-8dc23093901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:14.963365 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab089b02-3ddc-413e-b3fa-8dc23093901d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:14.963724 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab089b02-3ddc-413e-b3fa-8dc23093901d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:14.963968 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4308b-32a8-4172-9a1a-c94c659f612c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:14.964116 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab089b02-3ddc-413e-b3fa-8dc23093901d admin admin] PATH_INFO: `/v3/users/ac5ed3a769a043469fedf176615be2d0` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:14.965479 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab089b02-3ddc-413e-b3fa-8dc23093901d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac5ed3a769a043469fedf176615be2d0)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:14.967474 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab089b02-3ddc-413e-b3fa-8dc23093901d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:14.976076 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4308b-32a8-4172-9a1a-c94c659f612c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:14.983480 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b91c0-2ea6-490d-9486-a8b2d1882521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:14.984187 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b91c0-2ea6-490d-9486-a8b2d1882521 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:14.984466 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b91c0-2ea6-490d-9486-a8b2d1882521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:14.984740 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b91c0-2ea6-490d-9486-a8b2d1882521 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:14.985509 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b91c0-2ea6-490d-9486-a8b2d1882521 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:08:14.985811 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b91c0-2ea6-490d-9486-a8b2d1882521 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:14.987751 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b91c0-2ea6-490d-9486-a8b2d1882521 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:15.006346 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1234/2449] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 05:08:15.011003 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b91c0-2ea6-490d-9486-a8b2d1882521 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:15.026681 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ab089b02-3ddc-413e-b3fa-8dc23093901d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac5ed3a769a043469fedf176615be2d0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:15.027470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ab089b02-3ddc-413e-b3fa-8dc23093901d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac5ed3a769a043469fedf176615be2d0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:15.028218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ab089b02-3ddc-413e-b3fa-8dc23093901d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac5ed3a769a043469fedf176615be2d0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:15.029214 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b91c0-2ea6-490d-9486-a8b2d1882521 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:15.038221 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef53ef-e6de-42bb-8f98-47352819bf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:15.039176 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef53ef-e6de-42bb-8f98-47352819bf5f admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:15.039466 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ab089b02-3ddc-413e-b3fa-8dc23093901d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac5ed3a769a043469fedf176615be2d0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:15.039586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef53ef-e6de-42bb-8f98-47352819bf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:15.040020 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef53ef-e6de-42bb-8f98-47352819bf5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:15.040810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef53ef-e6de-42bb-8f98-47352819bf5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:15.043048 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef53ef-e6de-42bb-8f98-47352819bf5f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:15.061119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ab089b02-3ddc-413e-b3fa-8dc23093901d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac5ed3a769a043469fedf176615be2d0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:15.076868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1216/2450] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:08:14 2022] DELETE /identity/v3/users/ac5ed3a769a043469fedf176615be2d0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:08:15.081219 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef817-b433-43c3-84f4-597b09685150 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:15.082227 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef817-b433-43c3-84f4-597b09685150 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:15.082644 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1235/2451] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:08:15 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:08:15.082900 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef817-b433-43c3-84f4-597b09685150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:15.090659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef53ef-e6de-42bb-8f98-47352819bf5f admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:15.092604 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d4ef53ef-e6de-42bb-8f98-47352819bf5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:15.102959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4edef817-b433-43c3-84f4-597b09685150 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:08:15.104296 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4edef817-b433-43c3-84f4-597b09685150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:15.170577 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef53ef-e6de-42bb-8f98-47352819bf5f admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:15.175266 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8f8bb-b4ed-4a51-a76e-ea8030540043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:15.176374 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8f8bb-b4ed-4a51-a76e-ea8030540043 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:15.176657 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8f8bb-b4ed-4a51-a76e-ea8030540043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:15.176971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8f8bb-b4ed-4a51-a76e-ea8030540043 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:15.177676 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8f8bb-b4ed-4a51-a76e-ea8030540043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:15.179851 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8f8bb-b4ed-4a51-a76e-ea8030540043 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:15.180832 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1217/2452] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:08:15.195753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edef817-b433-43c3-84f4-597b09685150 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:15.197371 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4edef817-b433-43c3-84f4-597b09685150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:15.203966 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1236/2453] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:08:15 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:08:15.208860 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8f8bb-b4ed-4a51-a76e-ea8030540043 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:15.219204 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8f8bb-b4ed-4a51-a76e-ea8030540043 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:15.224994 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101727b-f796-4245-8556-f230b97f66e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:15.225661 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101727b-f796-4245-8556-f230b97f66e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:15.225946 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101727b-f796-4245-8556-f230b97f66e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:15.226219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101727b-f796-4245-8556-f230b97f66e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:15.227108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101727b-f796-4245-8556-f230b97f66e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:15.228775 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101727b-f796-4245-8556-f230b97f66e4 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:15.255943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1237/2454] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:08:15.261824 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101727b-f796-4245-8556-f230b97f66e4 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:15.263106 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edef817-b433-43c3-84f4-597b09685150 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:15.267974 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06518221-063a-4480-92a1-d3c2f2c2f100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:15.270138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06518221-063a-4480-92a1-d3c2f2c2f100 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:15.270448 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06518221-063a-4480-92a1-d3c2f2c2f100 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:15.270628 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06518221-063a-4480-92a1-d3c2f2c2f100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:15.273510 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101727b-f796-4245-8556-f230b97f66e4 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:15.278429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b12ae0-127a-49cb-adc3-bbe0a74502ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:15.279377 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b12ae0-127a-49cb-adc3-bbe0a74502ed admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:15.279677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b12ae0-127a-49cb-adc3-bbe0a74502ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:15.280077 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b12ae0-127a-49cb-adc3-bbe0a74502ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:15.280958 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b12ae0-127a-49cb-adc3-bbe0a74502ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:15.282894 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b12ae0-127a-49cb-adc3-bbe0a74502ed admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:15.283265 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06518221-063a-4480-92a1-d3c2f2c2f100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:15.285451 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06518221-063a-4480-92a1-d3c2f2c2f100 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:15.297333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1238/2455] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:08:15.301786 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b12ae0-127a-49cb-adc3-bbe0a74502ed admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:15.312841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1218/2456] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:08:15.319282 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b12ae0-127a-49cb-adc3-bbe0a74502ed admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:15.326202 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ab130-e752-4b50-b24c-4e65e026c6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:15.327710 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ab130-e752-4b50-b24c-4e65e026c6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:15.328281 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ab130-e752-4b50-b24c-4e65e026c6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:15.328712 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ab130-e752-4b50-b24c-4e65e026c6e3 admin admin] PATH_INFO: `/v3/projects/dd9cd5a85d76484386fc1b7e91ce66c7/users/fc9b5f276d17426fa2dca5dd1d35505e/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:15.353233 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ab130-e752-4b50-b24c-4e65e026c6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd9cd5a85d76484386fc1b7e91ce66c7, user_id=fc9b5f276d17426fa2dca5dd1d35505e, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:15.356070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ab130-e752-4b50-b24c-4e65e026c6e3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:15.377022 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1239/2457] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:08:15 2022] PUT /identity/v3/projects/dd9cd5a85d76484386fc1b7e91ce66c7/users/fc9b5f276d17426fa2dca5dd1d35505e/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:08:15.379412 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542851ed-71e5-45cb-998d-b227e85d3929 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:15.379992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542851ed-71e5-45cb-998d-b227e85d3929 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:15.380242 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542851ed-71e5-45cb-998d-b227e85d3929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:15.408005 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-542851ed-71e5-45cb-998d-b227e85d3929 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:08:15.409432 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-542851ed-71e5-45cb-998d-b227e85d3929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:15.485318 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1219/2458] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:08:15.510524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ab130-e752-4b50-b24c-4e65e026c6e3 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:15.512414 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8b9ab130-e752-4b50-b24c-4e65e026c6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:15.589448 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ab130-e752-4b50-b24c-4e65e026c6e3 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:15.593601 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2765a8-3c93-426c-af56-58e8602aa963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:15.594380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2765a8-3c93-426c-af56-58e8602aa963 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:15.594881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2765a8-3c93-426c-af56-58e8602aa963 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:15.595315 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2765a8-3c93-426c-af56-58e8602aa963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:15.607093 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2765a8-3c93-426c-af56-58e8602aa963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:15.608949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2765a8-3c93-426c-af56-58e8602aa963 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:15.622155 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1240/2459] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:08:15.822987 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542851ed-71e5-45cb-998d-b227e85d3929 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:15.824439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-542851ed-71e5-45cb-998d-b227e85d3929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:15.851092 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542851ed-71e5-45cb-998d-b227e85d3929 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:15.857789 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c19de-0d88-4788-ac97-00a1c52008fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:15.858598 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c19de-0d88-4788-ac97-00a1c52008fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:15.858973 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c19de-0d88-4788-ac97-00a1c52008fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:15.859260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c19de-0d88-4788-ac97-00a1c52008fd admin admin] PATH_INFO: `/v3/projects/ab193c5d90314047a98f17a4eca607cd` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:15.860608 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c19de-0d88-4788-ac97-00a1c52008fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab193c5d90314047a98f17a4eca607cd)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:15.863255 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c19de-0d88-4788-ac97-00a1c52008fd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:15.916486 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a5c19de-0d88-4788-ac97-00a1c52008fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab193c5d90314047a98f17a4eca607cd', 'request_id': 'req-1a5c19de-0d88-4788-ac97-00a1c52008fd'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:15.924093 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a5c19de-0d88-4788-ac97-00a1c52008fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab193c5d90314047a98f17a4eca607cd', 'request_id': 'req-1a5c19de-0d88-4788-ac97-00a1c52008fd'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:15.932174 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a5c19de-0d88-4788-ac97-00a1c52008fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab193c5d90314047a98f17a4eca607cd', 'request_id': 'req-1a5c19de-0d88-4788-ac97-00a1c52008fd'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:15.949310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a5c19de-0d88-4788-ac97-00a1c52008fd admin admin] The token cache is being invalidate because project ab193c5d90314047a98f17a4eca607cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:08:15.949890 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a5c19de-0d88-4788-ac97-00a1c52008fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:15.950426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1a5c19de-0d88-4788-ac97-00a1c52008fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:15.953705 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1220/2460] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:08:15 2022] DELETE /identity/v3/projects/ab193c5d90314047a98f17a4eca607cd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:08:20.443443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cdddd-5782-484e-828a-ec532062b33c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:20.443954 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cdddd-5782-484e-828a-ec532062b33c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:20.444064 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cdddd-5782-484e-828a-ec532062b33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:20.482681 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c46cdddd-5782-484e-828a-ec532062b33c None None] MFA Rules not processed for user `fc9b5f276d17426fa2dca5dd1d35505e`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:08:20.484733 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c46cdddd-5782-484e-828a-ec532062b33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:20.558891 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1241/2461] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:08:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:08:20.564044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c19de-0d88-4788-ac97-00a1c52008fd admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:20.565616 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1a5c19de-0d88-4788-ac97-00a1c52008fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:20.639600 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c19de-0d88-4788-ac97-00a1c52008fd admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:20.644514 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c32392-4d5f-4a5d-a1df-a043fd8dbafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:20.645224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c32392-4d5f-4a5d-a1df-a043fd8dbafb admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:20.645505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c32392-4d5f-4a5d-a1df-a043fd8dbafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:20.645775 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c32392-4d5f-4a5d-a1df-a043fd8dbafb admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:20.646458 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c32392-4d5f-4a5d-a1df-a043fd8dbafb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:20.648422 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c32392-4d5f-4a5d-a1df-a043fd8dbafb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:20.678245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1221/2462] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:08:20 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:08:20.679440 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cdddd-5782-484e-828a-ec532062b33c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:20.690195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cdddd-5782-484e-828a-ec532062b33c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:20.747714 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e21c6-8c78-4b4d-abbb-368f6047aa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:20.748388 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e21c6-8c78-4b4d-abbb-368f6047aa59 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:20.748672 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e21c6-8c78-4b4d-abbb-368f6047aa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:20.748982 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e21c6-8c78-4b4d-abbb-368f6047aa59 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:20.749673 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e21c6-8c78-4b4d-abbb-368f6047aa59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:20.751599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e21c6-8c78-4b4d-abbb-368f6047aa59 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:20.774639 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1242/2463] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:08:20 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:08:20.775927 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c32392-4d5f-4a5d-a1df-a043fd8dbafb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:20.787902 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c32392-4d5f-4a5d-a1df-a043fd8dbafb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:20.792626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62950de5-adf5-4fa4-8834-ed027abe2fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:20.793520 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62950de5-adf5-4fa4-8834-ed027abe2fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:20.793841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62950de5-adf5-4fa4-8834-ed027abe2fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:20.794112 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62950de5-adf5-4fa4-8834-ed027abe2fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:20.794839 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62950de5-adf5-4fa4-8834-ed027abe2fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:20.796451 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62950de5-adf5-4fa4-8834-ed027abe2fd0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:20.810311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1222/2464] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:08:20.814598 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e21c6-8c78-4b4d-abbb-368f6047aa59 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:20.824951 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e21c6-8c78-4b4d-abbb-368f6047aa59 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:20.829733 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77a923-3802-4857-aad9-0fdce12e2f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:20.830637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77a923-3802-4857-aad9-0fdce12e2f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:20.830911 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77a923-3802-4857-aad9-0fdce12e2f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:20.831188 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77a923-3802-4857-aad9-0fdce12e2f5d admin admin] PATH_INFO: `/v3/projects/f215b2cd18cf479e978e48943466579e/users/69d295f898444965b550c2e81c1bbf66/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:20.848767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77a923-3802-4857-aad9-0fdce12e2f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f215b2cd18cf479e978e48943466579e, user_id=69d295f898444965b550c2e81c1bbf66, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:20.851783 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77a923-3802-4857-aad9-0fdce12e2f5d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:20.867666 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1243/2465] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:08:20 2022] PUT /identity/v3/projects/f215b2cd18cf479e978e48943466579e/users/69d295f898444965b550c2e81c1bbf66/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:08:20.871908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62950de5-adf5-4fa4-8834-ed027abe2fd0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:20.883526 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62950de5-adf5-4fa4-8834-ed027abe2fd0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:20.940636 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218ddd0-e89e-4c19-af68-a4754eb1773c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:20.941630 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218ddd0-e89e-4c19-af68-a4754eb1773c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:20.942030 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218ddd0-e89e-4c19-af68-a4754eb1773c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:20.942311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218ddd0-e89e-4c19-af68-a4754eb1773c admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:20.943045 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218ddd0-e89e-4c19-af68-a4754eb1773c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:20.944661 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218ddd0-e89e-4c19-af68-a4754eb1773c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:20.956129 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1223/2466] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:08:20.960422 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77a923-3802-4857-aad9-0fdce12e2f5d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:20.974132 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77a923-3802-4857-aad9-0fdce12e2f5d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:20.990814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b8071-0ee5-4cab-9fc6-a90baaf889db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:20.992519 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b8071-0ee5-4cab-9fc6-a90baaf889db admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:20.993119 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b8071-0ee5-4cab-9fc6-a90baaf889db admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:20.993552 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b8071-0ee5-4cab-9fc6-a90baaf889db admin admin] PATH_INFO: `/v3/projects/f215b2cd18cf479e978e48943466579e/users/69d295f898444965b550c2e81c1bbf66/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:20.998008 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b8071-0ee5-4cab-9fc6-a90baaf889db admin admin] RBAC: Authorizing `identity:create_grant(project_id=f215b2cd18cf479e978e48943466579e, user_id=69d295f898444965b550c2e81c1bbf66, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:21.001632 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b8071-0ee5-4cab-9fc6-a90baaf889db admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:21.014031 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1244/2467] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:08:20 2022] PUT /identity/v3/projects/f215b2cd18cf479e978e48943466579e/users/69d295f898444965b550c2e81c1bbf66/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:08:26.462972 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308dc5-c516-4b78-9878-40ad5f78fe0a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:26.463514 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308dc5-c516-4b78-9878-40ad5f78fe0a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:26.463514 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54308dc5-c516-4b78-9878-40ad5f78fe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:26.493628 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-54308dc5-c516-4b78-9878-40ad5f78fe0a None None] MFA Rules not processed for user `69d295f898444965b550c2e81c1bbf66`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:08:26.494901 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-54308dc5-c516-4b78-9878-40ad5f78fe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:26.565582 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1224/2468] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:08:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:08:26.579445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b8071-0ee5-4cab-9fc6-a90baaf889db admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:26.581097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-cf7b8071-0ee5-4cab-9fc6-a90baaf889db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:26.655540 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b8071-0ee5-4cab-9fc6-a90baaf889db admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:26.661620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2362efe-b609-44e1-bbae-ad3abddfd28d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:26.662259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362efe-b609-44e1-bbae-ad3abddfd28d service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:26.662540 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362efe-b609-44e1-bbae-ad3abddfd28d service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:26.662814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362efe-b609-44e1-bbae-ad3abddfd28d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:26.715557 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2362efe-b609-44e1-bbae-ad3abddfd28d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:26.717192 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2362efe-b609-44e1-bbae-ad3abddfd28d service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:26.726502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1245/2469] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:08:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:08:38.183930 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54308dc5-c516-4b78-9878-40ad5f78fe0a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:38.185394 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-54308dc5-c516-4b78-9878-40ad5f78fe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:38.250703 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54308dc5-c516-4b78-9878-40ad5f78fe0a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:38.255392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af4c6a-5432-482e-83ff-9d49ed4467a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:38.256808 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af4c6a-5432-482e-83ff-9d49ed4467a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:38.257242 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af4c6a-5432-482e-83ff-9d49ed4467a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:38.257516 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af4c6a-5432-482e-83ff-9d49ed4467a6 admin admin] PATH_INFO: `/v3/users/f8c6b9202b334a8d95102f996de7fe6f` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:38.258700 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af4c6a-5432-482e-83ff-9d49ed4467a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c6b9202b334a8d95102f996de7fe6f)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:38.260638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af4c6a-5432-482e-83ff-9d49ed4467a6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:38.313391 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-28af4c6a-5432-482e-83ff-9d49ed4467a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c6b9202b334a8d95102f996de7fe6f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:38.314049 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-28af4c6a-5432-482e-83ff-9d49ed4467a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c6b9202b334a8d95102f996de7fe6f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:38.314665 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-28af4c6a-5432-482e-83ff-9d49ed4467a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c6b9202b334a8d95102f996de7fe6f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:38.322775 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-28af4c6a-5432-482e-83ff-9d49ed4467a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c6b9202b334a8d95102f996de7fe6f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:38.336128 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-28af4c6a-5432-482e-83ff-9d49ed4467a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c6b9202b334a8d95102f996de7fe6f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:38.348008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1225/2470] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:08:38 2022] DELETE /identity/v3/users/f8c6b9202b334a8d95102f996de7fe6f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:08:38.352651 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e3197-fde1-44c2-bac3-71b13df08caa None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:38.353155 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e3197-fde1-44c2-bac3-71b13df08caa None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:38.353350 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e3197-fde1-44c2-bac3-71b13df08caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:38.370543 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-aa8e3197-fde1-44c2-bac3-71b13df08caa None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:08:38.371757 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-aa8e3197-fde1-44c2-bac3-71b13df08caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:38.433709 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1246/2471] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:08:38.443958 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af4c6a-5432-482e-83ff-9d49ed4467a6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:38.445600 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-28af4c6a-5432-482e-83ff-9d49ed4467a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:38.501390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af4c6a-5432-482e-83ff-9d49ed4467a6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:38.504886 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45287a-c8d9-46de-8c75-abb9549b1385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:38.505769 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45287a-c8d9-46de-8c75-abb9549b1385 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:38.506104 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45287a-c8d9-46de-8c75-abb9549b1385 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:38.506374 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45287a-c8d9-46de-8c75-abb9549b1385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:38.515745 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45287a-c8d9-46de-8c75-abb9549b1385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:38.519845 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45287a-c8d9-46de-8c75-abb9549b1385 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:38.541249 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1226/2472] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:08:38.813449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e3197-fde1-44c2-bac3-71b13df08caa None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:38.815088 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-aa8e3197-fde1-44c2-bac3-71b13df08caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:38.829829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e3197-fde1-44c2-bac3-71b13df08caa None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:38.836469 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6f6ce-bd69-48a2-aff8-caf365210f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:38.837379 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6f6ce-bd69-48a2-aff8-caf365210f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:38.837629 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6f6ce-bd69-48a2-aff8-caf365210f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:38.837901 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6f6ce-bd69-48a2-aff8-caf365210f28 admin admin] PATH_INFO: `/v3/projects/66edadd0ebde4bcb963b0d446ec33920` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:38.839076 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6f6ce-bd69-48a2-aff8-caf365210f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66edadd0ebde4bcb963b0d446ec33920)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:38.843435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6f6ce-bd69-48a2-aff8-caf365210f28 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:38.889641 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-56a6f6ce-bd69-48a2-aff8-caf365210f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66edadd0ebde4bcb963b0d446ec33920', 'request_id': 'req-56a6f6ce-bd69-48a2-aff8-caf365210f28'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:38.895634 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-56a6f6ce-bd69-48a2-aff8-caf365210f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66edadd0ebde4bcb963b0d446ec33920', 'request_id': 'req-56a6f6ce-bd69-48a2-aff8-caf365210f28'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:38.904163 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-56a6f6ce-bd69-48a2-aff8-caf365210f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66edadd0ebde4bcb963b0d446ec33920', 'request_id': 'req-56a6f6ce-bd69-48a2-aff8-caf365210f28'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:38.914863 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-56a6f6ce-bd69-48a2-aff8-caf365210f28 admin admin] The token cache is being invalidate because project 66edadd0ebde4bcb963b0d446ec33920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:08:38.915149 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-56a6f6ce-bd69-48a2-aff8-caf365210f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:38.915800 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-56a6f6ce-bd69-48a2-aff8-caf365210f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:08:38.917433 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1247/2473] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:08:38 2022] DELETE /identity/v3/projects/66edadd0ebde4bcb963b0d446ec33920 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:08:46.333210 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45287a-c8d9-46de-8c75-abb9549b1385 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:08:46.334729 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6d45287a-c8d9-46de-8c75-abb9549b1385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:46.424649 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45287a-c8d9-46de-8c75-abb9549b1385 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:08:46.488447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72defca8-936d-4e06-adfb-003b31d95791 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8489647547d544a681131dad99e058bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:08:46.489162 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72defca8-936d-4e06-adfb-003b31d95791 service placement] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:46.489448 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72defca8-936d-4e06-adfb-003b31d95791 service placement] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:46.489727 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72defca8-936d-4e06-adfb-003b31d95791 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:46.491563 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-72defca8-936d-4e06-adfb-003b31d95791 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:46.503035 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72defca8-936d-4e06-adfb-003b31d95791 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:08:46.504631 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72defca8-936d-4e06-adfb-003b31d95791 service placement] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:08:46.514914 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1227/2474] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:08:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:08:57.085032 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e5b72-4c14-4b67-a088-3f43b7953cf5 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:08:57.085561 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e5b72-4c14-4b67-a088-3f43b7953cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:08:57.085561 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e5b72-4c14-4b67-a088-3f43b7953cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:08:57.103207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-523e5b72-4c14-4b67-a088-3f43b7953cf5 None None] MFA Rules not processed for user `fc9b5f276d17426fa2dca5dd1d35505e`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:08:57.104496 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-523e5b72-4c14-4b67-a088-3f43b7953cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:08:57.156163 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1248/2475] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:08:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:09:21.767349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e7d9f-f2a2-49d6-84c2-1deba53593fd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:09:21.767885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e7d9f-f2a2-49d6-84c2-1deba53593fd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:09:21.767885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e7d9f-f2a2-49d6-84c2-1deba53593fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:09:21.826232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-118e7d9f-f2a2-49d6-84c2-1deba53593fd None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:09:21.827556 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-118e7d9f-f2a2-49d6-84c2-1deba53593fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:09:21.896949 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1228/2476] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 27 05:09:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:09:21.941907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e5b72-4c14-4b67-a088-3f43b7953cf5 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:09:21.943331 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-523e5b72-4c14-4b67-a088-3f43b7953cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:09:22.037684 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e5b72-4c14-4b67-a088-3f43b7953cf5 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:09:22.043454 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452def4-47f8-42a5-a9d6-e112df2fa3a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:09:22.045421 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452def4-47f8-42a5-a9d6-e112df2fa3a1 service swift] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:09:22.045421 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452def4-47f8-42a5-a9d6-e112df2fa3a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:09:22.045421 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452def4-47f8-42a5-a9d6-e112df2fa3a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:09:22.053759 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452def4-47f8-42a5-a9d6-e112df2fa3a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:09:22.055610 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452def4-47f8-42a5-a9d6-e112df2fa3a1 service swift] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:09:22.064580 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1249/2477] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 05:09:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 05:09:28.719010 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e7d9f-f2a2-49d6-84c2-1deba53593fd None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:09:28.720699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-118e7d9f-f2a2-49d6-84c2-1deba53593fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:09:28.835924 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e7d9f-f2a2-49d6-84c2-1deba53593fd None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:09:28.841573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ca67e-2666-4765-b308-0f339d5a9bd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:09:28.842141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ca67e-2666-4765-b308-0f339d5a9bd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:09:28.843052 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ca67e-2666-4765-b308-0f339d5a9bd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:09:28.843052 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ca67e-2666-4765-b308-0f339d5a9bd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:09:28.845310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b20ca67e-2666-4765-b308-0f339d5a9bd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:09:28.951212 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ca67e-2666-4765-b308-0f339d5a9bd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:09:28.952933 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ca67e-2666-4765-b308-0f339d5a9bd7 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:09:28.970835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1229/2478] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:09:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:09:33.913178 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c790bf-6e7a-453c-aa69-5fb68aec4989 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:09:33.913726 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c790bf-6e7a-453c-aa69-5fb68aec4989 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:09:33.913726 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c790bf-6e7a-453c-aa69-5fb68aec4989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:09:33.932699 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-e3c790bf-6e7a-453c-aa69-5fb68aec4989 None None] MFA Rules not processed for user `6a6685057ae24345b4067cffb06b7f63`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:09:33.933965 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-e3c790bf-6e7a-453c-aa69-5fb68aec4989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:09:33.989037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1250/2479] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:09:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:09:39.808495 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a5175-35bc-40c6-b9df-ba0b5fd35381 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:09:39.809072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a5175-35bc-40c6-b9df-ba0b5fd35381 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:09:39.809072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a5175-35bc-40c6-b9df-ba0b5fd35381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:09:39.829328 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-da1a5175-35bc-40c6-b9df-ba0b5fd35381 None None] MFA Rules not processed for user `6ec6cd63c03c4ba29bc1eff1086f70fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:09:39.830551 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-da1a5175-35bc-40c6-b9df-ba0b5fd35381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:09:39.885310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1230/2480] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:09:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:09:41.376952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc85a80-1ee1-421c-a5e9-194f90143489 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:09:41.377513 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc85a80-1ee1-421c-a5e9-194f90143489 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:09:41.377513 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc85a80-1ee1-421c-a5e9-194f90143489 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:09:41.379416 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1251/2481] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 27 05:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:09:41.385959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e8e2b-056e-47ce-ad56-87b227f86635 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:09:41.386902 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e8e2b-056e-47ce-ad56-87b227f86635 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:09:41.387522 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e8e2b-056e-47ce-ad56-87b227f86635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:09:41.513851 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-912e8e2b-056e-47ce-ad56-87b227f86635 None None] MFA Rules not processed for user `faac84ed9d37420c811bbf6ac7df0b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:09:41.517653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-912e8e2b-056e-47ce-ad56-87b227f86635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:09:41.680095 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1231/2482] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 27 05:09:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:09:41.698170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc85a80-1ee1-421c-a5e9-194f90143489 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:09:41.700299 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9cc85a80-1ee1-421c-a5e9-194f90143489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:09:41.795299 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc85a80-1ee1-421c-a5e9-194f90143489 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:09:41.801001 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632d460-90d6-4bad-a72c-47fd1190149b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e04bf8c51c4d89bbb45e96223e7409', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:09:41.801824 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632d460-90d6-4bad-a72c-47fd1190149b service glance] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:09:41.802117 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632d460-90d6-4bad-a72c-47fd1190149b service glance] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:09:41.802393 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632d460-90d6-4bad-a72c-47fd1190149b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:09:41.814737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632d460-90d6-4bad-a72c-47fd1190149b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:09:41.816867 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632d460-90d6-4bad-a72c-47fd1190149b service glance] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:09:41.832761 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1252/2483] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:09:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:09:41.924248 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a2db4-5be8-428e-898a-3f116c2b07ec None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:09:41.924557 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a2db4-5be8-428e-898a-3f116c2b07ec None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:09:41.924942 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a2db4-5be8-428e-898a-3f116c2b07ec None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:09:41.927160 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1232/2484] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 27 05:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:09:41.933869 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49977df5-ca9c-44c9-939f-9d8a626d1185 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:09:41.934704 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49977df5-ca9c-44c9-939f-9d8a626d1185 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:09:41.935213 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49977df5-ca9c-44c9-939f-9d8a626d1185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:09:41.970185 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-49977df5-ca9c-44c9-939f-9d8a626d1185 None None] MFA Rules not processed for user `639126e5b13345cda6490073ec57f4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:09:41.978523 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-49977df5-ca9c-44c9-939f-9d8a626d1185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:09:42.000076 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1253/2485] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 27 05:09:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:09:42.014415 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a2db4-5be8-428e-898a-3f116c2b07ec None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:09:42.016898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7a0a2db4-5be8-428e-898a-3f116c2b07ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:09:42.045298 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a2db4-5be8-428e-898a-3f116c2b07ec None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:09:42.049076 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fdf8b-db28-4fb6-afe2-2b3f94783787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:09:42.050231 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fdf8b-db28-4fb6-afe2-2b3f94783787 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:09:42.050549 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fdf8b-db28-4fb6-afe2-2b3f94783787 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:09:42.050969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fdf8b-db28-4fb6-afe2-2b3f94783787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:09:42.062631 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fdf8b-db28-4fb6-afe2-2b3f94783787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:09:42.064661 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fdf8b-db28-4fb6-afe2-2b3f94783787 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:09:42.080338 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1233/2486] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:09:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:09:42.217509 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c66930-7cbd-4e72-be77-a87dc2103af5 None None] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:09:42.217918 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c66930-7cbd-4e72-be77-a87dc2103af5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:09:42.218268 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c66930-7cbd-4e72-be77-a87dc2103af5 None None] PATH_INFO: `/` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:09:42.220157 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1254/2487] 10.222.0.27 () {54 vars in 921 bytes} [Tue Sep 27 05:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 27 05:09:42.225695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fe495-e982-4149-a4dc-d139441ca713 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:09:42.226011 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fe495-e982-4149-a4dc-d139441ca713 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:09:42.226292 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fe495-e982-4149-a4dc-d139441ca713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:09:42.246371 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4d5fe495-e982-4149-a4dc-d139441ca713 None None] MFA Rules not processed for user `faac84ed9d37420c811bbf6ac7df0b35`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:09:42.247536 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4d5fe495-e982-4149-a4dc-d139441ca713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:09:42.257602 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1234/2488] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Sep 27 05:09:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:09:42.268875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c66930-7cbd-4e72-be77-a87dc2103af5 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:09:42.281580 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c66930-7cbd-4e72-be77-a87dc2103af5 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:09:42.285305 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c80227-cd71-4df0-bdb6-bbeea830fe25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:09:42.286109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c80227-cd71-4df0-bdb6-bbeea830fe25 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:09:42.286590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c80227-cd71-4df0-bdb6-bbeea830fe25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:09:42.286869 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c80227-cd71-4df0-bdb6-bbeea830fe25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:09:42.306063 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c80227-cd71-4df0-bdb6-bbeea830fe25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:09:42.307923 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c80227-cd71-4df0-bdb6-bbeea830fe25 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:09:42.320895 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1255/2489] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:09:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:09:45.106477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3168ca-ccec-4a20-8954-08c5b93bb8f5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:09:45.106944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3168ca-ccec-4a20-8954-08c5b93bb8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:09:45.107048 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3168ca-ccec-4a20-8954-08c5b93bb8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:09:45.125171 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4e3168ca-ccec-4a20-8954-08c5b93bb8f5 None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:09:45.126343 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4e3168ca-ccec-4a20-8954-08c5b93bb8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:09:45.133507 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1235/2490] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 27 05:09:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:09:45.145444 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c80227-cd71-4df0-bdb6-bbeea830fe25 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:09:45.156483 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c80227-cd71-4df0-bdb6-bbeea830fe25 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:09:45.161480 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d8631-2670-48cf-95d6-75c68f27a6fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:09:45.162102 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d8631-2670-48cf-95d6-75c68f27a6fd service swift] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:09:45.162382 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d8631-2670-48cf-95d6-75c68f27a6fd service swift] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:09:45.162655 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d8631-2670-48cf-95d6-75c68f27a6fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:09:45.171079 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d8631-2670-48cf-95d6-75c68f27a6fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:09:45.172660 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d8631-2670-48cf-95d6-75c68f27a6fd service swift] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:09:45.181108 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1256/2491] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 05:09:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 05:10:03.186082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dbc28-4f62-4e21-9d4d-6a4c23ab18b7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:10:03.186677 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dbc28-4f62-4e21-9d4d-6a4c23ab18b7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:10:03.186677 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dbc28-4f62-4e21-9d4d-6a4c23ab18b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:10:03.204783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-182dbc28-4f62-4e21-9d4d-6a4c23ab18b7 None None] MFA Rules not processed for user `43aeedbf8ef94c969eba750306890f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:10:03.206000 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-182dbc28-4f62-4e21-9d4d-6a4c23ab18b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:10:03.260831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1236/2492] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:10:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:10:08.814217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae5635-5834-41b2-b9ea-541a9c0f77e2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:10:08.814740 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae5635-5834-41b2-b9ea-541a9c0f77e2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:10:08.814844 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae5635-5834-41b2-b9ea-541a9c0f77e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:10:08.832334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0dae5635-5834-41b2-b9ea-541a9c0f77e2 None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:10:08.833583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0dae5635-5834-41b2-b9ea-541a9c0f77e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:10:08.840722 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1257/2493] 10.222.0.27 () {58 vars in 967 bytes} [Tue Sep 27 05:10:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:10:08.852587 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dbc28-4f62-4e21-9d4d-6a4c23ab18b7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:10:08.864709 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dbc28-4f62-4e21-9d4d-6a4c23ab18b7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:10:08.869602 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa8de7-2451-46b1-9d7a-bff7e9e4a155 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:10:08.871783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8de7-2451-46b1-9d7a-bff7e9e4a155 service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:10:08.872061 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8de7-2451-46b1-9d7a-bff7e9e4a155 service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:10:08.872332 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa8de7-2451-46b1-9d7a-bff7e9e4a155 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:10:08.880208 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa8de7-2451-46b1-9d7a-bff7e9e4a155 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:10:08.881820 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa8de7-2451-46b1-9d7a-bff7e9e4a155 service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:10:08.890116 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1237/2494] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 05:10:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 05:10:45.200945 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae5635-5834-41b2-b9ea-541a9c0f77e2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:10:45.202508 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0dae5635-5834-41b2-b9ea-541a9c0f77e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:10:45.267297 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae5635-5834-41b2-b9ea-541a9c0f77e2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:10:45.271824 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060047-0b4e-481d-bb30-0839dc44dc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:10:45.272689 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060047-0b4e-481d-bb30-0839dc44dc39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:10:45.272996 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060047-0b4e-481d-bb30-0839dc44dc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:10:45.273269 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1060047-0b4e-481d-bb30-0839dc44dc39 admin admin] PATH_INFO: `/v3/users/6ec6cd63c03c4ba29bc1eff1086f70fd` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:10:45.274467 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1060047-0b4e-481d-bb30-0839dc44dc39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec6cd63c03c4ba29bc1eff1086f70fd)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:10:45.276412 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1060047-0b4e-481d-bb30-0839dc44dc39 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:10:45.321871 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f1060047-0b4e-481d-bb30-0839dc44dc39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec6cd63c03c4ba29bc1eff1086f70fd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:10:45.322516 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f1060047-0b4e-481d-bb30-0839dc44dc39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec6cd63c03c4ba29bc1eff1086f70fd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:10:45.323143 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f1060047-0b4e-481d-bb30-0839dc44dc39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec6cd63c03c4ba29bc1eff1086f70fd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:10:45.330009 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f1060047-0b4e-481d-bb30-0839dc44dc39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec6cd63c03c4ba29bc1eff1086f70fd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:10:45.342255 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-f1060047-0b4e-481d-bb30-0839dc44dc39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec6cd63c03c4ba29bc1eff1086f70fd'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:10:45.364467 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1258/2495] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:10:45 2022] DELETE /identity/v3/users/6ec6cd63c03c4ba29bc1eff1086f70fd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:10:45.533781 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa8de7-2451-46b1-9d7a-bff7e9e4a155 service swift] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:10:45.545323 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa8de7-2451-46b1-9d7a-bff7e9e4a155 service swift] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:10:45.600639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f883c1-9922-40f6-bedf-5ea17de88407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:10:45.601518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f883c1-9922-40f6-bedf-5ea17de88407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:10:45.601796 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f883c1-9922-40f6-bedf-5ea17de88407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:10:45.602070 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f883c1-9922-40f6-bedf-5ea17de88407 admin admin] PATH_INFO: `/v3/projects/26e17082ae5342d29732e14c7d59f44c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:10:45.603249 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f883c1-9922-40f6-bedf-5ea17de88407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26e17082ae5342d29732e14c7d59f44c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:10:45.605211 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f883c1-9922-40f6-bedf-5ea17de88407 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:10:45.650097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-07f883c1-9922-40f6-bedf-5ea17de88407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e17082ae5342d29732e14c7d59f44c', 'request_id': 'req-07f883c1-9922-40f6-bedf-5ea17de88407'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:10:45.657413 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-07f883c1-9922-40f6-bedf-5ea17de88407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e17082ae5342d29732e14c7d59f44c', 'request_id': 'req-07f883c1-9922-40f6-bedf-5ea17de88407'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:10:45.663345 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-07f883c1-9922-40f6-bedf-5ea17de88407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e17082ae5342d29732e14c7d59f44c', 'request_id': 'req-07f883c1-9922-40f6-bedf-5ea17de88407'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:10:45.673568 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-07f883c1-9922-40f6-bedf-5ea17de88407 admin admin] The token cache is being invalidate because project 26e17082ae5342d29732e14c7d59f44c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:10:45.673843 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-07f883c1-9922-40f6-bedf-5ea17de88407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:10:45.674479 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-07f883c1-9922-40f6-bedf-5ea17de88407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:10:45.675987 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1238/2496] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:10:45 2022] DELETE /identity/v3/projects/26e17082ae5342d29732e14c7d59f44c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:10:52.736107 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060047-0b4e-481d-bb30-0839dc44dc39 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:10:52.737599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f1060047-0b4e-481d-bb30-0839dc44dc39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:10:52.802571 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1060047-0b4e-481d-bb30-0839dc44dc39 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:10:52.860906 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752b8a1-486c-4868-8df2-878c388915c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:10:52.861776 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752b8a1-486c-4868-8df2-878c388915c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:10:52.862058 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752b8a1-486c-4868-8df2-878c388915c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:10:52.862333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752b8a1-486c-4868-8df2-878c388915c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:10:52.864677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9752b8a1-486c-4868-8df2-878c388915c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:10:52.995939 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752b8a1-486c-4868-8df2-878c388915c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:10:52.997586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752b8a1-486c-4868-8df2-878c388915c2 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:10:53.023438 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1259/2497] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:10:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:10:54.397164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef8668-e17f-4945-adf6-5631b782d2b0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:10:54.397663 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef8668-e17f-4945-adf6-5631b782d2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:10:54.397762 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef8668-e17f-4945-adf6-5631b782d2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:10:54.415559 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b3ef8668-e17f-4945-adf6-5631b782d2b0 None None] MFA Rules not processed for user `e5cb068154f04e93b2a301d46164d001`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:10:54.416774 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b3ef8668-e17f-4945-adf6-5631b782d2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:10:54.473526 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1239/2498] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:10:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:10:54.508073 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752b8a1-486c-4868-8df2-878c388915c2 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:10:54.509545 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9752b8a1-486c-4868-8df2-878c388915c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:10:54.565554 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752b8a1-486c-4868-8df2-878c388915c2 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:10:54.569219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ea924-dde1-435c-8fbc-1a3c4094015b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e04bf8c51c4d89bbb45e96223e7409', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:10:54.569865 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ea924-dde1-435c-8fbc-1a3c4094015b service glance] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:10:54.570144 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ea924-dde1-435c-8fbc-1a3c4094015b service glance] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:10:54.570415 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ea924-dde1-435c-8fbc-1a3c4094015b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:10:54.572143 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8d4ea924-dde1-435c-8fbc-1a3c4094015b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:10:54.586140 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ea924-dde1-435c-8fbc-1a3c4094015b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:10:54.587651 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ea924-dde1-435c-8fbc-1a3c4094015b service glance] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:10:54.599370 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1260/2499] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:10:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:10:56.124357 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aecb97-b148-47f5-b09f-b01640a6a93c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:10:56.125237 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aecb97-b148-47f5-b09f-b01640a6a93c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:10:56.125733 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aecb97-b148-47f5-b09f-b01640a6a93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:10:56.145509 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-11aecb97-b148-47f5-b09f-b01640a6a93c None None] MFA Rules not processed for user `6a6685057ae24345b4067cffb06b7f63`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:10:56.146810 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-11aecb97-b148-47f5-b09f-b01640a6a93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:10:56.207248 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1240/2500] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:10:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:03.849457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ea924-dde1-435c-8fbc-1a3c4094015b service glance] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:03.850858 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8d4ea924-dde1-435c-8fbc-1a3c4094015b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:03.925957 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ea924-dde1-435c-8fbc-1a3c4094015b service glance] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:03.929498 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2cc9e-6fd3-47f2-8bb7-ba5079889b8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:03.930158 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2cc9e-6fd3-47f2-8bb7-ba5079889b8d service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:03.930437 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2cc9e-6fd3-47f2-8bb7-ba5079889b8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:03.930709 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2cc9e-6fd3-47f2-8bb7-ba5079889b8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:03.932463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-94e2cc9e-6fd3-47f2-8bb7-ba5079889b8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:03.988991 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2cc9e-6fd3-47f2-8bb7-ba5079889b8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:03.990463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2cc9e-6fd3-47f2-8bb7-ba5079889b8d service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:04.000429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1261/2501] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:14.007227 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aecb97-b148-47f5-b09f-b01640a6a93c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:14.008638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-11aecb97-b148-47f5-b09f-b01640a6a93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:14.020682 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aecb97-b148-47f5-b09f-b01640a6a93c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:14.024201 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f2fe6-7e8f-4540-9745-ed589f345d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:14.024868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f2fe6-7e8f-4540-9745-ed589f345d05 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:14.025157 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f2fe6-7e8f-4540-9745-ed589f345d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:14.025437 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f2fe6-7e8f-4540-9745-ed589f345d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:14.027193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-080f2fe6-7e8f-4540-9745-ed589f345d05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:14.219570 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f2fe6-7e8f-4540-9745-ed589f345d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:14.221053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f2fe6-7e8f-4540-9745-ed589f345d05 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:14.231042 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1241/2502] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:17.444570 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2cc9e-6fd3-47f2-8bb7-ba5079889b8d service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:17.446092 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-94e2cc9e-6fd3-47f2-8bb7-ba5079889b8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:17.535102 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2cc9e-6fd3-47f2-8bb7-ba5079889b8d service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:17.535219 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f2fe6-7e8f-4540-9745-ed589f345d05 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:17.536560 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-080f2fe6-7e8f-4540-9745-ed589f345d05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:17.540365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094d6dc-6edf-4454-a7f6-b702998b1dd2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8489647547d544a681131dad99e058bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:17.541061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094d6dc-6edf-4454-a7f6-b702998b1dd2 service placement] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:17.541349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094d6dc-6edf-4454-a7f6-b702998b1dd2 service placement] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:17.541646 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094d6dc-6edf-4454-a7f6-b702998b1dd2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:17.545456 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a094d6dc-6edf-4454-a7f6-b702998b1dd2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:17.550145 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f2fe6-7e8f-4540-9745-ed589f345d05 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:17.554995 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3d35d-2f4f-45a1-aded-6a09251ece69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:17.555920 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3d35d-2f4f-45a1-aded-6a09251ece69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:17.556251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3d35d-2f4f-45a1-aded-6a09251ece69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:17.556589 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3d35d-2f4f-45a1-aded-6a09251ece69 admin admin] PATH_INFO: `/v3/users/43aeedbf8ef94c969eba750306890f57` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:17.557793 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094d6dc-6edf-4454-a7f6-b702998b1dd2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:17.557908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3d35d-2f4f-45a1-aded-6a09251ece69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43aeedbf8ef94c969eba750306890f57)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:17.560006 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094d6dc-6edf-4454-a7f6-b702998b1dd2 service placement] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:17.560577 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3d35d-2f4f-45a1-aded-6a09251ece69 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:17.573154 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1262/2503] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:17.610377 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-aff3d35d-2f4f-45a1-aded-6a09251ece69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43aeedbf8ef94c969eba750306890f57'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:17.611017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-aff3d35d-2f4f-45a1-aded-6a09251ece69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43aeedbf8ef94c969eba750306890f57'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:17.611605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-aff3d35d-2f4f-45a1-aded-6a09251ece69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43aeedbf8ef94c969eba750306890f57'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:17.618254 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-aff3d35d-2f4f-45a1-aded-6a09251ece69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43aeedbf8ef94c969eba750306890f57'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:17.630090 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-aff3d35d-2f4f-45a1-aded-6a09251ece69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43aeedbf8ef94c969eba750306890f57'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:17.642908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1242/2504] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:11:17 2022] DELETE /identity/v3/users/43aeedbf8ef94c969eba750306890f57 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:11:17.812329 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094d6dc-6edf-4454-a7f6-b702998b1dd2 service placement] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:17.824841 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094d6dc-6edf-4454-a7f6-b702998b1dd2 service placement] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:17.889701 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5655270-e00d-4b85-b6fd-dfe9b93f7796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:17.890547 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655270-e00d-4b85-b6fd-dfe9b93f7796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:17.890856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655270-e00d-4b85-b6fd-dfe9b93f7796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:17.891125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655270-e00d-4b85-b6fd-dfe9b93f7796 admin admin] PATH_INFO: `/v3/projects/97fc6113b9d248e0b081f9812381b453` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:17.892353 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5655270-e00d-4b85-b6fd-dfe9b93f7796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97fc6113b9d248e0b081f9812381b453)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:17.894357 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5655270-e00d-4b85-b6fd-dfe9b93f7796 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:17.939888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d5655270-e00d-4b85-b6fd-dfe9b93f7796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97fc6113b9d248e0b081f9812381b453', 'request_id': 'req-d5655270-e00d-4b85-b6fd-dfe9b93f7796'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:17.945901 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d5655270-e00d-4b85-b6fd-dfe9b93f7796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97fc6113b9d248e0b081f9812381b453', 'request_id': 'req-d5655270-e00d-4b85-b6fd-dfe9b93f7796'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:17.952905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d5655270-e00d-4b85-b6fd-dfe9b93f7796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97fc6113b9d248e0b081f9812381b453', 'request_id': 'req-d5655270-e00d-4b85-b6fd-dfe9b93f7796'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:17.962783 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d5655270-e00d-4b85-b6fd-dfe9b93f7796 admin admin] The token cache is being invalidate because project 97fc6113b9d248e0b081f9812381b453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:11:17.963069 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d5655270-e00d-4b85-b6fd-dfe9b93f7796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:17.963707 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d5655270-e00d-4b85-b6fd-dfe9b93f7796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:17.965285 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1263/2505] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:11:17 2022] DELETE /identity/v3/projects/97fc6113b9d248e0b081f9812381b453 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:11:17.970199 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee6c2f-51b8-4780-9c48-ea854f62fea0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:17.970488 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee6c2f-51b8-4780-9c48-ea854f62fea0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:17.970762 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee6c2f-51b8-4780-9c48-ea854f62fea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:17.999564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d0ee6c2f-51b8-4780-9c48-ea854f62fea0 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:18.000746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d0ee6c2f-51b8-4780-9c48-ea854f62fea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:18.059056 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1243/2506] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:18.066615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7d11-a84e-4c5e-9ef8-0310018e29bc None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:18.066910 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7d11-a84e-4c5e-9ef8-0310018e29bc None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:18.067189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7d11-a84e-4c5e-9ef8-0310018e29bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:18.085349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-324f7d11-a84e-4c5e-9ef8-0310018e29bc None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:18.086583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-324f7d11-a84e-4c5e-9ef8-0310018e29bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:18.095125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1264/2507] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:18.099412 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee6c2f-51b8-4780-9c48-ea854f62fea0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:18.109317 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee6c2f-51b8-4780-9c48-ea854f62fea0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:18.113782 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c1d1d-fcf3-4b17-b208-21cf7170ea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:18.114425 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c1d1d-fcf3-4b17-b208-21cf7170ea88 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:18.114703 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c1d1d-fcf3-4b17-b208-21cf7170ea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:18.114975 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c1d1d-fcf3-4b17-b208-21cf7170ea88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:18.115690 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c1d1d-fcf3-4b17-b208-21cf7170ea88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:11:18.115996 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c1d1d-fcf3-4b17-b208-21cf7170ea88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:18.117624 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c1d1d-fcf3-4b17-b208-21cf7170ea88 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:18.129939 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1244/2508] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:11:18.134034 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f7d11-a84e-4c5e-9ef8-0310018e29bc None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:18.143397 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f7d11-a84e-4c5e-9ef8-0310018e29bc None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:18.148127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeaab84-56f4-4aa3-b60c-ca105f0a4a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:18.148810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaab84-56f4-4aa3-b60c-ca105f0a4a4b admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:18.149076 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaab84-56f4-4aa3-b60c-ca105f0a4a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:18.149360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeaab84-56f4-4aa3-b60c-ca105f0a4a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:18.150029 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeaab84-56f4-4aa3-b60c-ca105f0a4a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:18.151935 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeaab84-56f4-4aa3-b60c-ca105f0a4a4b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:18.177484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1265/2509] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:11:18 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:11:18.181537 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c1d1d-fcf3-4b17-b208-21cf7170ea88 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:18.191422 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c1d1d-fcf3-4b17-b208-21cf7170ea88 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:18.245545 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f61d2-6db9-461d-bffb-d1d4d47f0af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:18.246328 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f61d2-6db9-461d-bffb-d1d4d47f0af5 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:18.246611 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f61d2-6db9-461d-bffb-d1d4d47f0af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:18.246889 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f61d2-6db9-461d-bffb-d1d4d47f0af5 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:18.247570 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f61d2-6db9-461d-bffb-d1d4d47f0af5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:18.249583 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f61d2-6db9-461d-bffb-d1d4d47f0af5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:18.269423 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1245/2510] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:11:18 2022] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:11:18.273494 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeaab84-56f4-4aa3-b60c-ca105f0a4a4b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:18.283951 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeaab84-56f4-4aa3-b60c-ca105f0a4a4b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:18.288501 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb3709-26c9-4d2b-b46a-1ba0eff0da70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:18.289208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb3709-26c9-4d2b-b46a-1ba0eff0da70 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:18.289489 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb3709-26c9-4d2b-b46a-1ba0eff0da70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:18.289768 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb3709-26c9-4d2b-b46a-1ba0eff0da70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:18.290490 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb3709-26c9-4d2b-b46a-1ba0eff0da70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:18.292090 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb3709-26c9-4d2b-b46a-1ba0eff0da70 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:18.302934 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1266/2511] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:18.308031 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f61d2-6db9-461d-bffb-d1d4d47f0af5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:18.317949 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f61d2-6db9-461d-bffb-d1d4d47f0af5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:18.322838 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f1b22-b3c1-48d0-a90e-1b2b52f35da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:18.323483 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f1b22-b3c1-48d0-a90e-1b2b52f35da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:18.323764 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f1b22-b3c1-48d0-a90e-1b2b52f35da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:18.324107 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f1b22-b3c1-48d0-a90e-1b2b52f35da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:18.324880 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f1b22-b3c1-48d0-a90e-1b2b52f35da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:18.326472 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f1b22-b3c1-48d0-a90e-1b2b52f35da3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:18.336743 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1246/2512] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:11:18.341620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb3709-26c9-4d2b-b46a-1ba0eff0da70 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:18.351311 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb3709-26c9-4d2b-b46a-1ba0eff0da70 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:18.356726 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941f933-2093-4315-adf8-2042886028e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:18.357624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941f933-2093-4315-adf8-2042886028e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:18.357900 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941f933-2093-4315-adf8-2042886028e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:18.358167 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941f933-2093-4315-adf8-2042886028e5 admin admin] PATH_INFO: `/v3/projects/07e0429dd32c4156b41b9fc7932a8497/users/28069bdfbca6438dbebfc192899fe638/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:18.372512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941f933-2093-4315-adf8-2042886028e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07e0429dd32c4156b41b9fc7932a8497, user_id=28069bdfbca6438dbebfc192899fe638, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:18.375251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941f933-2093-4315-adf8-2042886028e5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:18.388357 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1267/2513] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:11:18 2022] PUT /identity/v3/projects/07e0429dd32c4156b41b9fc7932a8497/users/28069bdfbca6438dbebfc192899fe638/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:18.398872 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa611e-b54f-4fc7-af7c-24bae6634d85 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:18.399163 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa611e-b54f-4fc7-af7c-24bae6634d85 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:18.399479 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa611e-b54f-4fc7-af7c-24bae6634d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:18.425763 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-60fa611e-b54f-4fc7-af7c-24bae6634d85 None None] MFA Rules not processed for user `28069bdfbca6438dbebfc192899fe638`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:18.426945 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-60fa611e-b54f-4fc7-af7c-24bae6634d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:18.489179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1247/2514] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:18.493777 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941f933-2093-4315-adf8-2042886028e5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:18.554667 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941f933-2093-4315-adf8-2042886028e5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:18.559534 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3580d36-1bdc-432e-b760-30df7cad5441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:18.560179 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580d36-1bdc-432e-b760-30df7cad5441 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:18.560461 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580d36-1bdc-432e-b760-30df7cad5441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:18.560738 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580d36-1bdc-432e-b760-30df7cad5441 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:18.561456 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3580d36-1bdc-432e-b760-30df7cad5441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:18.563357 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3580d36-1bdc-432e-b760-30df7cad5441 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:18.588784 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1268/2515] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:11:18 2022] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:11:18.593610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa611e-b54f-4fc7-af7c-24bae6634d85 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:18.603723 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa611e-b54f-4fc7-af7c-24bae6634d85 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:18.658390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715fb6b-5a5e-4898-8885-3011a7309cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:18.659040 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715fb6b-5a5e-4898-8885-3011a7309cdc admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:18.659318 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715fb6b-5a5e-4898-8885-3011a7309cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:18.659589 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715fb6b-5a5e-4898-8885-3011a7309cdc admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:18.660278 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715fb6b-5a5e-4898-8885-3011a7309cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:18.662205 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715fb6b-5a5e-4898-8885-3011a7309cdc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:18.682286 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1248/2516] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:11:18 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:11:18.686669 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3580d36-1bdc-432e-b760-30df7cad5441 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:18.696549 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3580d36-1bdc-432e-b760-30df7cad5441 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:18.701974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5da70-829a-4cc4-b156-7499febd0cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:18.702613 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5da70-829a-4cc4-b156-7499febd0cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:18.702889 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5da70-829a-4cc4-b156-7499febd0cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:18.703160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5da70-829a-4cc4-b156-7499febd0cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:18.703872 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5da70-829a-4cc4-b156-7499febd0cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:18.705499 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5da70-829a-4cc4-b156-7499febd0cb4 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:18.715868 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1269/2517] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:18.719881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715fb6b-5a5e-4898-8885-3011a7309cdc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:18.729603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715fb6b-5a5e-4898-8885-3011a7309cdc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:18.734693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbceaa-e700-48ff-b230-29ae9290c46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:18.735620 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbceaa-e700-48ff-b230-29ae9290c46e admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:18.735917 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbceaa-e700-48ff-b230-29ae9290c46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:18.736195 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbceaa-e700-48ff-b230-29ae9290c46e admin admin] PATH_INFO: `/v3/projects/719b13a5c2b640c4ab846c007eb535a5/users/c7861c8152ce46d08075eb9ea80d789e/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:18.751645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbceaa-e700-48ff-b230-29ae9290c46e admin admin] RBAC: Authorizing `identity:create_grant(project_id=719b13a5c2b640c4ab846c007eb535a5, user_id=c7861c8152ce46d08075eb9ea80d789e, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:18.754329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbceaa-e700-48ff-b230-29ae9290c46e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:18.767706 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1249/2518] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:11:18 2022] PUT /identity/v3/projects/719b13a5c2b640c4ab846c007eb535a5/users/c7861c8152ce46d08075eb9ea80d789e/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:18.771794 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5da70-829a-4cc4-b156-7499febd0cb4 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:18.781877 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5da70-829a-4cc4-b156-7499febd0cb4 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:18.841311 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fa6b1-9d46-46a9-bbcf-9319e44d82c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:18.841889 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fa6b1-9d46-46a9-bbcf-9319e44d82c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:18.842165 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fa6b1-9d46-46a9-bbcf-9319e44d82c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:18.842435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fa6b1-9d46-46a9-bbcf-9319e44d82c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:18.843143 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fa6b1-9d46-46a9-bbcf-9319e44d82c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:18.844721 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fa6b1-9d46-46a9-bbcf-9319e44d82c0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:18.854272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1270/2519] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:18.858505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbceaa-e700-48ff-b230-29ae9290c46e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:18.868542 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbceaa-e700-48ff-b230-29ae9290c46e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:18.873970 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c865fd-be5e-4930-bbfd-c7085b3a5481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:18.874842 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c865fd-be5e-4930-bbfd-c7085b3a5481 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:18.875119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c865fd-be5e-4930-bbfd-c7085b3a5481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:18.875392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c865fd-be5e-4930-bbfd-c7085b3a5481 admin admin] PATH_INFO: `/v3/projects/719b13a5c2b640c4ab846c007eb535a5/users/c7861c8152ce46d08075eb9ea80d789e/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:18.877364 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c865fd-be5e-4930-bbfd-c7085b3a5481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=719b13a5c2b640c4ab846c007eb535a5, user_id=c7861c8152ce46d08075eb9ea80d789e, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:18.880007 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c865fd-be5e-4930-bbfd-c7085b3a5481 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:18.891617 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1250/2520] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:11:18 2022] PUT /identity/v3/projects/719b13a5c2b640c4ab846c007eb535a5/users/c7861c8152ce46d08075eb9ea80d789e/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:11:18.903002 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c27e2a-0f46-4f08-a920-2e6908185a01 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:18.903283 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c27e2a-0f46-4f08-a920-2e6908185a01 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:18.903560 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c27e2a-0f46-4f08-a920-2e6908185a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:18.930162 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-84c27e2a-0f46-4f08-a920-2e6908185a01 None None] MFA Rules not processed for user `c7861c8152ce46d08075eb9ea80d789e`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:18.931340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-84c27e2a-0f46-4f08-a920-2e6908185a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:18.997512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1271/2521] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:18 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:19.008415 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c865fd-be5e-4930-bbfd-c7085b3a5481 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:19.010108 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-69c865fd-be5e-4930-bbfd-c7085b3a5481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:19.072046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c865fd-be5e-4930-bbfd-c7085b3a5481 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:19.076989 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3359f2f-b470-414c-bd79-28366d9fe9dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:19.077625 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3359f2f-b470-414c-bd79-28366d9fe9dd service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:19.077895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3359f2f-b470-414c-bd79-28366d9fe9dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:19.078166 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3359f2f-b470-414c-bd79-28366d9fe9dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:19.086985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3359f2f-b470-414c-bd79-28366d9fe9dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:19.088389 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3359f2f-b470-414c-bd79-28366d9fe9dd service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:19.097597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1251/2522] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:19 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:19.173417 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c27e2a-0f46-4f08-a920-2e6908185a01 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:19.183055 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c27e2a-0f46-4f08-a920-2e6908185a01 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:19.186920 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392a062-9673-4513-bcc4-8f320ed5261b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:19.188089 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392a062-9673-4513-bcc4-8f320ed5261b service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:19.188369 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392a062-9673-4513-bcc4-8f320ed5261b service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:19.188642 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392a062-9673-4513-bcc4-8f320ed5261b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:19.244076 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392a062-9673-4513-bcc4-8f320ed5261b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:19.245558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392a062-9673-4513-bcc4-8f320ed5261b service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:19.254870 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1272/2523] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:28.365351 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3359f2f-b470-414c-bd79-28366d9fe9dd service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:28.425876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3359f2f-b470-414c-bd79-28366d9fe9dd service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:28.430427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e2169-0fef-4110-8a39-21359b194af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:28.431278 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e2169-0fef-4110-8a39-21359b194af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:28.431551 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e2169-0fef-4110-8a39-21359b194af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:28.431818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e2169-0fef-4110-8a39-21359b194af8 admin admin] PATH_INFO: `/v3/users/28069bdfbca6438dbebfc192899fe638` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:28.433008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e2169-0fef-4110-8a39-21359b194af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28069bdfbca6438dbebfc192899fe638)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:28.435978 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e2169-0fef-4110-8a39-21359b194af8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:28.483983 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9a4e2169-0fef-4110-8a39-21359b194af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28069bdfbca6438dbebfc192899fe638'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:28.484546 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9a4e2169-0fef-4110-8a39-21359b194af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28069bdfbca6438dbebfc192899fe638'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:28.485163 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9a4e2169-0fef-4110-8a39-21359b194af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28069bdfbca6438dbebfc192899fe638'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:28.491908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9a4e2169-0fef-4110-8a39-21359b194af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28069bdfbca6438dbebfc192899fe638'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:28.503233 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9a4e2169-0fef-4110-8a39-21359b194af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28069bdfbca6438dbebfc192899fe638'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:28.515279 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1252/2524] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:11:28 2022] DELETE /identity/v3/users/28069bdfbca6438dbebfc192899fe638 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:28.519846 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91bbfe-dffa-407f-a7a7-844253e94953 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:28.520334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91bbfe-dffa-407f-a7a7-844253e94953 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:28.520437 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91bbfe-dffa-407f-a7a7-844253e94953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:28.537781 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-df91bbfe-dffa-407f-a7a7-844253e94953 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:28.539027 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-df91bbfe-dffa-407f-a7a7-844253e94953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:28.596184 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1273/2525] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:28.605772 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e2169-0fef-4110-8a39-21359b194af8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:28.607819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9a4e2169-0fef-4110-8a39-21359b194af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:28.663300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e2169-0fef-4110-8a39-21359b194af8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:28.666891 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522e672-68b1-46d6-babd-59b3fc4e28f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:28.667527 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e672-68b1-46d6-babd-59b3fc4e28f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:28.667806 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e672-68b1-46d6-babd-59b3fc4e28f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:28.668081 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522e672-68b1-46d6-babd-59b3fc4e28f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:28.677445 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522e672-68b1-46d6-babd-59b3fc4e28f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:28.678874 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522e672-68b1-46d6-babd-59b3fc4e28f4 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:28.688104 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1253/2526] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:28.942868 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91bbfe-dffa-407f-a7a7-844253e94953 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:28.944340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-df91bbfe-dffa-407f-a7a7-844253e94953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:28.956582 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91bbfe-dffa-407f-a7a7-844253e94953 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:28.961897 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:28.962771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:28.963054 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:28.963330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e admin admin] PATH_INFO: `/v3/projects/07e0429dd32c4156b41b9fc7932a8497` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:28.964646 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e admin admin] RBAC: Authorizing `identity:delete_project(project_id=07e0429dd32c4156b41b9fc7932a8497)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:28.968432 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:29.017296 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07e0429dd32c4156b41b9fc7932a8497', 'request_id': 'req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:29.023277 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07e0429dd32c4156b41b9fc7932a8497', 'request_id': 'req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:29.031854 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07e0429dd32c4156b41b9fc7932a8497', 'request_id': 'req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:29.042177 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e admin admin] The token cache is being invalidate because project 07e0429dd32c4156b41b9fc7932a8497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:11:29.042462 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:29.043071 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:29.044811 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1274/2527] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:11:28 2022] DELETE /identity/v3/projects/07e0429dd32c4156b41b9fc7932a8497 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:29.048783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522e672-68b1-46d6-babd-59b3fc4e28f4 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:29.058304 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522e672-68b1-46d6-babd-59b3fc4e28f4 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:29.116466 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a63d0-df72-4209-aea2-e23d4fb57f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:29.117374 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a63d0-df72-4209-aea2-e23d4fb57f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:29.117653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a63d0-df72-4209-aea2-e23d4fb57f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:29.117921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a63d0-df72-4209-aea2-e23d4fb57f46 admin admin] PATH_INFO: `/v3/users/c7861c8152ce46d08075eb9ea80d789e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:29.119099 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a63d0-df72-4209-aea2-e23d4fb57f46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7861c8152ce46d08075eb9ea80d789e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:29.121034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a63d0-df72-4209-aea2-e23d4fb57f46 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:29.168364 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-969a63d0-df72-4209-aea2-e23d4fb57f46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7861c8152ce46d08075eb9ea80d789e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:29.169075 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-969a63d0-df72-4209-aea2-e23d4fb57f46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7861c8152ce46d08075eb9ea80d789e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:29.169696 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-969a63d0-df72-4209-aea2-e23d4fb57f46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7861c8152ce46d08075eb9ea80d789e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:29.176759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-969a63d0-df72-4209-aea2-e23d4fb57f46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7861c8152ce46d08075eb9ea80d789e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:29.187898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-969a63d0-df72-4209-aea2-e23d4fb57f46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7861c8152ce46d08075eb9ea80d789e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:29.202086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1254/2528] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:11:29 2022] DELETE /identity/v3/users/c7861c8152ce46d08075eb9ea80d789e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:29.463841 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:29.465952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:29.483742 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0c9f1-9e1a-4f21-97ff-1438ce53037e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:29.538975 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41fdf6-3369-436e-9660-720c35b77200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:29.539837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41fdf6-3369-436e-9660-720c35b77200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:29.540118 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41fdf6-3369-436e-9660-720c35b77200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:29.540395 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41fdf6-3369-436e-9660-720c35b77200 admin admin] PATH_INFO: `/v3/projects/719b13a5c2b640c4ab846c007eb535a5` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:29.541606 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41fdf6-3369-436e-9660-720c35b77200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=719b13a5c2b640c4ab846c007eb535a5)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:29.544249 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41fdf6-3369-436e-9660-720c35b77200 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:29.588102 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6d41fdf6-3369-436e-9660-720c35b77200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719b13a5c2b640c4ab846c007eb535a5', 'request_id': 'req-6d41fdf6-3369-436e-9660-720c35b77200'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:29.594792 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6d41fdf6-3369-436e-9660-720c35b77200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719b13a5c2b640c4ab846c007eb535a5', 'request_id': 'req-6d41fdf6-3369-436e-9660-720c35b77200'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:29.601875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6d41fdf6-3369-436e-9660-720c35b77200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719b13a5c2b640c4ab846c007eb535a5', 'request_id': 'req-6d41fdf6-3369-436e-9660-720c35b77200'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:29.612972 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6d41fdf6-3369-436e-9660-720c35b77200 admin admin] The token cache is being invalidate because project 719b13a5c2b640c4ab846c007eb535a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:11:29.613250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6d41fdf6-3369-436e-9660-720c35b77200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:29.613853 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6d41fdf6-3369-436e-9660-720c35b77200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:29.615578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1275/2529] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:11:29 2022] DELETE /identity/v3/projects/719b13a5c2b640c4ab846c007eb535a5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:29.621447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17d85-5145-4e45-8404-606a017031f4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:29.622065 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17d85-5145-4e45-8404-606a017031f4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:29.622166 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17d85-5145-4e45-8404-606a017031f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:29.641318 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a2b17d85-5145-4e45-8404-606a017031f4 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:29.642505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a2b17d85-5145-4e45-8404-606a017031f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:29.703753 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1255/2530] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:11:29.711640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd3bca-fe65-4ee5-b123-110dca67d497 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:29.712010 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd3bca-fe65-4ee5-b123-110dca67d497 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:29.712334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd3bca-fe65-4ee5-b123-110dca67d497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:29.730471 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f4bd3bca-fe65-4ee5-b123-110dca67d497 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:29.732293 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f4bd3bca-fe65-4ee5-b123-110dca67d497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:29.739964 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1276/2531] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:29.744036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b17d85-5145-4e45-8404-606a017031f4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:29.754660 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b17d85-5145-4e45-8404-606a017031f4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:29.759151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cb1dc-a32c-4b4f-86b8-4a5f97f9cd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:29.759793 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cb1dc-a32c-4b4f-86b8-4a5f97f9cd27 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:29.760069 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cb1dc-a32c-4b4f-86b8-4a5f97f9cd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:29.760336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cb1dc-a32c-4b4f-86b8-4a5f97f9cd27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:29.761098 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cb1dc-a32c-4b4f-86b8-4a5f97f9cd27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:11:29.761422 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cb1dc-a32c-4b4f-86b8-4a5f97f9cd27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:29.763220 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cb1dc-a32c-4b4f-86b8-4a5f97f9cd27 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:29.774824 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1256/2532] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 05:11:29.779469 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd3bca-fe65-4ee5-b123-110dca67d497 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:29.788474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd3bca-fe65-4ee5-b123-110dca67d497 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:29.793068 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697170f-874f-4e89-8cb7-b45ccc341fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:29.794512 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697170f-874f-4e89-8cb7-b45ccc341fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:29.794955 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697170f-874f-4e89-8cb7-b45ccc341fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:29.795457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697170f-874f-4e89-8cb7-b45ccc341fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:29.796715 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697170f-874f-4e89-8cb7-b45ccc341fd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:29.800487 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697170f-874f-4e89-8cb7-b45ccc341fd5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:29.826571 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1277/2533] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:11:29 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:11:29.830662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cb1dc-a32c-4b4f-86b8-4a5f97f9cd27 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:29.840366 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cb1dc-a32c-4b4f-86b8-4a5f97f9cd27 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:29.894565 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3aa3f-c5d5-41f2-a34a-f88f2b7e0563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:29.895286 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3aa3f-c5d5-41f2-a34a-f88f2b7e0563 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:29.895563 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3aa3f-c5d5-41f2-a34a-f88f2b7e0563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:29.895832 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3aa3f-c5d5-41f2-a34a-f88f2b7e0563 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:29.896510 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3aa3f-c5d5-41f2-a34a-f88f2b7e0563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:29.898785 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3aa3f-c5d5-41f2-a34a-f88f2b7e0563 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:29.917571 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1257/2534] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:11:29 2022] POST /identity/v3/users => generated 294 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:11:29.922264 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697170f-874f-4e89-8cb7-b45ccc341fd5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:29.932441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697170f-874f-4e89-8cb7-b45ccc341fd5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:29.938312 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6bb56-9d89-429a-bbee-56a7c6631eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:29.938954 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6bb56-9d89-429a-bbee-56a7c6631eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:29.939305 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6bb56-9d89-429a-bbee-56a7c6631eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:29.939607 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6bb56-9d89-429a-bbee-56a7c6631eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:29.940330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6bb56-9d89-429a-bbee-56a7c6631eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:29.941963 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6bb56-9d89-429a-bbee-56a7c6631eb5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:29.952595 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1278/2535] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:29.956518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3aa3f-c5d5-41f2-a34a-f88f2b7e0563 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:29.966669 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3aa3f-c5d5-41f2-a34a-f88f2b7e0563 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:29.971500 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae40a6-6419-49ac-b798-9ca6b284a0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:29.972190 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae40a6-6419-49ac-b798-9ca6b284a0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:29.972469 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae40a6-6419-49ac-b798-9ca6b284a0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:29.972871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae40a6-6419-49ac-b798-9ca6b284a0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:29.973660 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae40a6-6419-49ac-b798-9ca6b284a0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:29.975329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae40a6-6419-49ac-b798-9ca6b284a0a3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:29.985944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1258/2536] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:11:29.990232 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6bb56-9d89-429a-bbee-56a7c6631eb5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:30.001570 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6bb56-9d89-429a-bbee-56a7c6631eb5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:30.006218 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e875991-7519-40fb-b427-a3b97cfae4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:30.007092 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e875991-7519-40fb-b427-a3b97cfae4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:30.007371 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e875991-7519-40fb-b427-a3b97cfae4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:30.007645 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e875991-7519-40fb-b427-a3b97cfae4e8 admin admin] PATH_INFO: `/v3/projects/0d1b005992dc4589aef5682e4b24dae5/users/ef507c115bd2427fba437a41cf57d982/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:30.023101 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e875991-7519-40fb-b427-a3b97cfae4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1b005992dc4589aef5682e4b24dae5, user_id=ef507c115bd2427fba437a41cf57d982, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:30.025818 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e875991-7519-40fb-b427-a3b97cfae4e8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:30.038805 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1279/2537] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:11:29 2022] PUT /identity/v3/projects/0d1b005992dc4589aef5682e4b24dae5/users/ef507c115bd2427fba437a41cf57d982/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:30.049442 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828fd3d-73f8-4903-86f9-f45bff101ae3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:30.049730 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828fd3d-73f8-4903-86f9-f45bff101ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:30.050020 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828fd3d-73f8-4903-86f9-f45bff101ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:30.077868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0828fd3d-73f8-4903-86f9-f45bff101ae3 None None] MFA Rules not processed for user `ef507c115bd2427fba437a41cf57d982`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:30.079103 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0828fd3d-73f8-4903-86f9-f45bff101ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:30.144325 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1259/2538] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:30.148881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e875991-7519-40fb-b427-a3b97cfae4e8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:30.209369 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e875991-7519-40fb-b427-a3b97cfae4e8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:30.213953 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd051367-e5cd-4927-ba4a-bb3fafc3f187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:30.214597 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd051367-e5cd-4927-ba4a-bb3fafc3f187 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:30.214875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd051367-e5cd-4927-ba4a-bb3fafc3f187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:30.215146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd051367-e5cd-4927-ba4a-bb3fafc3f187 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:30.216551 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd051367-e5cd-4927-ba4a-bb3fafc3f187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:30.218454 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd051367-e5cd-4927-ba4a-bb3fafc3f187 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:30.243248 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1280/2539] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:11:30 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:11:30.247215 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828fd3d-73f8-4903-86f9-f45bff101ae3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:30.257512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828fd3d-73f8-4903-86f9-f45bff101ae3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:30.312724 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33f4c6-53a3-472d-94aa-7fc94911e69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:30.313339 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33f4c6-53a3-472d-94aa-7fc94911e69c admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:30.313620 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33f4c6-53a3-472d-94aa-7fc94911e69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:30.313898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33f4c6-53a3-472d-94aa-7fc94911e69c admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:30.314593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33f4c6-53a3-472d-94aa-7fc94911e69c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:30.316519 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33f4c6-53a3-472d-94aa-7fc94911e69c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:30.336238 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1260/2540] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:11:30 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:11:30.340193 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd051367-e5cd-4927-ba4a-bb3fafc3f187 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:30.350832 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd051367-e5cd-4927-ba4a-bb3fafc3f187 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:30.355470 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec616156-0d79-4cb8-a148-d7121bb075da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:30.356711 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec616156-0d79-4cb8-a148-d7121bb075da admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:30.357020 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec616156-0d79-4cb8-a148-d7121bb075da admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:30.357292 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec616156-0d79-4cb8-a148-d7121bb075da admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:30.358011 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec616156-0d79-4cb8-a148-d7121bb075da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:30.359593 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec616156-0d79-4cb8-a148-d7121bb075da admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:30.369180 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1281/2541] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:30.373279 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33f4c6-53a3-472d-94aa-7fc94911e69c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:30.383584 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33f4c6-53a3-472d-94aa-7fc94911e69c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:30.389009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb8c77-3eff-4f5a-aa79-9420fdbc97ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:30.389936 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb8c77-3eff-4f5a-aa79-9420fdbc97ea admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:30.390212 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb8c77-3eff-4f5a-aa79-9420fdbc97ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:30.390478 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb8c77-3eff-4f5a-aa79-9420fdbc97ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:30.391330 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb8c77-3eff-4f5a-aa79-9420fdbc97ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:30.392939 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb8c77-3eff-4f5a-aa79-9420fdbc97ea admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:30.403656 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1261/2542] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:11:30.407883 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec616156-0d79-4cb8-a148-d7121bb075da admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:30.417601 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec616156-0d79-4cb8-a148-d7121bb075da admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:30.422536 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a1b1d-f5dd-4f78-a2cc-a6daf781cb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:30.423394 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a1b1d-f5dd-4f78-a2cc-a6daf781cb2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:30.423670 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a1b1d-f5dd-4f78-a2cc-a6daf781cb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:30.423939 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a1b1d-f5dd-4f78-a2cc-a6daf781cb2f admin admin] PATH_INFO: `/v3/projects/9558aff74bfc4e93a1fa358dfc37d8ee/users/d1d9bd164b5b413a8178f6f4895a1b87/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:30.438242 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a1b1d-f5dd-4f78-a2cc-a6daf781cb2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9558aff74bfc4e93a1fa358dfc37d8ee, user_id=d1d9bd164b5b413a8178f6f4895a1b87, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:30.440894 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a1b1d-f5dd-4f78-a2cc-a6daf781cb2f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:30.454170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1282/2543] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:11:30 2022] PUT /identity/v3/projects/9558aff74bfc4e93a1fa358dfc37d8ee/users/d1d9bd164b5b413a8178f6f4895a1b87/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:11:30.471666 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24101e-1e49-4860-b70e-e06b1af88d20 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:30.471955 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24101e-1e49-4860-b70e-e06b1af88d20 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:30.472235 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24101e-1e49-4860-b70e-e06b1af88d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:30.498260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8d24101e-1e49-4860-b70e-e06b1af88d20 None None] MFA Rules not processed for user `d1d9bd164b5b413a8178f6f4895a1b87`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:30.499458 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8d24101e-1e49-4860-b70e-e06b1af88d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:30.562849 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1262/2544] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:30.567190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a1b1d-f5dd-4f78-a2cc-a6daf781cb2f admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:30.626645 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a1b1d-f5dd-4f78-a2cc-a6daf781cb2f admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:30.631425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66206f83-ff3e-45a9-a2e2-8cd3961fa5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:30.632074 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66206f83-ff3e-45a9-a2e2-8cd3961fa5da admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:30.632358 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66206f83-ff3e-45a9-a2e2-8cd3961fa5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:30.632636 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66206f83-ff3e-45a9-a2e2-8cd3961fa5da admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:30.633363 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66206f83-ff3e-45a9-a2e2-8cd3961fa5da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:30.635247 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66206f83-ff3e-45a9-a2e2-8cd3961fa5da admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:30.660997 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1283/2545] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:11:30 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:11:30.665428 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24101e-1e49-4860-b70e-e06b1af88d20 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:30.676502 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24101e-1e49-4860-b70e-e06b1af88d20 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:30.730576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae38545-8588-4e1c-90e3-f76e8c18e9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:30.731351 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38545-8588-4e1c-90e3-f76e8c18e9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:30.731813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38545-8588-4e1c-90e3-f76e8c18e9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:30.732092 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae38545-8588-4e1c-90e3-f76e8c18e9d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:30.732809 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae38545-8588-4e1c-90e3-f76e8c18e9d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:30.734725 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae38545-8588-4e1c-90e3-f76e8c18e9d0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:30.755026 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1263/2546] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:11:30 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:11:30.759046 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66206f83-ff3e-45a9-a2e2-8cd3961fa5da admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:30.770285 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66206f83-ff3e-45a9-a2e2-8cd3961fa5da admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:30.774882 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e067fa-b9b8-4207-bf0f-c4c68c35addc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:30.775522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e067fa-b9b8-4207-bf0f-c4c68c35addc admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:30.775797 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e067fa-b9b8-4207-bf0f-c4c68c35addc admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:30.776069 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e067fa-b9b8-4207-bf0f-c4c68c35addc admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:30.776810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e067fa-b9b8-4207-bf0f-c4c68c35addc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:30.778718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e067fa-b9b8-4207-bf0f-c4c68c35addc admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:30.788770 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1284/2547] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:30.792971 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae38545-8588-4e1c-90e3-f76e8c18e9d0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:30.802644 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae38545-8588-4e1c-90e3-f76e8c18e9d0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:30.807269 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5a374-98ca-41ff-a31d-d0dcac7a9c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:30.808131 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5a374-98ca-41ff-a31d-d0dcac7a9c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:30.808414 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5a374-98ca-41ff-a31d-d0dcac7a9c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:30.808691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5a374-98ca-41ff-a31d-d0dcac7a9c8c admin admin] PATH_INFO: `/v3/projects/59c1d5fdb28147059876a9ce5ed3e237/users/4da1e3c7b3354be4a02988025a9fbe14/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:30.823498 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5a374-98ca-41ff-a31d-d0dcac7a9c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c1d5fdb28147059876a9ce5ed3e237, user_id=4da1e3c7b3354be4a02988025a9fbe14, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:30.826771 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5a374-98ca-41ff-a31d-d0dcac7a9c8c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:30.838921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1264/2548] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:11:30 2022] PUT /identity/v3/projects/59c1d5fdb28147059876a9ce5ed3e237/users/4da1e3c7b3354be4a02988025a9fbe14/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:30.843079 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e067fa-b9b8-4207-bf0f-c4c68c35addc admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:30.852939 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e067fa-b9b8-4207-bf0f-c4c68c35addc admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:30.908243 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf4bc8-f0aa-4f44-bef7-fc69a61d19df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:30.908928 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf4bc8-f0aa-4f44-bef7-fc69a61d19df admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:30.909212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf4bc8-f0aa-4f44-bef7-fc69a61d19df admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:30.909485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf4bc8-f0aa-4f44-bef7-fc69a61d19df admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:30.910228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf4bc8-f0aa-4f44-bef7-fc69a61d19df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:30.911811 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf4bc8-f0aa-4f44-bef7-fc69a61d19df admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:30.921380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1285/2549] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:30.925562 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5a374-98ca-41ff-a31d-d0dcac7a9c8c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:30.936079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5a374-98ca-41ff-a31d-d0dcac7a9c8c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:30.940717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5416c6b-1b90-40a3-a098-a89d7491c75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:30.941622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5416c6b-1b90-40a3-a098-a89d7491c75f admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:30.941902 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5416c6b-1b90-40a3-a098-a89d7491c75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:30.942174 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5416c6b-1b90-40a3-a098-a89d7491c75f admin admin] PATH_INFO: `/v3/projects/59c1d5fdb28147059876a9ce5ed3e237/users/4da1e3c7b3354be4a02988025a9fbe14/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:30.944130 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5416c6b-1b90-40a3-a098-a89d7491c75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59c1d5fdb28147059876a9ce5ed3e237, user_id=4da1e3c7b3354be4a02988025a9fbe14, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:30.946784 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5416c6b-1b90-40a3-a098-a89d7491c75f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:30.957253 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1265/2550] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:11:30 2022] PUT /identity/v3/projects/59c1d5fdb28147059876a9ce5ed3e237/users/4da1e3c7b3354be4a02988025a9fbe14/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:30.967275 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2214b-6f18-46fb-b9c0-e1923ae774c3 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:30.967576 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2214b-6f18-46fb-b9c0-e1923ae774c3 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:30.967856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2214b-6f18-46fb-b9c0-e1923ae774c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:30.993863 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7be2214b-6f18-46fb-b9c0-e1923ae774c3 None None] MFA Rules not processed for user `4da1e3c7b3354be4a02988025a9fbe14`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:30.995097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7be2214b-6f18-46fb-b9c0-e1923ae774c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:31.061583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1286/2551] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:31.072226 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5416c6b-1b90-40a3-a098-a89d7491c75f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:31.073998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a5416c6b-1b90-40a3-a098-a89d7491c75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:31.129800 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5416c6b-1b90-40a3-a098-a89d7491c75f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:31.133424 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c491b3-ce91-407a-9255-9023040b6390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:31.134067 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c491b3-ce91-407a-9255-9023040b6390 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:31.134350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c491b3-ce91-407a-9255-9023040b6390 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:31.134628 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c491b3-ce91-407a-9255-9023040b6390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:31.143857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c491b3-ce91-407a-9255-9023040b6390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:31.145329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c491b3-ce91-407a-9255-9023040b6390 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:31.154433 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1266/2552] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:31.624754 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2214b-6f18-46fb-b9c0-e1923ae774c3 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:31.626178 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7be2214b-6f18-46fb-b9c0-e1923ae774c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:31.638738 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2214b-6f18-46fb-b9c0-e1923ae774c3 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:31.642771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8a1e9-de65-4fae-b55d-e5d705aec0f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:31.643401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8a1e9-de65-4fae-b55d-e5d705aec0f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:31.643679 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8a1e9-de65-4fae-b55d-e5d705aec0f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:31.643949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8a1e9-de65-4fae-b55d-e5d705aec0f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:31.698416 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8a1e9-de65-4fae-b55d-e5d705aec0f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:31.699995 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8a1e9-de65-4fae-b55d-e5d705aec0f1 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:31.708815 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1287/2553] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:35.683251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c491b3-ce91-407a-9255-9023040b6390 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:35.692266 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c491b3-ce91-407a-9255-9023040b6390 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:35.695906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35798f12-d329-4f8f-9058-58f70d9ef4ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:35.696532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798f12-d329-4f8f-9058-58f70d9ef4ad service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:35.696843 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798f12-d329-4f8f-9058-58f70d9ef4ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:35.697121 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798f12-d329-4f8f-9058-58f70d9ef4ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:35.752594 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35798f12-d329-4f8f-9058-58f70d9ef4ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:35.754091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35798f12-d329-4f8f-9058-58f70d9ef4ad service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:35.763451 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1267/2554] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:37.774589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8a1e9-de65-4fae-b55d-e5d705aec0f1 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:37.834896 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8a1e9-de65-4fae-b55d-e5d705aec0f1 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:37.839405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65103fca-5ba3-4e57-992f-f7460cbacc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:37.840325 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65103fca-5ba3-4e57-992f-f7460cbacc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:37.840856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65103fca-5ba3-4e57-992f-f7460cbacc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:37.841142 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65103fca-5ba3-4e57-992f-f7460cbacc24 admin admin] PATH_INFO: `/v3/users/ef507c115bd2427fba437a41cf57d982` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:37.842310 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65103fca-5ba3-4e57-992f-f7460cbacc24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef507c115bd2427fba437a41cf57d982)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:37.844220 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65103fca-5ba3-4e57-992f-f7460cbacc24 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:37.890979 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-65103fca-5ba3-4e57-992f-f7460cbacc24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef507c115bd2427fba437a41cf57d982'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:37.891621 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-65103fca-5ba3-4e57-992f-f7460cbacc24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef507c115bd2427fba437a41cf57d982'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:37.892479 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-65103fca-5ba3-4e57-992f-f7460cbacc24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef507c115bd2427fba437a41cf57d982'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:37.899457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-65103fca-5ba3-4e57-992f-f7460cbacc24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef507c115bd2427fba437a41cf57d982'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:37.911230 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-65103fca-5ba3-4e57-992f-f7460cbacc24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef507c115bd2427fba437a41cf57d982'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:37.923547 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1288/2555] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:11:37 2022] DELETE /identity/v3/users/ef507c115bd2427fba437a41cf57d982 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:37.928155 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad0175-c445-4a93-bbe7-81fdcf685144 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:37.928615 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad0175-c445-4a93-bbe7-81fdcf685144 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:37.928709 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad0175-c445-4a93-bbe7-81fdcf685144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:37.945928 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-02ad0175-c445-4a93-bbe7-81fdcf685144 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:37.947098 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-02ad0175-c445-4a93-bbe7-81fdcf685144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:38.004213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1268/2556] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:11:38.013669 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65103fca-5ba3-4e57-992f-f7460cbacc24 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:38.015316 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-65103fca-5ba3-4e57-992f-f7460cbacc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:38.070642 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65103fca-5ba3-4e57-992f-f7460cbacc24 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:38.074372 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43d09b-b585-4c53-94c2-d11be705626d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:38.075231 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43d09b-b585-4c53-94c2-d11be705626d service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:38.075514 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43d09b-b585-4c53-94c2-d11be705626d service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:38.075790 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43d09b-b585-4c53-94c2-d11be705626d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:38.084796 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43d09b-b585-4c53-94c2-d11be705626d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:38.086266 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43d09b-b585-4c53-94c2-d11be705626d service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:38.095621 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1289/2557] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:38.365287 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad0175-c445-4a93-bbe7-81fdcf685144 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:38.366691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-02ad0175-c445-4a93-bbe7-81fdcf685144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:38.380253 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad0175-c445-4a93-bbe7-81fdcf685144 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:38.385123 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce85248-becc-453e-8a6f-982013825932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:38.386138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce85248-becc-453e-8a6f-982013825932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:38.386419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce85248-becc-453e-8a6f-982013825932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:38.386762 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce85248-becc-453e-8a6f-982013825932 admin admin] PATH_INFO: `/v3/projects/0d1b005992dc4589aef5682e4b24dae5` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:38.388731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce85248-becc-453e-8a6f-982013825932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1b005992dc4589aef5682e4b24dae5)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:38.390934 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce85248-becc-453e-8a6f-982013825932 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:38.436114 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fce85248-becc-453e-8a6f-982013825932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1b005992dc4589aef5682e4b24dae5', 'request_id': 'req-fce85248-becc-453e-8a6f-982013825932'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:38.446957 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fce85248-becc-453e-8a6f-982013825932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1b005992dc4589aef5682e4b24dae5', 'request_id': 'req-fce85248-becc-453e-8a6f-982013825932'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:38.453938 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fce85248-becc-453e-8a6f-982013825932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1b005992dc4589aef5682e4b24dae5', 'request_id': 'req-fce85248-becc-453e-8a6f-982013825932'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:38.463939 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fce85248-becc-453e-8a6f-982013825932 admin admin] The token cache is being invalidate because project 0d1b005992dc4589aef5682e4b24dae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:11:38.464223 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fce85248-becc-453e-8a6f-982013825932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:38.464880 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fce85248-becc-453e-8a6f-982013825932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:38.466517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1269/2558] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:11:38 2022] DELETE /identity/v3/projects/0d1b005992dc4589aef5682e4b24dae5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:38.470458 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43d09b-b585-4c53-94c2-d11be705626d service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:38.479841 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43d09b-b585-4c53-94c2-d11be705626d service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:38.535866 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbcd04-21a0-4edb-9e49-f54a46bdf456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:38.536669 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbcd04-21a0-4edb-9e49-f54a46bdf456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:38.536980 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbcd04-21a0-4edb-9e49-f54a46bdf456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:38.537252 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbcd04-21a0-4edb-9e49-f54a46bdf456 admin admin] PATH_INFO: `/v3/users/d1d9bd164b5b413a8178f6f4895a1b87` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:38.538471 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbcd04-21a0-4edb-9e49-f54a46bdf456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d9bd164b5b413a8178f6f4895a1b87)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:38.540378 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbcd04-21a0-4edb-9e49-f54a46bdf456 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:38.587418 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-13bbcd04-21a0-4edb-9e49-f54a46bdf456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d9bd164b5b413a8178f6f4895a1b87'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:38.588065 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-13bbcd04-21a0-4edb-9e49-f54a46bdf456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d9bd164b5b413a8178f6f4895a1b87'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:38.588673 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-13bbcd04-21a0-4edb-9e49-f54a46bdf456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d9bd164b5b413a8178f6f4895a1b87'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:38.595840 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-13bbcd04-21a0-4edb-9e49-f54a46bdf456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d9bd164b5b413a8178f6f4895a1b87'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:38.607661 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-13bbcd04-21a0-4edb-9e49-f54a46bdf456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d9bd164b5b413a8178f6f4895a1b87'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:38.619175 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1290/2559] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:11:38 2022] DELETE /identity/v3/users/d1d9bd164b5b413a8178f6f4895a1b87 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:11:38.885533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce85248-becc-453e-8a6f-982013825932 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:38.886980 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fce85248-becc-453e-8a6f-982013825932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:38.901471 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce85248-becc-453e-8a6f-982013825932 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:38.958447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:38.959332 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:38.959612 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:38.959886 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8 admin admin] PATH_INFO: `/v3/projects/9558aff74bfc4e93a1fa358dfc37d8ee` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:38.961140 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9558aff74bfc4e93a1fa358dfc37d8ee)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:38.963108 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:39.015532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9558aff74bfc4e93a1fa358dfc37d8ee', 'request_id': 'req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:39.023508 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9558aff74bfc4e93a1fa358dfc37d8ee', 'request_id': 'req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:39.031042 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9558aff74bfc4e93a1fa358dfc37d8ee', 'request_id': 'req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:39.042254 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8 admin admin] The token cache is being invalidate because project 9558aff74bfc4e93a1fa358dfc37d8ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:11:39.042545 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:39.043254 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:39.045656 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1270/2560] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:11:38 2022] DELETE /identity/v3/projects/9558aff74bfc4e93a1fa358dfc37d8ee => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:39.049475 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbcd04-21a0-4edb-9e49-f54a46bdf456 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:39.050958 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-13bbcd04-21a0-4edb-9e49-f54a46bdf456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:39.064029 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbcd04-21a0-4edb-9e49-f54a46bdf456 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:39.122994 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ef216-628e-4b00-bcc6-c3c262d906b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:39.123852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ef216-628e-4b00-bcc6-c3c262d906b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:39.124123 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ef216-628e-4b00-bcc6-c3c262d906b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:39.124388 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ef216-628e-4b00-bcc6-c3c262d906b1 admin admin] PATH_INFO: `/v3/users/4da1e3c7b3354be4a02988025a9fbe14` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:39.125578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ef216-628e-4b00-bcc6-c3c262d906b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4da1e3c7b3354be4a02988025a9fbe14)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:39.127482 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ef216-628e-4b00-bcc6-c3c262d906b1 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:39.172761 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-339ef216-628e-4b00-bcc6-c3c262d906b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da1e3c7b3354be4a02988025a9fbe14'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:39.173461 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-339ef216-628e-4b00-bcc6-c3c262d906b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da1e3c7b3354be4a02988025a9fbe14'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:39.174065 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-339ef216-628e-4b00-bcc6-c3c262d906b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da1e3c7b3354be4a02988025a9fbe14'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:39.181322 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-339ef216-628e-4b00-bcc6-c3c262d906b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da1e3c7b3354be4a02988025a9fbe14'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:39.192745 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-339ef216-628e-4b00-bcc6-c3c262d906b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da1e3c7b3354be4a02988025a9fbe14'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:39.205021 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1291/2561] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:11:39 2022] DELETE /identity/v3/users/4da1e3c7b3354be4a02988025a9fbe14 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:39.469453 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:39.470892 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:39.485615 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db6d41-b3ac-4ce3-857b-60ab8f09e4a8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:39.541792 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5ef70-2538-47dc-8728-0f55aebba6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:39.542645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5ef70-2538-47dc-8728-0f55aebba6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:39.542920 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5ef70-2538-47dc-8728-0f55aebba6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:39.543193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5ef70-2538-47dc-8728-0f55aebba6c5 admin admin] PATH_INFO: `/v3/projects/59c1d5fdb28147059876a9ce5ed3e237` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:39.544684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5ef70-2538-47dc-8728-0f55aebba6c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59c1d5fdb28147059876a9ce5ed3e237)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:39.546618 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5ef70-2538-47dc-8728-0f55aebba6c5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:39.591050 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-40a5ef70-2538-47dc-8728-0f55aebba6c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59c1d5fdb28147059876a9ce5ed3e237', 'request_id': 'req-40a5ef70-2538-47dc-8728-0f55aebba6c5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:39.598137 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-40a5ef70-2538-47dc-8728-0f55aebba6c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59c1d5fdb28147059876a9ce5ed3e237', 'request_id': 'req-40a5ef70-2538-47dc-8728-0f55aebba6c5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:39.604130 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-40a5ef70-2538-47dc-8728-0f55aebba6c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59c1d5fdb28147059876a9ce5ed3e237', 'request_id': 'req-40a5ef70-2538-47dc-8728-0f55aebba6c5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:39.614120 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-40a5ef70-2538-47dc-8728-0f55aebba6c5 admin admin] The token cache is being invalidate because project 59c1d5fdb28147059876a9ce5ed3e237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:11:39.614402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-40a5ef70-2538-47dc-8728-0f55aebba6c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:39.615013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-40a5ef70-2538-47dc-8728-0f55aebba6c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:39.616494 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1271/2562] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:11:39 2022] DELETE /identity/v3/projects/59c1d5fdb28147059876a9ce5ed3e237 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:39.622531 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab98ce7-dab9-434a-84c9-7161e9e82f48 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:39.622816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab98ce7-dab9-434a-84c9-7161e9e82f48 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:39.623094 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab98ce7-dab9-434a-84c9-7161e9e82f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:39.642063 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-bab98ce7-dab9-434a-84c9-7161e9e82f48 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:39.643271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-bab98ce7-dab9-434a-84c9-7161e9e82f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:39.700222 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1292/2563] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:39.709751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d787d4d-7dd4-40e6-8cce-4621e411f182 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:39.710038 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d787d4d-7dd4-40e6-8cce-4621e411f182 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:39.710336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d787d4d-7dd4-40e6-8cce-4621e411f182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:39.729142 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1d787d4d-7dd4-40e6-8cce-4621e411f182 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:39.730311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1d787d4d-7dd4-40e6-8cce-4621e411f182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:39.738251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1272/2564] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:39.742299 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab98ce7-dab9-434a-84c9-7161e9e82f48 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:39.752230 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab98ce7-dab9-434a-84c9-7161e9e82f48 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:39.756693 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39433d0a-4eec-4529-8464-979172b0c4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:39.757352 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39433d0a-4eec-4529-8464-979172b0c4fa admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:39.757627 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39433d0a-4eec-4529-8464-979172b0c4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:39.757898 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39433d0a-4eec-4529-8464-979172b0c4fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:39.758600 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39433d0a-4eec-4529-8464-979172b0c4fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:11:39.758898 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39433d0a-4eec-4529-8464-979172b0c4fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:39.760474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39433d0a-4eec-4529-8464-979172b0c4fa admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:39.773118 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1293/2565] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:11:39.777238 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d787d4d-7dd4-40e6-8cce-4621e411f182 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:39.786517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d787d4d-7dd4-40e6-8cce-4621e411f182 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:39.791170 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d02c3-746a-49dc-993c-06245202c874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:39.791850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d02c3-746a-49dc-993c-06245202c874 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:39.792126 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d02c3-746a-49dc-993c-06245202c874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:39.792423 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d02c3-746a-49dc-993c-06245202c874 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:39.793156 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d02c3-746a-49dc-993c-06245202c874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:39.795088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d02c3-746a-49dc-993c-06245202c874 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:39.820374 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1273/2566] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:11:39 2022] POST /identity/v3/projects => generated 393 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:11:39.824450 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39433d0a-4eec-4529-8464-979172b0c4fa admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:39.835936 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39433d0a-4eec-4529-8464-979172b0c4fa admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:39.889910 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7074e-0ec5-4d1b-8a24-2aab0e971fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:39.890567 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7074e-0ec5-4d1b-8a24-2aab0e971fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:39.890950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7074e-0ec5-4d1b-8a24-2aab0e971fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:39.891319 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7074e-0ec5-4d1b-8a24-2aab0e971fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:39.892007 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7074e-0ec5-4d1b-8a24-2aab0e971fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:39.893957 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7074e-0ec5-4d1b-8a24-2aab0e971fd8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:39.914281 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1294/2567] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:11:39 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:11:39.918961 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d02c3-746a-49dc-993c-06245202c874 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:39.928997 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d02c3-746a-49dc-993c-06245202c874 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:39.933533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b23d1-7a5d-4147-8cc1-d1afc6a3fcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:39.934293 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b23d1-7a5d-4147-8cc1-d1afc6a3fcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:39.934571 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b23d1-7a5d-4147-8cc1-d1afc6a3fcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:39.934843 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b23d1-7a5d-4147-8cc1-d1afc6a3fcf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:39.935562 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b23d1-7a5d-4147-8cc1-d1afc6a3fcf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:39.937180 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b23d1-7a5d-4147-8cc1-d1afc6a3fcf7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:39.948226 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1274/2568] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:39.952006 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7074e-0ec5-4d1b-8a24-2aab0e971fd8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:39.961787 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7074e-0ec5-4d1b-8a24-2aab0e971fd8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:39.967351 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a9012-c3e6-45db-8da5-c53cf0e12eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:39.967990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a9012-c3e6-45db-8da5-c53cf0e12eae admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:39.968268 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a9012-c3e6-45db-8da5-c53cf0e12eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:39.968560 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a9012-c3e6-45db-8da5-c53cf0e12eae admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:39.969305 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a9012-c3e6-45db-8da5-c53cf0e12eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:39.970882 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a9012-c3e6-45db-8da5-c53cf0e12eae admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:39.980752 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1295/2569] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:39.985551 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b23d1-7a5d-4147-8cc1-d1afc6a3fcf7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:39.995242 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b23d1-7a5d-4147-8cc1-d1afc6a3fcf7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:40.000336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce600c-23f9-4177-a760-086eaf1a9db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:40.001246 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce600c-23f9-4177-a760-086eaf1a9db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:40.001515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce600c-23f9-4177-a760-086eaf1a9db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:40.001782 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce600c-23f9-4177-a760-086eaf1a9db5 admin admin] PATH_INFO: `/v3/projects/a619feddc095483db62bc6187eb49ac4/users/bcdec26323f44147afd120d9c41f82e6/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:40.016306 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce600c-23f9-4177-a760-086eaf1a9db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a619feddc095483db62bc6187eb49ac4, user_id=bcdec26323f44147afd120d9c41f82e6, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:40.019047 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce600c-23f9-4177-a760-086eaf1a9db5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:40.034153 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1275/2570] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:11:39 2022] PUT /identity/v3/projects/a619feddc095483db62bc6187eb49ac4/users/bcdec26323f44147afd120d9c41f82e6/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:40.046214 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648e8ff-2364-4eba-abc3-3a5f110c4f58 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:40.046504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648e8ff-2364-4eba-abc3-3a5f110c4f58 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:40.046787 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648e8ff-2364-4eba-abc3-3a5f110c4f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:40.073062 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c648e8ff-2364-4eba-abc3-3a5f110c4f58 None None] MFA Rules not processed for user `bcdec26323f44147afd120d9c41f82e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:40.074251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c648e8ff-2364-4eba-abc3-3a5f110c4f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:40.140577 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1296/2571] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:40.145378 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce600c-23f9-4177-a760-086eaf1a9db5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:40.209248 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce600c-23f9-4177-a760-086eaf1a9db5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:40.213938 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f5874-b3df-400c-af2f-597815ba0505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:40.214588 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f5874-b3df-400c-af2f-597815ba0505 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:40.214867 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f5874-b3df-400c-af2f-597815ba0505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:40.215220 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f5874-b3df-400c-af2f-597815ba0505 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:40.216317 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f5874-b3df-400c-af2f-597815ba0505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:40.218233 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f5874-b3df-400c-af2f-597815ba0505 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:40.249053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1276/2572] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:11:40 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:11:40.250324 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648e8ff-2364-4eba-abc3-3a5f110c4f58 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:40.260848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648e8ff-2364-4eba-abc3-3a5f110c4f58 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:40.316255 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cde2c-4c3b-4ec9-a7d8-db86ff3364fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:40.316959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cde2c-4c3b-4ec9-a7d8-db86ff3364fa admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:40.317241 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cde2c-4c3b-4ec9-a7d8-db86ff3364fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:40.317516 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cde2c-4c3b-4ec9-a7d8-db86ff3364fa admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:40.318208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cde2c-4c3b-4ec9-a7d8-db86ff3364fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:40.320142 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cde2c-4c3b-4ec9-a7d8-db86ff3364fa admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:40.340240 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1297/2573] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:11:40 2022] POST /identity/v3/users => generated 301 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:11:40.343542 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f5874-b3df-400c-af2f-597815ba0505 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:40.353619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f5874-b3df-400c-af2f-597815ba0505 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:40.359240 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f1eb3-1587-4ae2-8515-7d6e05737bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:40.359895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f1eb3-1587-4ae2-8515-7d6e05737bca admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:40.360173 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f1eb3-1587-4ae2-8515-7d6e05737bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:40.360446 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f1eb3-1587-4ae2-8515-7d6e05737bca admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:40.361216 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f1eb3-1587-4ae2-8515-7d6e05737bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:40.362798 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f1eb3-1587-4ae2-8515-7d6e05737bca admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:40.373772 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1277/2574] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:40.377856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cde2c-4c3b-4ec9-a7d8-db86ff3364fa admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:40.388527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cde2c-4c3b-4ec9-a7d8-db86ff3364fa admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:40.393761 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c484c7-2e9c-42bb-83ac-3ab5b5c28cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:40.394630 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c484c7-2e9c-42bb-83ac-3ab5b5c28cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:40.394907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c484c7-2e9c-42bb-83ac-3ab5b5c28cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:40.395179 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c484c7-2e9c-42bb-83ac-3ab5b5c28cf3 admin admin] PATH_INFO: `/v3/projects/17d2233bb77f4d728e6ee455d5733d0e/users/0f92f0a7805a426bbe648ae9de843c68/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:40.410275 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c484c7-2e9c-42bb-83ac-3ab5b5c28cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17d2233bb77f4d728e6ee455d5733d0e, user_id=0f92f0a7805a426bbe648ae9de843c68, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:40.412990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c484c7-2e9c-42bb-83ac-3ab5b5c28cf3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:40.426553 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1298/2575] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:11:40 2022] PUT /identity/v3/projects/17d2233bb77f4d728e6ee455d5733d0e/users/0f92f0a7805a426bbe648ae9de843c68/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:40.430712 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f1eb3-1587-4ae2-8515-7d6e05737bca admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:40.443255 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f1eb3-1587-4ae2-8515-7d6e05737bca admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:40.499770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb11715-fb56-4311-88ef-cc580c834b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:40.500430 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb11715-fb56-4311-88ef-cc580c834b1a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:40.500707 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb11715-fb56-4311-88ef-cc580c834b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:40.501013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb11715-fb56-4311-88ef-cc580c834b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:40.501730 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb11715-fb56-4311-88ef-cc580c834b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:40.503311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb11715-fb56-4311-88ef-cc580c834b1a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:40.515843 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1278/2576] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:40.520313 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c484c7-2e9c-42bb-83ac-3ab5b5c28cf3 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:40.531828 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c484c7-2e9c-42bb-83ac-3ab5b5c28cf3 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:40.536479 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499415a-a088-4379-863c-6bf13c2598c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:40.537380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499415a-a088-4379-863c-6bf13c2598c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:40.537664 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499415a-a088-4379-863c-6bf13c2598c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:40.537940 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499415a-a088-4379-863c-6bf13c2598c3 admin admin] PATH_INFO: `/v3/projects/17d2233bb77f4d728e6ee455d5733d0e/users/0f92f0a7805a426bbe648ae9de843c68/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:40.539920 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499415a-a088-4379-863c-6bf13c2598c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17d2233bb77f4d728e6ee455d5733d0e, user_id=0f92f0a7805a426bbe648ae9de843c68, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:40.542601 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499415a-a088-4379-863c-6bf13c2598c3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:40.553504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1299/2577] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:11:40 2022] PUT /identity/v3/projects/17d2233bb77f4d728e6ee455d5733d0e/users/0f92f0a7805a426bbe648ae9de843c68/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:40.564090 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b8ad6-bac7-46b6-9d4d-790167be3bcc None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:40.564489 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b8ad6-bac7-46b6-9d4d-790167be3bcc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:40.564892 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b8ad6-bac7-46b6-9d4d-790167be3bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:40.592765 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0d4b8ad6-bac7-46b6-9d4d-790167be3bcc None None] MFA Rules not processed for user `0f92f0a7805a426bbe648ae9de843c68`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:40.593990 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0d4b8ad6-bac7-46b6-9d4d-790167be3bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:40.659992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1279/2578] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:40.671362 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499415a-a088-4379-863c-6bf13c2598c3 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:40.673072 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1499415a-a088-4379-863c-6bf13c2598c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:40.728656 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499415a-a088-4379-863c-6bf13c2598c3 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:40.733052 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6ccd8-aaec-45e7-a941-bcb1fb018eab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:40.733684 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6ccd8-aaec-45e7-a941-bcb1fb018eab service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:40.733974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6ccd8-aaec-45e7-a941-bcb1fb018eab service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:40.734250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6ccd8-aaec-45e7-a941-bcb1fb018eab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:40.743318 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6ccd8-aaec-45e7-a941-bcb1fb018eab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:40.744776 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6ccd8-aaec-45e7-a941-bcb1fb018eab service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:40.754190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1300/2579] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:40.801227 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b8ad6-bac7-46b6-9d4d-790167be3bcc None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:40.802596 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0d4b8ad6-bac7-46b6-9d4d-790167be3bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:40.814465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b8ad6-bac7-46b6-9d4d-790167be3bcc None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:40.818088 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f81ce6-c5d3-456d-bd34-d342292aab52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:40.818719 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81ce6-c5d3-456d-bd34-d342292aab52 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:40.818999 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81ce6-c5d3-456d-bd34-d342292aab52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:40.819272 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81ce6-c5d3-456d-bd34-d342292aab52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:40.873257 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f81ce6-c5d3-456d-bd34-d342292aab52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:40.874690 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f81ce6-c5d3-456d-bd34-d342292aab52 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:40.883299 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1280/2580] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:43.041309 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6ccd8-aaec-45e7-a941-bcb1fb018eab service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:43.042686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3da6ccd8-aaec-45e7-a941-bcb1fb018eab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:43.135487 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6ccd8-aaec-45e7-a941-bcb1fb018eab service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:43.142233 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe7b16-4700-47ad-bc7a-1f53c26dfbfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:43.142888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe7b16-4700-47ad-bc7a-1f53c26dfbfc service nova] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:43.143170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe7b16-4700-47ad-bc7a-1f53c26dfbfc service nova] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:43.143448 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe7b16-4700-47ad-bc7a-1f53c26dfbfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:43.145289 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4ffe7b16-4700-47ad-bc7a-1f53c26dfbfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:43.158585 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe7b16-4700-47ad-bc7a-1f53c26dfbfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:43.160205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe7b16-4700-47ad-bc7a-1f53c26dfbfc service nova] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:43.171745 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1301/2581] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:11:44.195168 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f81ce6-c5d3-456d-bd34-d342292aab52 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:44.256672 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f81ce6-c5d3-456d-bd34-d342292aab52 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:44.261400 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c429e-d25a-4bd9-9a93-18382e6d52ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:44.262417 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c429e-d25a-4bd9-9a93-18382e6d52ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:44.262931 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c429e-d25a-4bd9-9a93-18382e6d52ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:44.263219 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c429e-d25a-4bd9-9a93-18382e6d52ac admin admin] PATH_INFO: `/v3/users/bcdec26323f44147afd120d9c41f82e6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:44.264419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c429e-d25a-4bd9-9a93-18382e6d52ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcdec26323f44147afd120d9c41f82e6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:44.266646 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c429e-d25a-4bd9-9a93-18382e6d52ac admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:44.315326 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-757c429e-d25a-4bd9-9a93-18382e6d52ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcdec26323f44147afd120d9c41f82e6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:44.316027 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-757c429e-d25a-4bd9-9a93-18382e6d52ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcdec26323f44147afd120d9c41f82e6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:44.316638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-757c429e-d25a-4bd9-9a93-18382e6d52ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcdec26323f44147afd120d9c41f82e6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:44.325832 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-757c429e-d25a-4bd9-9a93-18382e6d52ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcdec26323f44147afd120d9c41f82e6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:44.338405 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-757c429e-d25a-4bd9-9a93-18382e6d52ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcdec26323f44147afd120d9c41f82e6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:44.350749 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1281/2582] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:11:44 2022] DELETE /identity/v3/users/bcdec26323f44147afd120d9c41f82e6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:44.355283 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508996f-9e30-4a31-b62f-335bd2d32acd None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:44.356348 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508996f-9e30-4a31-b62f-335bd2d32acd None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:44.356527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508996f-9e30-4a31-b62f-335bd2d32acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:44.373653 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4508996f-9e30-4a31-b62f-335bd2d32acd None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:44.374830 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4508996f-9e30-4a31-b62f-335bd2d32acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:44.434695 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1302/2583] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:44.444409 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c429e-d25a-4bd9-9a93-18382e6d52ac admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:44.445821 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-757c429e-d25a-4bd9-9a93-18382e6d52ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:44.505944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c429e-d25a-4bd9-9a93-18382e6d52ac admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:44.509666 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd721a-a2b2-4f0d-bdab-6fb7b7ff8425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:44.510328 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd721a-a2b2-4f0d-bdab-6fb7b7ff8425 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:44.510614 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd721a-a2b2-4f0d-bdab-6fb7b7ff8425 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:44.510897 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd721a-a2b2-4f0d-bdab-6fb7b7ff8425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:44.521029 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd721a-a2b2-4f0d-bdab-6fb7b7ff8425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:44.522460 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd721a-a2b2-4f0d-bdab-6fb7b7ff8425 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:44.531691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1282/2584] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:44.792486 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508996f-9e30-4a31-b62f-335bd2d32acd None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:44.794831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4508996f-9e30-4a31-b62f-335bd2d32acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:44.817829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508996f-9e30-4a31-b62f-335bd2d32acd None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:44.823759 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5233d39-9c71-4b15-b782-49a53e461aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:44.825217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5233d39-9c71-4b15-b782-49a53e461aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:44.825477 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5233d39-9c71-4b15-b782-49a53e461aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:44.825818 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5233d39-9c71-4b15-b782-49a53e461aa6 admin admin] PATH_INFO: `/v3/projects/a619feddc095483db62bc6187eb49ac4` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:44.827090 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5233d39-9c71-4b15-b782-49a53e461aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a619feddc095483db62bc6187eb49ac4)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:44.829385 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5233d39-9c71-4b15-b782-49a53e461aa6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:44.839749 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04f991-f61c-404a-8906-d7a78b2d3582 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:44.840320 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04f991-f61c-404a-8906-d7a78b2d3582 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:44.840821 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04f991-f61c-404a-8906-d7a78b2d3582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:44.858331 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5d04f991-f61c-404a-8906-d7a78b2d3582 None None] MFA Rules not processed for user `fc9b5f276d17426fa2dca5dd1d35505e`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:44.859722 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5d04f991-f61c-404a-8906-d7a78b2d3582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:44.878272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a5233d39-9c71-4b15-b782-49a53e461aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a619feddc095483db62bc6187eb49ac4', 'request_id': 'req-a5233d39-9c71-4b15-b782-49a53e461aa6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:44.884407 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a5233d39-9c71-4b15-b782-49a53e461aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a619feddc095483db62bc6187eb49ac4', 'request_id': 'req-a5233d39-9c71-4b15-b782-49a53e461aa6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:44.892286 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a5233d39-9c71-4b15-b782-49a53e461aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a619feddc095483db62bc6187eb49ac4', 'request_id': 'req-a5233d39-9c71-4b15-b782-49a53e461aa6'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:44.902251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a5233d39-9c71-4b15-b782-49a53e461aa6 admin admin] The token cache is being invalidate because project a619feddc095483db62bc6187eb49ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:11:44.902799 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a5233d39-9c71-4b15-b782-49a53e461aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:44.903574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-a5233d39-9c71-4b15-b782-49a53e461aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:44.905139 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1303/2585] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:11:44 2022] DELETE /identity/v3/projects/a619feddc095483db62bc6187eb49ac4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:44.908877 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5233d39-9c71-4b15-b782-49a53e461aa6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:44.910197 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a5233d39-9c71-4b15-b782-49a53e461aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:44.916918 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1283/2586] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:11:44.979180 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5233d39-9c71-4b15-b782-49a53e461aa6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:44.984116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578c10d-3075-406c-bdcd-6e0aaeca34ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:44.985023 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578c10d-3075-406c-bdcd-6e0aaeca34ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:44.985302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578c10d-3075-406c-bdcd-6e0aaeca34ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:44.985573 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578c10d-3075-406c-bdcd-6e0aaeca34ba admin admin] PATH_INFO: `/v3/users/0f92f0a7805a426bbe648ae9de843c68` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:44.986771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578c10d-3075-406c-bdcd-6e0aaeca34ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f92f0a7805a426bbe648ae9de843c68)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:44.988682 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578c10d-3075-406c-bdcd-6e0aaeca34ba admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:45.035353 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5578c10d-3075-406c-bdcd-6e0aaeca34ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f92f0a7805a426bbe648ae9de843c68'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:45.036159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5578c10d-3075-406c-bdcd-6e0aaeca34ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f92f0a7805a426bbe648ae9de843c68'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:45.036903 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5578c10d-3075-406c-bdcd-6e0aaeca34ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f92f0a7805a426bbe648ae9de843c68'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:45.044922 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5578c10d-3075-406c-bdcd-6e0aaeca34ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f92f0a7805a426bbe648ae9de843c68'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:45.056457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-5578c10d-3075-406c-bdcd-6e0aaeca34ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f92f0a7805a426bbe648ae9de843c68'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:45.069977 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1304/2587] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:11:44 2022] DELETE /identity/v3/users/0f92f0a7805a426bbe648ae9de843c68 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:11:45.254460 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04f991-f61c-404a-8906-d7a78b2d3582 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:45.255896 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5d04f991-f61c-404a-8906-d7a78b2d3582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:45.269688 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04f991-f61c-404a-8906-d7a78b2d3582 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:45.321208 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f98c3-9996-4ec0-9fe2-f643ffeb9048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:45.321880 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f98c3-9996-4ec0-9fe2-f643ffeb9048 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:45.322141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f98c3-9996-4ec0-9fe2-f643ffeb9048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:45.322553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f98c3-9996-4ec0-9fe2-f643ffeb9048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:45.325145 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c71f98c3-9996-4ec0-9fe2-f643ffeb9048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:45.335043 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f98c3-9996-4ec0-9fe2-f643ffeb9048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:45.336518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f98c3-9996-4ec0-9fe2-f643ffeb9048 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:45.344439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1284/2588] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:45.399575 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578c10d-3075-406c-bdcd-6e0aaeca34ba admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:45.401195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5578c10d-3075-406c-bdcd-6e0aaeca34ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:45.472876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578c10d-3075-406c-bdcd-6e0aaeca34ba admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:45.477298 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb73858-5f82-4914-aa57-8b5d76e1d29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:45.478148 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb73858-5f82-4914-aa57-8b5d76e1d29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:45.478425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb73858-5f82-4914-aa57-8b5d76e1d29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:45.478696 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb73858-5f82-4914-aa57-8b5d76e1d29e admin admin] PATH_INFO: `/v3/projects/17d2233bb77f4d728e6ee455d5733d0e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:45.479982 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb73858-5f82-4914-aa57-8b5d76e1d29e admin admin] RBAC: Authorizing `identity:delete_project(project_id=17d2233bb77f4d728e6ee455d5733d0e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:45.482516 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb73858-5f82-4914-aa57-8b5d76e1d29e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:45.533269 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0bb73858-5f82-4914-aa57-8b5d76e1d29e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17d2233bb77f4d728e6ee455d5733d0e', 'request_id': 'req-0bb73858-5f82-4914-aa57-8b5d76e1d29e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:45.539316 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0bb73858-5f82-4914-aa57-8b5d76e1d29e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17d2233bb77f4d728e6ee455d5733d0e', 'request_id': 'req-0bb73858-5f82-4914-aa57-8b5d76e1d29e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:45.547250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0bb73858-5f82-4914-aa57-8b5d76e1d29e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17d2233bb77f4d728e6ee455d5733d0e', 'request_id': 'req-0bb73858-5f82-4914-aa57-8b5d76e1d29e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:45.557928 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0bb73858-5f82-4914-aa57-8b5d76e1d29e admin admin] The token cache is being invalidate because project 17d2233bb77f4d728e6ee455d5733d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:11:45.558063 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0bb73858-5f82-4914-aa57-8b5d76e1d29e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:45.558704 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0bb73858-5f82-4914-aa57-8b5d76e1d29e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:45.561212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1305/2589] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:11:45 2022] DELETE /identity/v3/projects/17d2233bb77f4d728e6ee455d5733d0e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:45.567161 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6751cd2-a37c-4ed4-b1ad-6ad197cf2d0e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:45.567449 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6751cd2-a37c-4ed4-b1ad-6ad197cf2d0e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:45.567744 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6751cd2-a37c-4ed4-b1ad-6ad197cf2d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:45.585859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d6751cd2-a37c-4ed4-b1ad-6ad197cf2d0e None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:45.587236 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d6751cd2-a37c-4ed4-b1ad-6ad197cf2d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:45.648017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1285/2590] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:45.656152 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086ef6e-3243-4753-9d59-661ba6790ed2 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:45.656288 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086ef6e-3243-4753-9d59-661ba6790ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:45.656572 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086ef6e-3243-4753-9d59-661ba6790ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:45.675742 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2086ef6e-3243-4753-9d59-661ba6790ed2 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:45.676965 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2086ef6e-3243-4753-9d59-661ba6790ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:45.685646 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1306/2591] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:45.690009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6751cd2-a37c-4ed4-b1ad-6ad197cf2d0e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:45.699693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6751cd2-a37c-4ed4-b1ad-6ad197cf2d0e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:45.704712 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31622c7b-a51d-49c0-b6ab-ad3572cf0dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:45.705392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31622c7b-a51d-49c0-b6ab-ad3572cf0dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:45.705674 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31622c7b-a51d-49c0-b6ab-ad3572cf0dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:45.705947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31622c7b-a51d-49c0-b6ab-ad3572cf0dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:45.706666 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31622c7b-a51d-49c0-b6ab-ad3572cf0dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:11:45.706969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31622c7b-a51d-49c0-b6ab-ad3572cf0dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:45.708578 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31622c7b-a51d-49c0-b6ab-ad3572cf0dcc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:45.720710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1286/2592] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:11:45.725325 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086ef6e-3243-4753-9d59-661ba6790ed2 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:45.735359 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086ef6e-3243-4753-9d59-661ba6790ed2 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:45.740332 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d74b2-2915-4fdd-93dd-2ac0383ce8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:45.741021 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d74b2-2915-4fdd-93dd-2ac0383ce8cb admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:45.741301 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d74b2-2915-4fdd-93dd-2ac0383ce8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:45.741622 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d74b2-2915-4fdd-93dd-2ac0383ce8cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:45.742314 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d74b2-2915-4fdd-93dd-2ac0383ce8cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:45.744221 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d74b2-2915-4fdd-93dd-2ac0383ce8cb admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:45.757485 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31622c7b-a51d-49c0-b6ab-ad3572cf0dcc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:45.759713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-31622c7b-a51d-49c0-b6ab-ad3572cf0dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:45.780703 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1307/2593] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:11:45 2022] POST /identity/v3/projects => generated 409 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:11:45.781709 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d74b2-2915-4fdd-93dd-2ac0383ce8cb admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:45.856090 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31622c7b-a51d-49c0-b6ab-ad3572cf0dcc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:45.868067 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d74b2-2915-4fdd-93dd-2ac0383ce8cb admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:45.877410 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43103a7e-507e-47e9-a115-5865551a3197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:45.878090 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43103a7e-507e-47e9-a115-5865551a3197 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:45.878375 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43103a7e-507e-47e9-a115-5865551a3197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:45.878651 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43103a7e-507e-47e9-a115-5865551a3197 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:45.879338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43103a7e-507e-47e9-a115-5865551a3197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:45.881337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43103a7e-507e-47e9-a115-5865551a3197 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:45.910772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1308/2594] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:11:45 2022] POST /identity/v3/users => generated 305 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:11:45.911603 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43103a7e-507e-47e9-a115-5865551a3197 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:45.913229 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-43103a7e-507e-47e9-a115-5865551a3197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:45.925168 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13446c-3f6a-41be-966e-e61810a4d02c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:45.925821 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13446c-3f6a-41be-966e-e61810a4d02c service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:45.926096 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13446c-3f6a-41be-966e-e61810a4d02c service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:45.926369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13446c-3f6a-41be-966e-e61810a4d02c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:45.928115 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0f13446c-3f6a-41be-966e-e61810a4d02c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:45.980771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43103a7e-507e-47e9-a115-5865551a3197 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:45.986201 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434ffa6-0316-42ff-b49d-b51bffac0c58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8489647547d544a681131dad99e058bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:45.986914 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434ffa6-0316-42ff-b49d-b51bffac0c58 service placement] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:45.987079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13446c-3f6a-41be-966e-e61810a4d02c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:45.987208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434ffa6-0316-42ff-b49d-b51bffac0c58 service placement] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:45.987484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434ffa6-0316-42ff-b49d-b51bffac0c58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:45.989019 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13446c-3f6a-41be-966e-e61810a4d02c service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:45.989683 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c434ffa6-0316-42ff-b49d-b51bffac0c58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:45.999189 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1287/2595] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:11:46.000193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13446c-3f6a-41be-966e-e61810a4d02c service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:46.004081 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434ffa6-0316-42ff-b49d-b51bffac0c58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:46.005772 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434ffa6-0316-42ff-b49d-b51bffac0c58 service placement] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:46.011403 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13446c-3f6a-41be-966e-e61810a4d02c service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:46.016646 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97143005-581a-4f7f-a147-6d82fb25993d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:46.017202 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1309/2596] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:46.017765 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97143005-581a-4f7f-a147-6d82fb25993d admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:46.018048 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97143005-581a-4f7f-a147-6d82fb25993d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:46.018398 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97143005-581a-4f7f-a147-6d82fb25993d admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:46.019125 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97143005-581a-4f7f-a147-6d82fb25993d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:46.020728 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97143005-581a-4f7f-a147-6d82fb25993d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:46.031415 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1288/2597] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:46.035999 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434ffa6-0316-42ff-b49d-b51bffac0c58 service placement] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:46.048717 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434ffa6-0316-42ff-b49d-b51bffac0c58 service placement] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:46.054407 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c8042-9d1a-4be8-a7d2-65e0bc884a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:46.055065 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c8042-9d1a-4be8-a7d2-65e0bc884a01 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:46.055350 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c8042-9d1a-4be8-a7d2-65e0bc884a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:46.055625 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c8042-9d1a-4be8-a7d2-65e0bc884a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:46.056499 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c8042-9d1a-4be8-a7d2-65e0bc884a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:46.058169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c8042-9d1a-4be8-a7d2-65e0bc884a01 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:46.070232 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1310/2598] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:11:46.074374 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97143005-581a-4f7f-a147-6d82fb25993d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:46.085373 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97143005-581a-4f7f-a147-6d82fb25993d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:46.094811 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad8f64-f43f-49f0-9e00-e43a3e5f4e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:46.095768 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad8f64-f43f-49f0-9e00-e43a3e5f4e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:46.096111 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad8f64-f43f-49f0-9e00-e43a3e5f4e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:46.096453 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad8f64-f43f-49f0-9e00-e43a3e5f4e27 admin admin] PATH_INFO: `/v3/projects/4169ba8942d34dda97e8af915ce98d6e/users/23f9ac27de2c4ab6b4249ae50b92489d/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:46.114805 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad8f64-f43f-49f0-9e00-e43a3e5f4e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4169ba8942d34dda97e8af915ce98d6e, user_id=23f9ac27de2c4ab6b4249ae50b92489d, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:46.117735 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad8f64-f43f-49f0-9e00-e43a3e5f4e27 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:46.132390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1289/2599] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:11:46 2022] PUT /identity/v3/projects/4169ba8942d34dda97e8af915ce98d6e/users/23f9ac27de2c4ab6b4249ae50b92489d/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:46.143691 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4aaa-715e-426a-bbde-4c56be72770b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:46.144051 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4aaa-715e-426a-bbde-4c56be72770b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:46.144406 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4aaa-715e-426a-bbde-4c56be72770b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:46.177855 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3dfd4aaa-715e-426a-bbde-4c56be72770b None None] MFA Rules not processed for user `23f9ac27de2c4ab6b4249ae50b92489d`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:46.179429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3dfd4aaa-715e-426a-bbde-4c56be72770b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:46.257888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1311/2600] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:46.259376 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad8f64-f43f-49f0-9e00-e43a3e5f4e27 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:46.389258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad8f64-f43f-49f0-9e00-e43a3e5f4e27 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:46.395677 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143df6f-9149-41a2-986f-f838d4483b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:46.396489 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143df6f-9149-41a2-986f-f838d4483b8d admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:46.396767 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143df6f-9149-41a2-986f-f838d4483b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:46.397445 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143df6f-9149-41a2-986f-f838d4483b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:46.398597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143df6f-9149-41a2-986f-f838d4483b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:46.401059 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143df6f-9149-41a2-986f-f838d4483b8d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:46.438381 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1290/2601] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:11:46 2022] POST /identity/v3/projects => generated 409 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:11:46.442545 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd4aaa-715e-426a-bbde-4c56be72770b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:46.456907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd4aaa-715e-426a-bbde-4c56be72770b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:46.521665 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6725f7f-aa8a-4eab-b7be-5f8a1f488018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:46.522340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6725f7f-aa8a-4eab-b7be-5f8a1f488018 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:46.522625 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6725f7f-aa8a-4eab-b7be-5f8a1f488018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:46.523039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6725f7f-aa8a-4eab-b7be-5f8a1f488018 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:46.523737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6725f7f-aa8a-4eab-b7be-5f8a1f488018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:46.525734 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6725f7f-aa8a-4eab-b7be-5f8a1f488018 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:46.549074 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1312/2602] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:11:46 2022] POST /identity/v3/users => generated 311 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:11:46.551182 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143df6f-9149-41a2-986f-f838d4483b8d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:46.562028 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143df6f-9149-41a2-986f-f838d4483b8d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:46.566906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37495fcf-113c-45e9-b886-7446f6062b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:46.567480 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37495fcf-113c-45e9-b886-7446f6062b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:46.567758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37495fcf-113c-45e9-b886-7446f6062b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:46.568217 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37495fcf-113c-45e9-b886-7446f6062b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:46.569202 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37495fcf-113c-45e9-b886-7446f6062b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:46.570891 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37495fcf-113c-45e9-b886-7446f6062b6e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:46.586427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1291/2603] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:46.591398 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6725f7f-aa8a-4eab-b7be-5f8a1f488018 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:46.602381 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6725f7f-aa8a-4eab-b7be-5f8a1f488018 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:46.608969 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5d327-8234-42d3-8a57-c336213f8798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:46.609862 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5d327-8234-42d3-8a57-c336213f8798 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:46.610189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5d327-8234-42d3-8a57-c336213f8798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:46.610460 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5d327-8234-42d3-8a57-c336213f8798 admin admin] PATH_INFO: `/v3/projects/91de124356c3474fbf0980d18d4f83e3/users/2ef2afd6f5f54036864232f3ba33ba13/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:46.628298 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5d327-8234-42d3-8a57-c336213f8798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91de124356c3474fbf0980d18d4f83e3, user_id=2ef2afd6f5f54036864232f3ba33ba13, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:46.631530 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5d327-8234-42d3-8a57-c336213f8798 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:46.648206 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1313/2604] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:11:46 2022] PUT /identity/v3/projects/91de124356c3474fbf0980d18d4f83e3/users/2ef2afd6f5f54036864232f3ba33ba13/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:46.649423 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37495fcf-113c-45e9-b886-7446f6062b6e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:46.661107 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37495fcf-113c-45e9-b886-7446f6062b6e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:46.727258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ff5d1-7436-4e50-98ba-a2bf1587bc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:46.728035 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ff5d1-7436-4e50-98ba-a2bf1587bc16 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:46.728318 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ff5d1-7436-4e50-98ba-a2bf1587bc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:46.728597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ff5d1-7436-4e50-98ba-a2bf1587bc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:46.729361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ff5d1-7436-4e50-98ba-a2bf1587bc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:46.731575 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ff5d1-7436-4e50-98ba-a2bf1587bc16 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:46.741554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1292/2605] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:46.745603 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5d327-8234-42d3-8a57-c336213f8798 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:46.756449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5d327-8234-42d3-8a57-c336213f8798 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:46.761120 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae22b7-86aa-4984-92c4-ef32e3a18ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:46.762628 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae22b7-86aa-4984-92c4-ef32e3a18ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:46.762906 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae22b7-86aa-4984-92c4-ef32e3a18ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:46.763169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae22b7-86aa-4984-92c4-ef32e3a18ec2 admin admin] PATH_INFO: `/v3/projects/91de124356c3474fbf0980d18d4f83e3/users/2ef2afd6f5f54036864232f3ba33ba13/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:46.765787 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae22b7-86aa-4984-92c4-ef32e3a18ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91de124356c3474fbf0980d18d4f83e3, user_id=2ef2afd6f5f54036864232f3ba33ba13, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:46.768500 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae22b7-86aa-4984-92c4-ef32e3a18ec2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:46.779026 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1314/2606] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:11:46 2022] PUT /identity/v3/projects/91de124356c3474fbf0980d18d4f83e3/users/2ef2afd6f5f54036864232f3ba33ba13/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:46.790132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d9f8d-58e4-4054-bf0e-cede5d5adddf None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:46.790421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d9f8d-58e4-4054-bf0e-cede5d5adddf None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:46.790701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d9f8d-58e4-4054-bf0e-cede5d5adddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:46.817486 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e21d9f8d-58e4-4054-bf0e-cede5d5adddf None None] MFA Rules not processed for user `2ef2afd6f5f54036864232f3ba33ba13`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:46.818684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e21d9f8d-58e4-4054-bf0e-cede5d5adddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:46.888899 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1293/2607] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:46 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:46.900145 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae22b7-86aa-4984-92c4-ef32e3a18ec2 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:46.901994 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-beae22b7-86aa-4984-92c4-ef32e3a18ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:46.966615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae22b7-86aa-4984-92c4-ef32e3a18ec2 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:46.978234 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee27e80-de4c-451b-8464-98c54b7eed38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:46.979190 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee27e80-de4c-451b-8464-98c54b7eed38 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:46.993830 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee27e80-de4c-451b-8464-98c54b7eed38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:46.993830 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee27e80-de4c-451b-8464-98c54b7eed38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:46.998387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee27e80-de4c-451b-8464-98c54b7eed38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:47.000176 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee27e80-de4c-451b-8464-98c54b7eed38 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:47.012970 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1315/2608] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:46 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:47.176589 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d9f8d-58e4-4054-bf0e-cede5d5adddf None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:47.178043 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e21d9f8d-58e4-4054-bf0e-cede5d5adddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:47.192075 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d9f8d-58e4-4054-bf0e-cede5d5adddf None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:47.195990 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695bafc-2b6d-4c1f-a68c-469237719606 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:47.196868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695bafc-2b6d-4c1f-a68c-469237719606 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:47.197242 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695bafc-2b6d-4c1f-a68c-469237719606 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:47.197611 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695bafc-2b6d-4c1f-a68c-469237719606 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:47.256175 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695bafc-2b6d-4c1f-a68c-469237719606 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:47.257692 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695bafc-2b6d-4c1f-a68c-469237719606 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:47.268247 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1294/2609] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:47 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:47.815950 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee27e80-de4c-451b-8464-98c54b7eed38 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:47.818525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2ee27e80-de4c-451b-8464-98c54b7eed38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:47.908922 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee27e80-de4c-451b-8464-98c54b7eed38 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:47.924124 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c78b7-0005-4926-8436-5a4c144929d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:47.925179 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c78b7-0005-4926-8436-5a4c144929d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:47.925686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c78b7-0005-4926-8436-5a4c144929d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:47.926114 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c78b7-0005-4926-8436-5a4c144929d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:47.930060 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-136c78b7-0005-4926-8436-5a4c144929d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:47.944966 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c78b7-0005-4926-8436-5a4c144929d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:47.946574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c78b7-0005-4926-8436-5a4c144929d2 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:47.958876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1316/2610] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:54.712211 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695bafc-2b6d-4c1f-a68c-469237719606 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:54.778379 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695bafc-2b6d-4c1f-a68c-469237719606 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:54.784319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a226c-129e-4cfd-bb9c-64353e54c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:54.785251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a226c-129e-4cfd-bb9c-64353e54c89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:54.785530 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a226c-129e-4cfd-bb9c-64353e54c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:54.785807 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a226c-129e-4cfd-bb9c-64353e54c89a admin admin] PATH_INFO: `/v3/users/23f9ac27de2c4ab6b4249ae50b92489d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:54.787010 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a226c-129e-4cfd-bb9c-64353e54c89a admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f9ac27de2c4ab6b4249ae50b92489d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:54.788996 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a226c-129e-4cfd-bb9c-64353e54c89a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:54.837877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-961a226c-129e-4cfd-bb9c-64353e54c89a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f9ac27de2c4ab6b4249ae50b92489d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:54.838521 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-961a226c-129e-4cfd-bb9c-64353e54c89a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f9ac27de2c4ab6b4249ae50b92489d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:54.839120 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-961a226c-129e-4cfd-bb9c-64353e54c89a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f9ac27de2c4ab6b4249ae50b92489d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:54.847234 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-961a226c-129e-4cfd-bb9c-64353e54c89a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f9ac27de2c4ab6b4249ae50b92489d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:54.859501 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-961a226c-129e-4cfd-bb9c-64353e54c89a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f9ac27de2c4ab6b4249ae50b92489d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:54.871163 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1295/2611] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:11:54 2022] DELETE /identity/v3/users/23f9ac27de2c4ab6b4249ae50b92489d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:54.875729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fea7d-1ee9-4e86-904a-08bab1c3ce6b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:54.876215 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fea7d-1ee9-4e86-904a-08bab1c3ce6b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:54.876324 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fea7d-1ee9-4e86-904a-08bab1c3ce6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:54.893096 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-558fea7d-1ee9-4e86-904a-08bab1c3ce6b None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:54.894279 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-558fea7d-1ee9-4e86-904a-08bab1c3ce6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:54.953149 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1317/2612] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:11:54.962765 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a226c-129e-4cfd-bb9c-64353e54c89a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:54.964142 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-961a226c-129e-4cfd-bb9c-64353e54c89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:55.023894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a226c-129e-4cfd-bb9c-64353e54c89a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:55.027907 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca66fea-a4fd-4e94-bd54-63103ac3c818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:55.028895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca66fea-a4fd-4e94-bd54-63103ac3c818 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:55.029173 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca66fea-a4fd-4e94-bd54-63103ac3c818 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:55.029439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca66fea-a4fd-4e94-bd54-63103ac3c818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:55.038232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca66fea-a4fd-4e94-bd54-63103ac3c818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:55.039651 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca66fea-a4fd-4e94-bd54-63103ac3c818 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:55.049755 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1296/2613] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:55.319211 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fea7d-1ee9-4e86-904a-08bab1c3ce6b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:55.320768 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-558fea7d-1ee9-4e86-904a-08bab1c3ce6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:55.333660 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fea7d-1ee9-4e86-904a-08bab1c3ce6b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:55.338516 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e026a3-3046-4ae8-8da5-efd19c860a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:55.339451 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e026a3-3046-4ae8-8da5-efd19c860a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:55.339824 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e026a3-3046-4ae8-8da5-efd19c860a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:55.340171 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e026a3-3046-4ae8-8da5-efd19c860a9b admin admin] PATH_INFO: `/v3/projects/4169ba8942d34dda97e8af915ce98d6e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:55.341552 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e026a3-3046-4ae8-8da5-efd19c860a9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4169ba8942d34dda97e8af915ce98d6e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:55.343535 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e026a3-3046-4ae8-8da5-efd19c860a9b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:55.390230 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-40e026a3-3046-4ae8-8da5-efd19c860a9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4169ba8942d34dda97e8af915ce98d6e', 'request_id': 'req-40e026a3-3046-4ae8-8da5-efd19c860a9b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:55.396408 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-40e026a3-3046-4ae8-8da5-efd19c860a9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4169ba8942d34dda97e8af915ce98d6e', 'request_id': 'req-40e026a3-3046-4ae8-8da5-efd19c860a9b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:55.404036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-40e026a3-3046-4ae8-8da5-efd19c860a9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4169ba8942d34dda97e8af915ce98d6e', 'request_id': 'req-40e026a3-3046-4ae8-8da5-efd19c860a9b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:55.414563 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-40e026a3-3046-4ae8-8da5-efd19c860a9b admin admin] The token cache is being invalidate because project 4169ba8942d34dda97e8af915ce98d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:11:55.414851 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-40e026a3-3046-4ae8-8da5-efd19c860a9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:55.415546 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-40e026a3-3046-4ae8-8da5-efd19c860a9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:55.417186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1318/2614] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:11:55 2022] DELETE /identity/v3/projects/4169ba8942d34dda97e8af915ce98d6e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:55.421756 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca66fea-a4fd-4e94-bd54-63103ac3c818 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:55.431171 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca66fea-a4fd-4e94-bd54-63103ac3c818 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:55.485897 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abbf90-5695-4bff-a82e-d75d50653d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:55.486760 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abbf90-5695-4bff-a82e-d75d50653d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:55.487040 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abbf90-5695-4bff-a82e-d75d50653d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:55.487316 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abbf90-5695-4bff-a82e-d75d50653d46 admin admin] PATH_INFO: `/v3/users/2ef2afd6f5f54036864232f3ba33ba13` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:55.488488 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abbf90-5695-4bff-a82e-d75d50653d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ef2afd6f5f54036864232f3ba33ba13)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:55.490445 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abbf90-5695-4bff-a82e-d75d50653d46 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:55.534184 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-14abbf90-5695-4bff-a82e-d75d50653d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ef2afd6f5f54036864232f3ba33ba13'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:55.534816 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-14abbf90-5695-4bff-a82e-d75d50653d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ef2afd6f5f54036864232f3ba33ba13'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:55.535415 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-14abbf90-5695-4bff-a82e-d75d50653d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ef2afd6f5f54036864232f3ba33ba13'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:55.543887 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-14abbf90-5695-4bff-a82e-d75d50653d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ef2afd6f5f54036864232f3ba33ba13'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:55.555508 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-14abbf90-5695-4bff-a82e-d75d50653d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ef2afd6f5f54036864232f3ba33ba13'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:55.567250 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1297/2615] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:11:55 2022] DELETE /identity/v3/users/2ef2afd6f5f54036864232f3ba33ba13 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:55.826019 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e026a3-3046-4ae8-8da5-efd19c860a9b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:55.827437 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-40e026a3-3046-4ae8-8da5-efd19c860a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:55.840631 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e026a3-3046-4ae8-8da5-efd19c860a9b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:55.924504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1f4d3-cd2f-4466-8655-657ab65339fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:55.925437 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1f4d3-cd2f-4466-8655-657ab65339fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:55.925723 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1f4d3-cd2f-4466-8655-657ab65339fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:55.925999 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1f4d3-cd2f-4466-8655-657ab65339fa admin admin] PATH_INFO: `/v3/projects/91de124356c3474fbf0980d18d4f83e3` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:55.941611 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1f4d3-cd2f-4466-8655-657ab65339fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=91de124356c3474fbf0980d18d4f83e3)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:55.941611 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1f4d3-cd2f-4466-8655-657ab65339fa admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:55.989093 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6ea1f4d3-cd2f-4466-8655-657ab65339fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91de124356c3474fbf0980d18d4f83e3', 'request_id': 'req-6ea1f4d3-cd2f-4466-8655-657ab65339fa'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:55.996127 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6ea1f4d3-cd2f-4466-8655-657ab65339fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91de124356c3474fbf0980d18d4f83e3', 'request_id': 'req-6ea1f4d3-cd2f-4466-8655-657ab65339fa'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:56.004836 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6ea1f4d3-cd2f-4466-8655-657ab65339fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91de124356c3474fbf0980d18d4f83e3', 'request_id': 'req-6ea1f4d3-cd2f-4466-8655-657ab65339fa'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:56.016859 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6ea1f4d3-cd2f-4466-8655-657ab65339fa admin admin] The token cache is being invalidate because project 91de124356c3474fbf0980d18d4f83e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:11:56.017123 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6ea1f4d3-cd2f-4466-8655-657ab65339fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:56.017944 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-6ea1f4d3-cd2f-4466-8655-657ab65339fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:56.019482 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1319/2616] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:11:55 2022] DELETE /identity/v3/projects/91de124356c3474fbf0980d18d4f83e3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:11:56.024724 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc0d83-977b-46e1-b6d8-3aa47838b70c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:56.025252 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc0d83-977b-46e1-b6d8-3aa47838b70c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:56.025509 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc0d83-977b-46e1-b6d8-3aa47838b70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:56.047408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b9fc0d83-977b-46e1-b6d8-3aa47838b70c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:56.048595 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b9fc0d83-977b-46e1-b6d8-3aa47838b70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:56.114197 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1298/2617] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:56.123438 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183871c7-265d-4e55-817c-b5bff207b013 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:56.123829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183871c7-265d-4e55-817c-b5bff207b013 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:56.124203 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183871c7-265d-4e55-817c-b5bff207b013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:56.146906 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-183871c7-265d-4e55-817c-b5bff207b013 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:56.148262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-183871c7-265d-4e55-817c-b5bff207b013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:56.161349 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1320/2618] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:56.162740 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc0d83-977b-46e1-b6d8-3aa47838b70c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:56.173071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc0d83-977b-46e1-b6d8-3aa47838b70c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:56.177651 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8826b14-1453-4867-8568-14413db3c49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:56.178301 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8826b14-1453-4867-8568-14413db3c49a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:56.178576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8826b14-1453-4867-8568-14413db3c49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:56.178866 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8826b14-1453-4867-8568-14413db3c49a admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:56.179568 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8826b14-1453-4867-8568-14413db3c49a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:11:56.179870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8826b14-1453-4867-8568-14413db3c49a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:56.181505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8826b14-1453-4867-8568-14413db3c49a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:56.193807 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1299/2619] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 05:11:56.198376 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183871c7-265d-4e55-817c-b5bff207b013 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:56.208446 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183871c7-265d-4e55-817c-b5bff207b013 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:56.213262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fadc19-d330-4509-9c01-4cc783e66780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:56.213925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fadc19-d330-4509-9c01-4cc783e66780 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:56.214206 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fadc19-d330-4509-9c01-4cc783e66780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:56.214481 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fadc19-d330-4509-9c01-4cc783e66780 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:56.215725 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fadc19-d330-4509-9c01-4cc783e66780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:56.217710 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fadc19-d330-4509-9c01-4cc783e66780 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:56.247933 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1321/2620] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:11:56 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:11:56.249233 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8826b14-1453-4867-8568-14413db3c49a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:56.259115 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8826b14-1453-4867-8568-14413db3c49a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:56.316038 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bd07b-79dd-401b-8ef9-ac9c5c4dbe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:56.316710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bd07b-79dd-401b-8ef9-ac9c5c4dbe7e admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:56.317020 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bd07b-79dd-401b-8ef9-ac9c5c4dbe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:56.317298 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bd07b-79dd-401b-8ef9-ac9c5c4dbe7e admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:56.318020 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2bd07b-79dd-401b-8ef9-ac9c5c4dbe7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:56.320065 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2bd07b-79dd-401b-8ef9-ac9c5c4dbe7e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:56.340629 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1300/2621] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:11:56 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:11:56.344579 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fadc19-d330-4509-9c01-4cc783e66780 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:56.354788 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fadc19-d330-4509-9c01-4cc783e66780 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:56.359401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f93191-7630-44e9-b142-07f0f90db653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:56.360047 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93191-7630-44e9-b142-07f0f90db653 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:56.360331 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93191-7630-44e9-b142-07f0f90db653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:56.360605 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93191-7630-44e9-b142-07f0f90db653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:56.361370 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f93191-7630-44e9-b142-07f0f90db653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:56.362987 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f93191-7630-44e9-b142-07f0f90db653 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:56.373669 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1322/2622] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:56.377442 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bd07b-79dd-401b-8ef9-ac9c5c4dbe7e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:56.387726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bd07b-79dd-401b-8ef9-ac9c5c4dbe7e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:56.392716 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a92bc7-9d12-4d2f-8b7c-498532a83a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:56.393391 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a92bc7-9d12-4d2f-8b7c-498532a83a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:56.393752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a92bc7-9d12-4d2f-8b7c-498532a83a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:56.394025 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a92bc7-9d12-4d2f-8b7c-498532a83a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:56.394778 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a92bc7-9d12-4d2f-8b7c-498532a83a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:56.396365 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a92bc7-9d12-4d2f-8b7c-498532a83a54 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:56.406313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1301/2623] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:56.410351 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f93191-7630-44e9-b142-07f0f90db653 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:56.420518 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f93191-7630-44e9-b142-07f0f90db653 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:56.425177 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea9bd-1dd5-4b42-a5ec-f5c9cabdae94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:56.426046 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea9bd-1dd5-4b42-a5ec-f5c9cabdae94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:56.426329 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea9bd-1dd5-4b42-a5ec-f5c9cabdae94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:56.426602 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea9bd-1dd5-4b42-a5ec-f5c9cabdae94 admin admin] PATH_INFO: `/v3/projects/148e4f38f34244bf8932e6c854a14b8a/users/ac7e050943f74496b8aed27a5941f81f/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:56.441213 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ea9bd-1dd5-4b42-a5ec-f5c9cabdae94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=148e4f38f34244bf8932e6c854a14b8a, user_id=ac7e050943f74496b8aed27a5941f81f, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:56.443888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ea9bd-1dd5-4b42-a5ec-f5c9cabdae94 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:56.457405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1323/2624] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:11:56 2022] PUT /identity/v3/projects/148e4f38f34244bf8932e6c854a14b8a/users/ac7e050943f74496b8aed27a5941f81f/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:56.467592 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74be63f-1246-4938-a4cc-edaee4653f45 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:56.467880 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74be63f-1246-4938-a4cc-edaee4653f45 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:56.468161 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74be63f-1246-4938-a4cc-edaee4653f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:56.493519 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b74be63f-1246-4938-a4cc-edaee4653f45 None None] MFA Rules not processed for user `ac7e050943f74496b8aed27a5941f81f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:56.494720 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b74be63f-1246-4938-a4cc-edaee4653f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:56.556600 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1302/2625] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:56.568523 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea9bd-1dd5-4b42-a5ec-f5c9cabdae94 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:56.570234 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-392ea9bd-1dd5-4b42-a5ec-f5c9cabdae94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:56.626076 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea9bd-1dd5-4b42-a5ec-f5c9cabdae94 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:56.629691 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999d42a-bd9e-4330-909a-b6dc8957c5e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:56.630314 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999d42a-bd9e-4330-909a-b6dc8957c5e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:56.630590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999d42a-bd9e-4330-909a-b6dc8957c5e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:56.630859 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999d42a-bd9e-4330-909a-b6dc8957c5e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:56.639332 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999d42a-bd9e-4330-909a-b6dc8957c5e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:56.641040 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999d42a-bd9e-4330-909a-b6dc8957c5e9 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:56.650014 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1324/2626] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:56.675481 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74be63f-1246-4938-a4cc-edaee4653f45 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:56.734796 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74be63f-1246-4938-a4cc-edaee4653f45 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:56.739384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6cb96-4468-42a2-969b-5455d091b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:56.740239 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6cb96-4468-42a2-969b-5455d091b1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:56.740517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6cb96-4468-42a2-969b-5455d091b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:56.740803 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6cb96-4468-42a2-969b-5455d091b1fd admin admin] PATH_INFO: `/v3/users/ac7e050943f74496b8aed27a5941f81f` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:56.742008 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6cb96-4468-42a2-969b-5455d091b1fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac7e050943f74496b8aed27a5941f81f)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:56.743914 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6cb96-4468-42a2-969b-5455d091b1fd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:56.787588 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-99f6cb96-4468-42a2-969b-5455d091b1fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac7e050943f74496b8aed27a5941f81f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:56.788242 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-99f6cb96-4468-42a2-969b-5455d091b1fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac7e050943f74496b8aed27a5941f81f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:56.788882 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-99f6cb96-4468-42a2-969b-5455d091b1fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac7e050943f74496b8aed27a5941f81f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:56.795770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-99f6cb96-4468-42a2-969b-5455d091b1fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac7e050943f74496b8aed27a5941f81f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:56.807709 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-99f6cb96-4468-42a2-969b-5455d091b1fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac7e050943f74496b8aed27a5941f81f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:56.819484 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1303/2627] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:11:56 2022] DELETE /identity/v3/users/ac7e050943f74496b8aed27a5941f81f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:56.823989 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e86d40-4ecf-49e2-9d2d-ceaabda64efb None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:56.824780 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e86d40-4ecf-49e2-9d2d-ceaabda64efb None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:56.825080 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e86d40-4ecf-49e2-9d2d-ceaabda64efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:56.842363 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-08e86d40-4ecf-49e2-9d2d-ceaabda64efb None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:56.843556 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-08e86d40-4ecf-49e2-9d2d-ceaabda64efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:56.900345 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1325/2628] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:56.910678 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6cb96-4468-42a2-969b-5455d091b1fd admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:56.912287 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-99f6cb96-4468-42a2-969b-5455d091b1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:56.970556 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6cb96-4468-42a2-969b-5455d091b1fd admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:56.974231 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf01574-4422-4479-a817-ab44ec702313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:56.974872 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf01574-4422-4479-a817-ab44ec702313 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:56.975154 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf01574-4422-4479-a817-ab44ec702313 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:56.975434 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf01574-4422-4479-a817-ab44ec702313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:56.985223 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf01574-4422-4479-a817-ab44ec702313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:56.986661 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf01574-4422-4479-a817-ab44ec702313 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:56.996086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1304/2629] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:11:57.315837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e86d40-4ecf-49e2-9d2d-ceaabda64efb None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:57.317359 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-08e86d40-4ecf-49e2-9d2d-ceaabda64efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:57.340203 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e86d40-4ecf-49e2-9d2d-ceaabda64efb None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:57.346762 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a2f5c-9023-4af6-a327-ae55cd122511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:57.347638 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a2f5c-9023-4af6-a327-ae55cd122511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:57.347977 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a2f5c-9023-4af6-a327-ae55cd122511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:57.348182 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a2f5c-9023-4af6-a327-ae55cd122511 admin admin] PATH_INFO: `/v3/projects/148e4f38f34244bf8932e6c854a14b8a` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:57.349678 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a2f5c-9023-4af6-a327-ae55cd122511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=148e4f38f34244bf8932e6c854a14b8a)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:57.351753 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a2f5c-9023-4af6-a327-ae55cd122511 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:57.399274 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-dd1a2f5c-9023-4af6-a327-ae55cd122511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '148e4f38f34244bf8932e6c854a14b8a', 'request_id': 'req-dd1a2f5c-9023-4af6-a327-ae55cd122511'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:57.405973 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-dd1a2f5c-9023-4af6-a327-ae55cd122511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '148e4f38f34244bf8932e6c854a14b8a', 'request_id': 'req-dd1a2f5c-9023-4af6-a327-ae55cd122511'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:57.413465 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-dd1a2f5c-9023-4af6-a327-ae55cd122511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '148e4f38f34244bf8932e6c854a14b8a', 'request_id': 'req-dd1a2f5c-9023-4af6-a327-ae55cd122511'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:57.424169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-dd1a2f5c-9023-4af6-a327-ae55cd122511 admin admin] The token cache is being invalidate because project 148e4f38f34244bf8932e6c854a14b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:11:57.424448 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-dd1a2f5c-9023-4af6-a327-ae55cd122511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:57.425099 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-dd1a2f5c-9023-4af6-a327-ae55cd122511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:11:57.426620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1326/2630] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:11:57 2022] DELETE /identity/v3/projects/148e4f38f34244bf8932e6c854a14b8a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:11:57.431852 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73acdb-57e2-43e1-bc8a-479065277cf6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:57.432341 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73acdb-57e2-43e1-bc8a-479065277cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:57.432643 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73acdb-57e2-43e1-bc8a-479065277cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:57.451665 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1d73acdb-57e2-43e1-bc8a-479065277cf6 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:57.452950 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1d73acdb-57e2-43e1-bc8a-479065277cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:57.516783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1305/2631] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:11:57.581565 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafd96b-9760-4618-8e39-a43f7d64c04f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:57.581852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafd96b-9760-4618-8e39-a43f7d64c04f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:57.582175 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafd96b-9760-4618-8e39-a43f7d64c04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:57.603263 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2eafd96b-9760-4618-8e39-a43f7d64c04f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:57.604484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2eafd96b-9760-4618-8e39-a43f7d64c04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:57.613186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1327/2632] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:57.617675 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73acdb-57e2-43e1-bc8a-479065277cf6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:57.627353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73acdb-57e2-43e1-bc8a-479065277cf6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:57.631855 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f6090-e2f4-44a1-93f2-73d2c726a0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:57.632499 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f6090-e2f4-44a1-93f2-73d2c726a0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:57.632777 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f6090-e2f4-44a1-93f2-73d2c726a0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:57.633082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f6090-e2f4-44a1-93f2-73d2c726a0c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:57.633797 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f6090-e2f4-44a1-93f2-73d2c726a0c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:11:57.634100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f6090-e2f4-44a1-93f2-73d2c726a0c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:57.635683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f6090-e2f4-44a1-93f2-73d2c726a0c6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:57.647977 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1306/2633] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:11:57.652029 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafd96b-9760-4618-8e39-a43f7d64c04f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:57.662116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafd96b-9760-4618-8e39-a43f7d64c04f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:57.666696 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716a066-2dfd-44d0-a179-a1fbd2e7f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:57.667268 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716a066-2dfd-44d0-a179-a1fbd2e7f2bb admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:57.667542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716a066-2dfd-44d0-a179-a1fbd2e7f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:57.667812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716a066-2dfd-44d0-a179-a1fbd2e7f2bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:57.668926 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716a066-2dfd-44d0-a179-a1fbd2e7f2bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:57.670799 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716a066-2dfd-44d0-a179-a1fbd2e7f2bb admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:57.697819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1328/2634] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:11:57 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:11:57.702793 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f6090-e2f4-44a1-93f2-73d2c726a0c6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:57.712660 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f6090-e2f4-44a1-93f2-73d2c726a0c6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:57.768284 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b25c1-5e80-4e15-9fb6-e1ff889fa235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:57.768965 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b25c1-5e80-4e15-9fb6-e1ff889fa235 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:57.769242 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b25c1-5e80-4e15-9fb6-e1ff889fa235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:57.769510 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b25c1-5e80-4e15-9fb6-e1ff889fa235 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:57.770192 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b25c1-5e80-4e15-9fb6-e1ff889fa235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:57.772090 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b25c1-5e80-4e15-9fb6-e1ff889fa235 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:57.791555 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1307/2635] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:11:57 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:11:57.795673 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716a066-2dfd-44d0-a179-a1fbd2e7f2bb admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:57.805569 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716a066-2dfd-44d0-a179-a1fbd2e7f2bb admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:57.810971 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723eabe-6b63-4943-842e-b47f4c138a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:57.811613 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723eabe-6b63-4943-842e-b47f4c138a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:57.811889 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723eabe-6b63-4943-842e-b47f4c138a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:57.812155 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723eabe-6b63-4943-842e-b47f4c138a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:57.812895 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723eabe-6b63-4943-842e-b47f4c138a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:57.814469 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723eabe-6b63-4943-842e-b47f4c138a7e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:57.825242 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1329/2636] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:57.829240 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b25c1-5e80-4e15-9fb6-e1ff889fa235 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:57.838947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b25c1-5e80-4e15-9fb6-e1ff889fa235 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:57.843691 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f69008-e846-4a84-9b3b-1be2d676a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:57.844336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f69008-e846-4a84-9b3b-1be2d676a434 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:57.844614 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f69008-e846-4a84-9b3b-1be2d676a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:57.844987 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f69008-e846-4a84-9b3b-1be2d676a434 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:57.845711 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f69008-e846-4a84-9b3b-1be2d676a434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:57.847287 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f69008-e846-4a84-9b3b-1be2d676a434 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:57.856814 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1308/2637] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:11:57.860658 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723eabe-6b63-4943-842e-b47f4c138a7e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:57.870444 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723eabe-6b63-4943-842e-b47f4c138a7e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:57.875862 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1730bb-9026-464a-a940-c81b6bfe5506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:57.876729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1730bb-9026-464a-a940-c81b6bfe5506 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:57.877032 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1730bb-9026-464a-a940-c81b6bfe5506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:57.877304 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1730bb-9026-464a-a940-c81b6bfe5506 admin admin] PATH_INFO: `/v3/projects/b8113b9a28f440dfb159aa0ac87e9de0/users/6f5e8e68ea894ade8d246e0902ba86a9/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:57.893067 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1730bb-9026-464a-a940-c81b6bfe5506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8113b9a28f440dfb159aa0ac87e9de0, user_id=6f5e8e68ea894ade8d246e0902ba86a9, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:57.895771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1730bb-9026-464a-a940-c81b6bfe5506 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:57.909604 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1330/2638] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:11:57 2022] PUT /identity/v3/projects/b8113b9a28f440dfb159aa0ac87e9de0/users/6f5e8e68ea894ade8d246e0902ba86a9/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:11:57.920757 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4aa99c-6b8b-42ea-b36c-06355f19150f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:57.920998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4aa99c-6b8b-42ea-b36c-06355f19150f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:57.921278 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4aa99c-6b8b-42ea-b36c-06355f19150f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:57.948754 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2a4aa99c-6b8b-42ea-b36c-06355f19150f None None] MFA Rules not processed for user `6f5e8e68ea894ade8d246e0902ba86a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:57.950791 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2a4aa99c-6b8b-42ea-b36c-06355f19150f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:58.015402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1309/2639] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:11:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:11:58.026657 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1730bb-9026-464a-a940-c81b6bfe5506 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:11:58.029014 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3a1730bb-9026-464a-a940-c81b6bfe5506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:11:58.084876 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1730bb-9026-464a-a940-c81b6bfe5506 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:11:58.089445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d7218-bc22-4e20-9c16-5698f17af8bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:11:58.090168 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d7218-bc22-4e20-9c16-5698f17af8bf service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:58.090450 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d7218-bc22-4e20-9c16-5698f17af8bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:58.090721 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d7218-bc22-4e20-9c16-5698f17af8bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:58.099424 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d7218-bc22-4e20-9c16-5698f17af8bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:11:58.100891 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d7218-bc22-4e20-9c16-5698f17af8bf service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:11:58.110892 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1331/2640] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:11:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:11:59.929622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652b62a-9da9-486a-a2bf-7b47e09bd52c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:11:59.930152 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652b62a-9da9-486a-a2bf-7b47e09bd52c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:11:59.930152 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652b62a-9da9-486a-a2bf-7b47e09bd52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:11:59.953114 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2652b62a-9da9-486a-a2bf-7b47e09bd52c None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:11:59.954640 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2652b62a-9da9-486a-a2bf-7b47e09bd52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:00.023578 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1310/2641] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 27 05:11:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:00.092006 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d7218-bc22-4e20-9c16-5698f17af8bf service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:00.094036 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a29d7218-bc22-4e20-9c16-5698f17af8bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:00.174431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d7218-bc22-4e20-9c16-5698f17af8bf service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:00.181074 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e7f21-a9ae-4a7d-9145-d205b63bc77d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:00.181721 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e7f21-a9ae-4a7d-9145-d205b63bc77d service swift] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:00.182003 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e7f21-a9ae-4a7d-9145-d205b63bc77d service swift] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:00.182278 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e7f21-a9ae-4a7d-9145-d205b63bc77d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:00.190837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e7f21-a9ae-4a7d-9145-d205b63bc77d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:00.192429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e7f21-a9ae-4a7d-9145-d205b63bc77d service swift] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:00.200447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1332/2642] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 05:12:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 05:12:05.136699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652b62a-9da9-486a-a2bf-7b47e09bd52c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:05.138885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2652b62a-9da9-486a-a2bf-7b47e09bd52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:05.283446 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652b62a-9da9-486a-a2bf-7b47e09bd52c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:05.307391 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84700161-7784-4844-8a97-d389fa9a8141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:05.310247 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84700161-7784-4844-8a97-d389fa9a8141 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:05.311943 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84700161-7784-4844-8a97-d389fa9a8141 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:05.312487 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84700161-7784-4844-8a97-d389fa9a8141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:05.314592 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-84700161-7784-4844-8a97-d389fa9a8141 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:05.346704 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84700161-7784-4844-8a97-d389fa9a8141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:05.348421 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84700161-7784-4844-8a97-d389fa9a8141 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:05.363115 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e7f21-a9ae-4a7d-9145-d205b63bc77d service swift] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:05.370653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1311/2643] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:12:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:12:05.473384 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e7f21-a9ae-4a7d-9145-d205b63bc77d service swift] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:05.482331 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3949234-6b26-4ccf-a336-f1b27671262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:05.483257 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3949234-6b26-4ccf-a336-f1b27671262c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:05.483589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3949234-6b26-4ccf-a336-f1b27671262c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:05.483795 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3949234-6b26-4ccf-a336-f1b27671262c admin admin] PATH_INFO: `/v3/users/6f5e8e68ea894ade8d246e0902ba86a9` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:05.485606 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3949234-6b26-4ccf-a336-f1b27671262c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5e8e68ea894ade8d246e0902ba86a9)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:05.488425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3949234-6b26-4ccf-a336-f1b27671262c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:05.558938 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d3949234-6b26-4ccf-a336-f1b27671262c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5e8e68ea894ade8d246e0902ba86a9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:05.559518 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d3949234-6b26-4ccf-a336-f1b27671262c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5e8e68ea894ade8d246e0902ba86a9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:05.560130 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d3949234-6b26-4ccf-a336-f1b27671262c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5e8e68ea894ade8d246e0902ba86a9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:05.567815 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d3949234-6b26-4ccf-a336-f1b27671262c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5e8e68ea894ade8d246e0902ba86a9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:05.582903 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-d3949234-6b26-4ccf-a336-f1b27671262c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5e8e68ea894ade8d246e0902ba86a9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:05.597855 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1333/2644] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:12:05 2022] DELETE /identity/v3/users/6f5e8e68ea894ade8d246e0902ba86a9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:12:05.602080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec620b-8504-4738-ab4d-8829bd097672 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:05.602371 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec620b-8504-4738-ab4d-8829bd097672 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:05.602647 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec620b-8504-4738-ab4d-8829bd097672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:05.623750 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f7ec620b-8504-4738-ab4d-8829bd097672 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:05.625041 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f7ec620b-8504-4738-ab4d-8829bd097672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:05.706424 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1312/2645] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:05.713980 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3949234-6b26-4ccf-a336-f1b27671262c admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:05.716816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d3949234-6b26-4ccf-a336-f1b27671262c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:05.785992 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3949234-6b26-4ccf-a336-f1b27671262c admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:05.792074 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a34c02-d84e-424e-a6c0-1c4b8182dcef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:05.792818 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a34c02-d84e-424e-a6c0-1c4b8182dcef service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:05.794223 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a34c02-d84e-424e-a6c0-1c4b8182dcef service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:05.794223 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a34c02-d84e-424e-a6c0-1c4b8182dcef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:05.804431 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a34c02-d84e-424e-a6c0-1c4b8182dcef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:05.806059 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a34c02-d84e-424e-a6c0-1c4b8182dcef service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:05.818527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1334/2646] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:12:06.141714 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec620b-8504-4738-ab4d-8829bd097672 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:06.143395 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f7ec620b-8504-4738-ab4d-8829bd097672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:06.160428 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec620b-8504-4738-ab4d-8829bd097672 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:06.171214 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c35771-37cd-44fb-9c29-b123a542ba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:06.172544 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c35771-37cd-44fb-9c29-b123a542ba4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:06.174440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c35771-37cd-44fb-9c29-b123a542ba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:06.174788 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c35771-37cd-44fb-9c29-b123a542ba4b admin admin] PATH_INFO: `/v3/projects/b8113b9a28f440dfb159aa0ac87e9de0` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:06.188386 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c35771-37cd-44fb-9c29-b123a542ba4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8113b9a28f440dfb159aa0ac87e9de0)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:06.194769 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c35771-37cd-44fb-9c29-b123a542ba4b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:06.279262 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-34c35771-37cd-44fb-9c29-b123a542ba4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8113b9a28f440dfb159aa0ac87e9de0', 'request_id': 'req-34c35771-37cd-44fb-9c29-b123a542ba4b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:06.289355 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-34c35771-37cd-44fb-9c29-b123a542ba4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8113b9a28f440dfb159aa0ac87e9de0', 'request_id': 'req-34c35771-37cd-44fb-9c29-b123a542ba4b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:06.297784 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-34c35771-37cd-44fb-9c29-b123a542ba4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8113b9a28f440dfb159aa0ac87e9de0', 'request_id': 'req-34c35771-37cd-44fb-9c29-b123a542ba4b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:06.315132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-34c35771-37cd-44fb-9c29-b123a542ba4b admin admin] The token cache is being invalidate because project b8113b9a28f440dfb159aa0ac87e9de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:12:06.315683 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-34c35771-37cd-44fb-9c29-b123a542ba4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:06.317645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-34c35771-37cd-44fb-9c29-b123a542ba4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:06.319783 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1313/2647] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:12:06 2022] DELETE /identity/v3/projects/b8113b9a28f440dfb159aa0ac87e9de0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:12:06.652682 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a34c02-d84e-424e-a6c0-1c4b8182dcef service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:06.655394 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-10a34c02-d84e-424e-a6c0-1c4b8182dcef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:06.666580 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a34c02-d84e-424e-a6c0-1c4b8182dcef service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:06.725858 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfae200-8f28-43c9-8f53-be254f216e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:06.726507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfae200-8f28-43c9-8f53-be254f216e53 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:06.726791 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfae200-8f28-43c9-8f53-be254f216e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:06.727070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfae200-8f28-43c9-8f53-be254f216e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:06.728992 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fcfae200-8f28-43c9-8f53-be254f216e53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:06.814126 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfae200-8f28-43c9-8f53-be254f216e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:06.815645 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfae200-8f28-43c9-8f53-be254f216e53 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:06.829973 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1335/2648] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:12:10.707855 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c35771-37cd-44fb-9c29-b123a542ba4b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:10.709868 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-34c35771-37cd-44fb-9c29-b123a542ba4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:10.725014 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c35771-37cd-44fb-9c29-b123a542ba4b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:10.735471 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6436e-8730-4b5e-9e7d-e99568d376c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:10.736419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6436e-8730-4b5e-9e7d-e99568d376c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:10.736701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6436e-8730-4b5e-9e7d-e99568d376c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:10.737232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6436e-8730-4b5e-9e7d-e99568d376c8 admin admin] PATH_INFO: `/v3/users/6a6685057ae24345b4067cffb06b7f63` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:10.738535 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6436e-8730-4b5e-9e7d-e99568d376c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6685057ae24345b4067cffb06b7f63)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:10.740492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6436e-8730-4b5e-9e7d-e99568d376c8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:10.792698 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6bf6436e-8730-4b5e-9e7d-e99568d376c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6685057ae24345b4067cffb06b7f63'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:10.793546 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6bf6436e-8730-4b5e-9e7d-e99568d376c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6685057ae24345b4067cffb06b7f63'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:10.794869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6bf6436e-8730-4b5e-9e7d-e99568d376c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6685057ae24345b4067cffb06b7f63'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:10.815627 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6bf6436e-8730-4b5e-9e7d-e99568d376c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6685057ae24345b4067cffb06b7f63'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:10.817818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6bf6436e-8730-4b5e-9e7d-e99568d376c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6685057ae24345b4067cffb06b7f63'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:10.831703 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1314/2649] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:12:10 2022] DELETE /identity/v3/users/6a6685057ae24345b4067cffb06b7f63 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:12:11.013637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfae200-8f28-43c9-8f53-be254f216e53 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:11.025819 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfae200-8f28-43c9-8f53-be254f216e53 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:11.085077 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc533e-f6b9-4478-b930-daa9facf9d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:11.086029 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc533e-f6b9-4478-b930-daa9facf9d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:11.086382 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc533e-f6b9-4478-b930-daa9facf9d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:11.086732 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc533e-f6b9-4478-b930-daa9facf9d65 admin admin] PATH_INFO: `/v3/projects/14088bcc2ded4aebb6e8c1f890d6fdec` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:11.088008 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc533e-f6b9-4478-b930-daa9facf9d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14088bcc2ded4aebb6e8c1f890d6fdec)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:11.090134 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc533e-f6b9-4478-b930-daa9facf9d65 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:11.151669 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-54bc533e-f6b9-4478-b930-daa9facf9d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14088bcc2ded4aebb6e8c1f890d6fdec', 'request_id': 'req-54bc533e-f6b9-4478-b930-daa9facf9d65'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:11.160015 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-54bc533e-f6b9-4478-b930-daa9facf9d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14088bcc2ded4aebb6e8c1f890d6fdec', 'request_id': 'req-54bc533e-f6b9-4478-b930-daa9facf9d65'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:11.172892 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-54bc533e-f6b9-4478-b930-daa9facf9d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14088bcc2ded4aebb6e8c1f890d6fdec', 'request_id': 'req-54bc533e-f6b9-4478-b930-daa9facf9d65'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:11.186186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-54bc533e-f6b9-4478-b930-daa9facf9d65 admin admin] The token cache is being invalidate because project 14088bcc2ded4aebb6e8c1f890d6fdec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:12:11.186482 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-54bc533e-f6b9-4478-b930-daa9facf9d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:11.187422 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-54bc533e-f6b9-4478-b930-daa9facf9d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:11.190719 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1336/2650] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:12:11 2022] DELETE /identity/v3/projects/14088bcc2ded4aebb6e8c1f890d6fdec => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:12:11.194444 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26199-be5f-4e87-93d2-2c89b644170c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:11.194738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26199-be5f-4e87-93d2-2c89b644170c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:11.195019 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26199-be5f-4e87-93d2-2c89b644170c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:11.213662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-99a26199-be5f-4e87-93d2-2c89b644170c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:11.215469 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-99a26199-be5f-4e87-93d2-2c89b644170c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:11.288638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1315/2651] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:11.297968 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac335443-3fdb-4290-9386-5611aa8f9f0a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:11.298493 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac335443-3fdb-4290-9386-5611aa8f9f0a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:11.299135 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac335443-3fdb-4290-9386-5611aa8f9f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:11.321825 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ac335443-3fdb-4290-9386-5611aa8f9f0a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:11.322820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ac335443-3fdb-4290-9386-5611aa8f9f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:11.332762 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1337/2652] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:11.338644 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26199-be5f-4e87-93d2-2c89b644170c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:11.354260 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a26199-be5f-4e87-93d2-2c89b644170c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:11.360385 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53e675-9810-4e64-944d-3af7fafb1d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:11.361169 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53e675-9810-4e64-944d-3af7fafb1d5e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:11.361520 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53e675-9810-4e64-944d-3af7fafb1d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:11.361864 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53e675-9810-4e64-944d-3af7fafb1d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:11.362747 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53e675-9810-4e64-944d-3af7fafb1d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:12:11.363118 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53e675-9810-4e64-944d-3af7fafb1d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:11.364816 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53e675-9810-4e64-944d-3af7fafb1d5e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:11.376925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1316/2653] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 05:12:11.381491 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac335443-3fdb-4290-9386-5611aa8f9f0a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:11.391087 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac335443-3fdb-4290-9386-5611aa8f9f0a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:11.395720 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb143ed6-d170-49bd-8ef6-edd5a2c1d8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:11.396354 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb143ed6-d170-49bd-8ef6-edd5a2c1d8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:11.396640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb143ed6-d170-49bd-8ef6-edd5a2c1d8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:11.396949 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb143ed6-d170-49bd-8ef6-edd5a2c1d8d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:11.397656 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb143ed6-d170-49bd-8ef6-edd5a2c1d8d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:11.399558 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb143ed6-d170-49bd-8ef6-edd5a2c1d8d2 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:11.437775 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1338/2654] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:12:11 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:12:11.442023 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53e675-9810-4e64-944d-3af7fafb1d5e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:11.453241 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53e675-9810-4e64-944d-3af7fafb1d5e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:11.520379 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9928e-3d87-4a9a-a4d0-eb964a289d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:11.521117 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9928e-3d87-4a9a-a4d0-eb964a289d91 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:11.521401 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9928e-3d87-4a9a-a4d0-eb964a289d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:11.521776 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9928e-3d87-4a9a-a4d0-eb964a289d91 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:11.522477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9928e-3d87-4a9a-a4d0-eb964a289d91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:11.524427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e9928e-3d87-4a9a-a4d0-eb964a289d91 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:11.549580 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1317/2655] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:12:11 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:12:11.550942 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb143ed6-d170-49bd-8ef6-edd5a2c1d8d2 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:11.565063 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb143ed6-d170-49bd-8ef6-edd5a2c1d8d2 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:11.570047 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26299c-db33-4985-aae3-ee79425d8562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:11.570727 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26299c-db33-4985-aae3-ee79425d8562 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:11.571035 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26299c-db33-4985-aae3-ee79425d8562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:11.571313 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26299c-db33-4985-aae3-ee79425d8562 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:11.572112 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26299c-db33-4985-aae3-ee79425d8562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:11.573776 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26299c-db33-4985-aae3-ee79425d8562 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:11.584874 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1339/2656] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:12:11.588938 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9928e-3d87-4a9a-a4d0-eb964a289d91 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:11.600138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9928e-3d87-4a9a-a4d0-eb964a289d91 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:11.605102 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d176a-d1db-44c5-a014-fdc7e54d9118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:11.606549 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d176a-d1db-44c5-a014-fdc7e54d9118 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:11.606831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d176a-d1db-44c5-a014-fdc7e54d9118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:11.607128 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d176a-d1db-44c5-a014-fdc7e54d9118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:11.607877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d176a-d1db-44c5-a014-fdc7e54d9118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:11.609554 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d176a-d1db-44c5-a014-fdc7e54d9118 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:11.620733 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1318/2657] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:12:11.625129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26299c-db33-4985-aae3-ee79425d8562 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:11.635888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26299c-db33-4985-aae3-ee79425d8562 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:11.641522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95835a-b59f-4d74-9185-c753dabf8dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:11.642515 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95835a-b59f-4d74-9185-c753dabf8dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:11.642855 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95835a-b59f-4d74-9185-c753dabf8dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:11.643194 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95835a-b59f-4d74-9185-c753dabf8dd6 admin admin] PATH_INFO: `/v3/projects/b84f7ab558fa4a3fa7a1ddf1831c7fe2/users/7cd53a52db0c406481a53731c629ae23/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:11.658834 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95835a-b59f-4d74-9185-c753dabf8dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84f7ab558fa4a3fa7a1ddf1831c7fe2, user_id=7cd53a52db0c406481a53731c629ae23, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:11.661628 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95835a-b59f-4d74-9185-c753dabf8dd6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:11.674835 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1340/2658] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:12:11 2022] PUT /identity/v3/projects/b84f7ab558fa4a3fa7a1ddf1831c7fe2/users/7cd53a52db0c406481a53731c629ae23/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:12:11.685751 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19293663-1888-43ce-9a0d-0fbce9c183fd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:11.686043 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19293663-1888-43ce-9a0d-0fbce9c183fd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:11.686328 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19293663-1888-43ce-9a0d-0fbce9c183fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:11.716804 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-19293663-1888-43ce-9a0d-0fbce9c183fd None None] MFA Rules not processed for user `7cd53a52db0c406481a53731c629ae23`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:11.718099 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-19293663-1888-43ce-9a0d-0fbce9c183fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:11.783415 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1319/2659] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:12:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:11.788201 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95835a-b59f-4d74-9185-c753dabf8dd6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:11.852334 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95835a-b59f-4d74-9185-c753dabf8dd6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:11.858428 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a786db-be23-4b7d-9717-d93cc11795e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:11.859100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a786db-be23-4b7d-9717-d93cc11795e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:11.859380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a786db-be23-4b7d-9717-d93cc11795e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:11.859657 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a786db-be23-4b7d-9717-d93cc11795e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:11.860359 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a786db-be23-4b7d-9717-d93cc11795e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:11.862309 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a786db-be23-4b7d-9717-d93cc11795e9 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:11.889010 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1341/2660] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:12:11 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:12:11.893440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19293663-1888-43ce-9a0d-0fbce9c183fd None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:11.904129 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19293663-1888-43ce-9a0d-0fbce9c183fd None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:11.960513 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd14579-164a-416a-9351-d90e7b0b430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:11.961235 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd14579-164a-416a-9351-d90e7b0b430d admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:11.961515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd14579-164a-416a-9351-d90e7b0b430d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:11.961787 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd14579-164a-416a-9351-d90e7b0b430d admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:11.962476 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd14579-164a-416a-9351-d90e7b0b430d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:11.964393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd14579-164a-416a-9351-d90e7b0b430d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:11.987679 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1320/2661] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:12:11 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:12:11.992746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a786db-be23-4b7d-9717-d93cc11795e9 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:12.003948 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a786db-be23-4b7d-9717-d93cc11795e9 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:12.010047 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed080a8a-a1e5-407e-90a2-ea27962782ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:12.011017 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed080a8a-a1e5-407e-90a2-ea27962782ae admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:12.011306 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed080a8a-a1e5-407e-90a2-ea27962782ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:12.012151 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed080a8a-a1e5-407e-90a2-ea27962782ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:12.012916 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed080a8a-a1e5-407e-90a2-ea27962782ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:12.014574 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed080a8a-a1e5-407e-90a2-ea27962782ae admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:12.026228 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1342/2662] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:12:12.030603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd14579-164a-416a-9351-d90e7b0b430d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:12.043181 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd14579-164a-416a-9351-d90e7b0b430d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:12.050966 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf2f28-5414-453b-b0a0-74ccd61da559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:12.051878 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf2f28-5414-453b-b0a0-74ccd61da559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:12.052162 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf2f28-5414-453b-b0a0-74ccd61da559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:12.052438 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf2f28-5414-453b-b0a0-74ccd61da559 admin admin] PATH_INFO: `/v3/projects/b701ca96420e4f9b942db672d287664f/users/84b0cdf9d5c3431581507d6635d386cb/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:12.068645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf2f28-5414-453b-b0a0-74ccd61da559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b701ca96420e4f9b942db672d287664f, user_id=84b0cdf9d5c3431581507d6635d386cb, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:12.071571 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf2f28-5414-453b-b0a0-74ccd61da559 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:12.087331 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1321/2663] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:12:12 2022] PUT /identity/v3/projects/b701ca96420e4f9b942db672d287664f/users/84b0cdf9d5c3431581507d6635d386cb/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:12:12.091957 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed080a8a-a1e5-407e-90a2-ea27962782ae admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:12.110629 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed080a8a-a1e5-407e-90a2-ea27962782ae admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:12.180977 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a94d83-dd27-4290-b397-b36ae14e598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:12.181882 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a94d83-dd27-4290-b397-b36ae14e598d admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:12.182176 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a94d83-dd27-4290-b397-b36ae14e598d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:12.182453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a94d83-dd27-4290-b397-b36ae14e598d admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:12.183170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a94d83-dd27-4290-b397-b36ae14e598d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:12.185322 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a94d83-dd27-4290-b397-b36ae14e598d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:12.195648 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1343/2664] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:12:12.200450 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf2f28-5414-453b-b0a0-74ccd61da559 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:12.210082 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf2f28-5414-453b-b0a0-74ccd61da559 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:12.215214 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e523c2-0ab6-4a3e-a7c2-ebf454570f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:12.216090 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e523c2-0ab6-4a3e-a7c2-ebf454570f84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:12.216365 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e523c2-0ab6-4a3e-a7c2-ebf454570f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:12.216637 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e523c2-0ab6-4a3e-a7c2-ebf454570f84 admin admin] PATH_INFO: `/v3/projects/b701ca96420e4f9b942db672d287664f/users/84b0cdf9d5c3431581507d6635d386cb/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:12.218646 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e523c2-0ab6-4a3e-a7c2-ebf454570f84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b701ca96420e4f9b942db672d287664f, user_id=84b0cdf9d5c3431581507d6635d386cb, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:12.221344 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e523c2-0ab6-4a3e-a7c2-ebf454570f84 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:12.232509 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1322/2665] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:12:12 2022] PUT /identity/v3/projects/b701ca96420e4f9b942db672d287664f/users/84b0cdf9d5c3431581507d6635d386cb/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:12:12.243252 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fe58e-914f-445f-97b0-36c05988f00c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:12.243537 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fe58e-914f-445f-97b0-36c05988f00c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:12.243813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fe58e-914f-445f-97b0-36c05988f00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:12.271205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-bb7fe58e-914f-445f-97b0-36c05988f00c None None] MFA Rules not processed for user `84b0cdf9d5c3431581507d6635d386cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:12.272406 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-bb7fe58e-914f-445f-97b0-36c05988f00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:12.344047 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1344/2666] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:12:12 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:12.355706 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e523c2-0ab6-4a3e-a7c2-ebf454570f84 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:12.357557 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-06e523c2-0ab6-4a3e-a7c2-ebf454570f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:12.416050 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e523c2-0ab6-4a3e-a7c2-ebf454570f84 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:12.420381 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b81eb1-387c-469b-ac42-dc369cf4e164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:12.421070 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b81eb1-387c-469b-ac42-dc369cf4e164 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:12.421349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b81eb1-387c-469b-ac42-dc369cf4e164 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:12.421624 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b81eb1-387c-469b-ac42-dc369cf4e164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:12.431189 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b81eb1-387c-469b-ac42-dc369cf4e164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:12.432699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b81eb1-387c-469b-ac42-dc369cf4e164 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:12.443403 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1323/2667] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:12:12 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:12:12.519340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fe58e-914f-445f-97b0-36c05988f00c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:12.529388 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fe58e-914f-445f-97b0-36c05988f00c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:12.533246 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e090-895c-41bb-978b-a8bc0131a8ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:12.534161 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e090-895c-41bb-978b-a8bc0131a8ad service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:12.534500 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e090-895c-41bb-978b-a8bc0131a8ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:12.534837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e090-895c-41bb-978b-a8bc0131a8ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:12.591259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634e090-895c-41bb-978b-a8bc0131a8ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:12.592682 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634e090-895c-41bb-978b-a8bc0131a8ad service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:12.601862 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1345/2668] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:12:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:12:12.972690 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b81eb1-387c-469b-ac42-dc369cf4e164 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:12.974279 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e4b81eb1-387c-469b-ac42-dc369cf4e164 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:13.048854 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b81eb1-387c-469b-ac42-dc369cf4e164 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:13.054941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ff088-efe4-43dc-8478-e579ddecbc54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:13.055583 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ff088-efe4-43dc-8478-e579ddecbc54 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:13.055858 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ff088-efe4-43dc-8478-e579ddecbc54 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:13.056134 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ff088-efe4-43dc-8478-e579ddecbc54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:13.057952 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-202ff088-efe4-43dc-8478-e579ddecbc54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:13.070353 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ff088-efe4-43dc-8478-e579ddecbc54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:13.071936 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ff088-efe4-43dc-8478-e579ddecbc54 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:13.083321 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1324/2669] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:12:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:12:14.377249 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e090-895c-41bb-978b-a8bc0131a8ad service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:14.378730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b634e090-895c-41bb-978b-a8bc0131a8ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:14.437213 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e090-895c-41bb-978b-a8bc0131a8ad service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:14.440864 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8f3da-c8a9-4d45-8f0e-8096346fb301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:14.441508 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8f3da-c8a9-4d45-8f0e-8096346fb301 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:14.441788 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8f3da-c8a9-4d45-8f0e-8096346fb301 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:14.442064 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8f3da-c8a9-4d45-8f0e-8096346fb301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:14.443828 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f0e8f3da-c8a9-4d45-8f0e-8096346fb301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:14.456427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8f3da-c8a9-4d45-8f0e-8096346fb301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:14.458987 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8f3da-c8a9-4d45-8f0e-8096346fb301 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:14.471862 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1346/2670] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:12:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:12:19.266336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f1d6f-57c9-4cb5-93eb-3adf44a55ae8 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:19.266849 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f1d6f-57c9-4cb5-93eb-3adf44a55ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:19.267132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f1d6f-57c9-4cb5-93eb-3adf44a55ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:19.284909 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3d0f1d6f-57c9-4cb5-93eb-3adf44a55ae8 None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:19.286099 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3d0f1d6f-57c9-4cb5-93eb-3adf44a55ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:19.344412 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1325/2671] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 27 05:12:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:19.356674 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8f3da-c8a9-4d45-8f0e-8096346fb301 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:19.358689 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f0e8f3da-c8a9-4d45-8f0e-8096346fb301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:19.427551 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8f3da-c8a9-4d45-8f0e-8096346fb301 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:19.432619 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665af8e7-6ed3-4b91-acf7-f10822f039fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:19.433399 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665af8e7-6ed3-4b91-acf7-f10822f039fd service swift] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:19.433875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665af8e7-6ed3-4b91-acf7-f10822f039fd service swift] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:19.434342 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665af8e7-6ed3-4b91-acf7-f10822f039fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:19.442739 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665af8e7-6ed3-4b91-acf7-f10822f039fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:19.444935 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665af8e7-6ed3-4b91-acf7-f10822f039fd service swift] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:19.453600 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1347/2672] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 05:12:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 05:12:34.959511 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f1d6f-57c9-4cb5-93eb-3adf44a55ae8 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:34.972174 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f1d6f-57c9-4cb5-93eb-3adf44a55ae8 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:34.977767 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c172cc-9b89-4734-a785-8456df764c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:34.978871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c172cc-9b89-4734-a785-8456df764c05 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:34.978871 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c172cc-9b89-4734-a785-8456df764c05 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:34.979212 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c172cc-9b89-4734-a785-8456df764c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:34.981624 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-76c172cc-9b89-4734-a785-8456df764c05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:35.038366 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c172cc-9b89-4734-a785-8456df764c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:35.040006 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c172cc-9b89-4734-a785-8456df764c05 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:35.049973 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1326/2673] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:12:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:12:39.401029 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ecfa7-4c04-4945-aaf3-09bc0fa3f35f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:39.401502 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ecfa7-4c04-4945-aaf3-09bc0fa3f35f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:39.402308 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ecfa7-4c04-4945-aaf3-09bc0fa3f35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:39.419323 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-cf3ecfa7-4c04-4945-aaf3-09bc0fa3f35f None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:39.420524 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-cf3ecfa7-4c04-4945-aaf3-09bc0fa3f35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:39.427663 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1348/2674] 10.222.0.27 () {58 vars in 967 bytes} [Tue Sep 27 05:12:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:39.439937 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c172cc-9b89-4734-a785-8456df764c05 service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:39.451574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c172cc-9b89-4734-a785-8456df764c05 service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:39.457205 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33635d00-aa6a-45a9-90c1-da6182dcffff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:39.457712 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33635d00-aa6a-45a9-90c1-da6182dcffff service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:39.457999 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33635d00-aa6a-45a9-90c1-da6182dcffff service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:39.458272 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33635d00-aa6a-45a9-90c1-da6182dcffff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:39.468176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33635d00-aa6a-45a9-90c1-da6182dcffff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:39.470073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33635d00-aa6a-45a9-90c1-da6182dcffff service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:39.479572 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1327/2675] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 05:12:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 27 05:12:51.459173 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ecfa7-4c04-4945-aaf3-09bc0fa3f35f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:51.519858 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ecfa7-4c04-4945-aaf3-09bc0fa3f35f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:51.524287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e8c0c-53d7-45df-afd9-9870c176adc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:51.525172 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e8c0c-53d7-45df-afd9-9870c176adc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:51.525453 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e8c0c-53d7-45df-afd9-9870c176adc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:51.525728 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e8c0c-53d7-45df-afd9-9870c176adc6 admin admin] PATH_INFO: `/v3/users/7cd53a52db0c406481a53731c629ae23` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:51.526916 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e8c0c-53d7-45df-afd9-9870c176adc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd53a52db0c406481a53731c629ae23)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:51.529559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e8c0c-53d7-45df-afd9-9870c176adc6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:51.574040 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-789e8c0c-53d7-45df-afd9-9870c176adc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd53a52db0c406481a53731c629ae23'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:51.575205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-789e8c0c-53d7-45df-afd9-9870c176adc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd53a52db0c406481a53731c629ae23'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:51.575807 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-789e8c0c-53d7-45df-afd9-9870c176adc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd53a52db0c406481a53731c629ae23'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:51.582973 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-789e8c0c-53d7-45df-afd9-9870c176adc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd53a52db0c406481a53731c629ae23'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:51.595005 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-789e8c0c-53d7-45df-afd9-9870c176adc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd53a52db0c406481a53731c629ae23'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:51.606808 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1349/2676] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:12:51 2022] DELETE /identity/v3/users/7cd53a52db0c406481a53731c629ae23 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:12:51.611321 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fcaa2-4517-420f-8516-dc92b95a1123 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:51.611800 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fcaa2-4517-420f-8516-dc92b95a1123 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:51.611895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fcaa2-4517-420f-8516-dc92b95a1123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:51.628687 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1b2fcaa2-4517-420f-8516-dc92b95a1123 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:51.629908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1b2fcaa2-4517-420f-8516-dc92b95a1123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:51.687718 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1328/2677] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:51.697618 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e8c0c-53d7-45df-afd9-9870c176adc6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:51.699067 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-789e8c0c-53d7-45df-afd9-9870c176adc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:51.756281 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e8c0c-53d7-45df-afd9-9870c176adc6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:51.760028 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583977f7-d58f-45db-aa94-57030c8e8b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:51.760702 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583977f7-d58f-45db-aa94-57030c8e8b32 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:51.761084 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583977f7-d58f-45db-aa94-57030c8e8b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:51.761357 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583977f7-d58f-45db-aa94-57030c8e8b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:51.771528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583977f7-d58f-45db-aa94-57030c8e8b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:51.772938 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583977f7-d58f-45db-aa94-57030c8e8b32 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:51.782236 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1350/2678] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:12:52.049236 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fcaa2-4517-420f-8516-dc92b95a1123 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:52.051039 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1b2fcaa2-4517-420f-8516-dc92b95a1123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:52.066142 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fcaa2-4517-420f-8516-dc92b95a1123 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:52.071262 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8733478-32c7-464d-87ec-f5c3c4c5d41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:52.072118 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8733478-32c7-464d-87ec-f5c3c4c5d41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:52.073176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8733478-32c7-464d-87ec-f5c3c4c5d41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:52.073176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8733478-32c7-464d-87ec-f5c3c4c5d41a admin admin] PATH_INFO: `/v3/projects/b84f7ab558fa4a3fa7a1ddf1831c7fe2` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:52.074006 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8733478-32c7-464d-87ec-f5c3c4c5d41a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84f7ab558fa4a3fa7a1ddf1831c7fe2)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:52.076719 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8733478-32c7-464d-87ec-f5c3c4c5d41a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:52.123750 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e8733478-32c7-464d-87ec-f5c3c4c5d41a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84f7ab558fa4a3fa7a1ddf1831c7fe2', 'request_id': 'req-e8733478-32c7-464d-87ec-f5c3c4c5d41a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:52.130988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e8733478-32c7-464d-87ec-f5c3c4c5d41a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84f7ab558fa4a3fa7a1ddf1831c7fe2', 'request_id': 'req-e8733478-32c7-464d-87ec-f5c3c4c5d41a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:52.137029 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e8733478-32c7-464d-87ec-f5c3c4c5d41a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84f7ab558fa4a3fa7a1ddf1831c7fe2', 'request_id': 'req-e8733478-32c7-464d-87ec-f5c3c4c5d41a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:52.147279 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e8733478-32c7-464d-87ec-f5c3c4c5d41a admin admin] The token cache is being invalidate because project b84f7ab558fa4a3fa7a1ddf1831c7fe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:12:52.147558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e8733478-32c7-464d-87ec-f5c3c4c5d41a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:52.148183 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e8733478-32c7-464d-87ec-f5c3c4c5d41a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:52.149716 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1329/2679] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:12:52 2022] DELETE /identity/v3/projects/b84f7ab558fa4a3fa7a1ddf1831c7fe2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:12:52.153931 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583977f7-d58f-45db-aa94-57030c8e8b32 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:52.163462 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583977f7-d58f-45db-aa94-57030c8e8b32 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:52.217705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a764cbd-a015-405b-8f4d-26ac80534d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:52.218563 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a764cbd-a015-405b-8f4d-26ac80534d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:52.218843 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a764cbd-a015-405b-8f4d-26ac80534d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:52.219116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a764cbd-a015-405b-8f4d-26ac80534d2f admin admin] PATH_INFO: `/v3/users/84b0cdf9d5c3431581507d6635d386cb` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:52.220287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a764cbd-a015-405b-8f4d-26ac80534d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b0cdf9d5c3431581507d6635d386cb)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:52.222244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a764cbd-a015-405b-8f4d-26ac80534d2f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:52.266372 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4a764cbd-a015-405b-8f4d-26ac80534d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b0cdf9d5c3431581507d6635d386cb'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:52.267012 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4a764cbd-a015-405b-8f4d-26ac80534d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b0cdf9d5c3431581507d6635d386cb'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:52.267609 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4a764cbd-a015-405b-8f4d-26ac80534d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b0cdf9d5c3431581507d6635d386cb'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:52.274409 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4a764cbd-a015-405b-8f4d-26ac80534d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b0cdf9d5c3431581507d6635d386cb'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:52.286373 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4a764cbd-a015-405b-8f4d-26ac80534d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b0cdf9d5c3431581507d6635d386cb'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:52.298897 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1351/2680] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:12:52 2022] DELETE /identity/v3/users/84b0cdf9d5c3431581507d6635d386cb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:12:52.557575 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8733478-32c7-464d-87ec-f5c3c4c5d41a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:52.559268 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e8733478-32c7-464d-87ec-f5c3c4c5d41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:52.572899 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8733478-32c7-464d-87ec-f5c3c4c5d41a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:52.628818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5af1e5-5c1c-4b01-ab55-ebdfe1d05b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:52.629674 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5af1e5-5c1c-4b01-ab55-ebdfe1d05b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:52.629940 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5af1e5-5c1c-4b01-ab55-ebdfe1d05b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:52.630213 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5af1e5-5c1c-4b01-ab55-ebdfe1d05b77 admin admin] PATH_INFO: `/v3/projects/b701ca96420e4f9b942db672d287664f` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:52.631367 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5af1e5-5c1c-4b01-ab55-ebdfe1d05b77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b701ca96420e4f9b942db672d287664f)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:52.633348 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5af1e5-5c1c-4b01-ab55-ebdfe1d05b77 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:52.678591 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6a5af1e5-5c1c-4b01-ab55-ebdfe1d05b77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b701ca96420e4f9b942db672d287664f', 'request_id': 'req-6a5af1e5-5c1c-4b01-ab55-ebdfe1d05b77'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:52.685552 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6a5af1e5-5c1c-4b01-ab55-ebdfe1d05b77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b701ca96420e4f9b942db672d287664f', 'request_id': 'req-6a5af1e5-5c1c-4b01-ab55-ebdfe1d05b77'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:52.691446 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6a5af1e5-5c1c-4b01-ab55-ebdfe1d05b77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b701ca96420e4f9b942db672d287664f', 'request_id': 'req-6a5af1e5-5c1c-4b01-ab55-ebdfe1d05b77'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:52.701375 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6a5af1e5-5c1c-4b01-ab55-ebdfe1d05b77 admin admin] The token cache is being invalidate because project b701ca96420e4f9b942db672d287664f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:12:52.701654 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6a5af1e5-5c1c-4b01-ab55-ebdfe1d05b77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:52.702265 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6a5af1e5-5c1c-4b01-ab55-ebdfe1d05b77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:52.703768 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1330/2681] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:12:52 2022] DELETE /identity/v3/projects/b701ca96420e4f9b942db672d287664f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:12:52.708697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f867f3-9b2c-4e1d-984e-6c6b66ed052c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:52.709207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f867f3-9b2c-4e1d-984e-6c6b66ed052c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:52.709313 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f867f3-9b2c-4e1d-984e-6c6b66ed052c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:52.727345 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f8f867f3-9b2c-4e1d-984e-6c6b66ed052c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:52.728551 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f8f867f3-9b2c-4e1d-984e-6c6b66ed052c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:52.785155 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1352/2682] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:52.793749 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdfd2e-5401-4e77-a458-446e3f6c916d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:52.794055 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdfd2e-5401-4e77-a458-446e3f6c916d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:52.794689 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdfd2e-5401-4e77-a458-446e3f6c916d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:52.813892 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8cbdfd2e-5401-4e77-a458-446e3f6c916d None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:52.815017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8cbdfd2e-5401-4e77-a458-446e3f6c916d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:52.823021 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1331/2683] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:52.827637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f867f3-9b2c-4e1d-984e-6c6b66ed052c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:52.837195 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f867f3-9b2c-4e1d-984e-6c6b66ed052c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:52.842596 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d594e-9716-4f46-b824-f90007a74301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:52.843234 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d594e-9716-4f46-b824-f90007a74301 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:52.843509 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d594e-9716-4f46-b824-f90007a74301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:52.843780 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d594e-9716-4f46-b824-f90007a74301 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:52.844485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d594e-9716-4f46-b824-f90007a74301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:12:52.844810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d594e-9716-4f46-b824-f90007a74301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:52.846384 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d594e-9716-4f46-b824-f90007a74301 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:52.857680 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1353/2684] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:12:52.861773 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdfd2e-5401-4e77-a458-446e3f6c916d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:52.870674 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdfd2e-5401-4e77-a458-446e3f6c916d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:52.875271 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61c5b7-2e47-44a1-a663-69ea646e077e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:52.875907 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61c5b7-2e47-44a1-a663-69ea646e077e admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:52.876188 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61c5b7-2e47-44a1-a663-69ea646e077e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:52.876462 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61c5b7-2e47-44a1-a663-69ea646e077e admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:52.877174 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61c5b7-2e47-44a1-a663-69ea646e077e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:52.879072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61c5b7-2e47-44a1-a663-69ea646e077e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:52.905193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1332/2685] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:12:52 2022] POST /identity/v3/projects => generated 359 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:12:52.909436 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d594e-9716-4f46-b824-f90007a74301 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:52.919254 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d594e-9716-4f46-b824-f90007a74301 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:52.979547 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559f448-a853-4bcf-82bd-bb409d254606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:52.980204 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559f448-a853-4bcf-82bd-bb409d254606 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:52.980496 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559f448-a853-4bcf-82bd-bb409d254606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:52.981145 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559f448-a853-4bcf-82bd-bb409d254606 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:52.981836 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559f448-a853-4bcf-82bd-bb409d254606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:52.983973 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559f448-a853-4bcf-82bd-bb409d254606 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:53.004073 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1354/2686] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:12:52 2022] POST /identity/v3/users => generated 280 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:12:53.008537 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61c5b7-2e47-44a1-a663-69ea646e077e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:53.019606 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61c5b7-2e47-44a1-a663-69ea646e077e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:53.024153 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f261d0-3155-4cc6-8a89-890c8df84d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:53.024828 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f261d0-3155-4cc6-8a89-890c8df84d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:53.025118 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f261d0-3155-4cc6-8a89-890c8df84d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:53.025395 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f261d0-3155-4cc6-8a89-890c8df84d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:53.026124 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f261d0-3155-4cc6-8a89-890c8df84d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:53.028426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f261d0-3155-4cc6-8a89-890c8df84d11 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:53.038604 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1333/2687] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:12:53.042567 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559f448-a853-4bcf-82bd-bb409d254606 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:53.052484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559f448-a853-4bcf-82bd-bb409d254606 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:53.057109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765d79f-8f38-4c9a-b986-b05d7e13a531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:53.057752 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765d79f-8f38-4c9a-b986-b05d7e13a531 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:53.058066 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765d79f-8f38-4c9a-b986-b05d7e13a531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:53.058344 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765d79f-8f38-4c9a-b986-b05d7e13a531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:53.059120 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765d79f-8f38-4c9a-b986-b05d7e13a531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:53.060912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765d79f-8f38-4c9a-b986-b05d7e13a531 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:53.070479 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1355/2688] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:12:53.074855 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f261d0-3155-4cc6-8a89-890c8df84d11 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:53.084652 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f261d0-3155-4cc6-8a89-890c8df84d11 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:53.089305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130aa6e-508b-4d78-902d-0f3ec760b666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:53.090921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130aa6e-508b-4d78-902d-0f3ec760b666 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:53.091393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130aa6e-508b-4d78-902d-0f3ec760b666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:53.091716 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130aa6e-508b-4d78-902d-0f3ec760b666 admin admin] PATH_INFO: `/v3/projects/ec97fccc92fb48c4b1be62ae522e7f18/users/72635393a3b046f7bc4373a033a86516/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:53.105917 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130aa6e-508b-4d78-902d-0f3ec760b666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec97fccc92fb48c4b1be62ae522e7f18, user_id=72635393a3b046f7bc4373a033a86516, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:53.108576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130aa6e-508b-4d78-902d-0f3ec760b666 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:53.121378 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1334/2689] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:12:53 2022] PUT /identity/v3/projects/ec97fccc92fb48c4b1be62ae522e7f18/users/72635393a3b046f7bc4373a033a86516/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:12:53.132905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2294b7f-2755-40c0-bc4a-cda1c20331fe None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:53.133198 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2294b7f-2755-40c0-bc4a-cda1c20331fe None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:53.133568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2294b7f-2755-40c0-bc4a-cda1c20331fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:53.161093 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f2294b7f-2755-40c0-bc4a-cda1c20331fe None None] MFA Rules not processed for user `72635393a3b046f7bc4373a033a86516`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:53.162298 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f2294b7f-2755-40c0-bc4a-cda1c20331fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:53.224968 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1356/2690] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:12:53 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:53.258910 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130aa6e-508b-4d78-902d-0f3ec760b666 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:53.260593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1130aa6e-508b-4d78-902d-0f3ec760b666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:53.316928 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130aa6e-508b-4d78-902d-0f3ec760b666 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:53.320605 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa9c5f-c5bb-4eee-be4a-f877794a212b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:53.321222 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa9c5f-c5bb-4eee-be4a-f877794a212b service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:53.321505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa9c5f-c5bb-4eee-be4a-f877794a212b service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:53.321782 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa9c5f-c5bb-4eee-be4a-f877794a212b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:53.331086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa9c5f-c5bb-4eee-be4a-f877794a212b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:53.332557 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa9c5f-c5bb-4eee-be4a-f877794a212b service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:53.341343 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1335/2691] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:12:53 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:12:53.356413 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2294b7f-2755-40c0-bc4a-cda1c20331fe None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:53.418174 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2294b7f-2755-40c0-bc4a-cda1c20331fe None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:53.422773 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371737be-0a05-4ac1-a509-737c3aee7f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:53.423630 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371737be-0a05-4ac1-a509-737c3aee7f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:53.423913 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371737be-0a05-4ac1-a509-737c3aee7f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:53.424186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371737be-0a05-4ac1-a509-737c3aee7f75 admin admin] PATH_INFO: `/v3/users/72635393a3b046f7bc4373a033a86516` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:53.425402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371737be-0a05-4ac1-a509-737c3aee7f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72635393a3b046f7bc4373a033a86516)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:53.427310 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371737be-0a05-4ac1-a509-737c3aee7f75 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:53.470862 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-371737be-0a05-4ac1-a509-737c3aee7f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72635393a3b046f7bc4373a033a86516'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:53.471519 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-371737be-0a05-4ac1-a509-737c3aee7f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72635393a3b046f7bc4373a033a86516'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:53.472124 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-371737be-0a05-4ac1-a509-737c3aee7f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72635393a3b046f7bc4373a033a86516'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:53.478967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-371737be-0a05-4ac1-a509-737c3aee7f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72635393a3b046f7bc4373a033a86516'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:53.490751 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-371737be-0a05-4ac1-a509-737c3aee7f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72635393a3b046f7bc4373a033a86516'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:53.502943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1357/2692] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:12:53 2022] DELETE /identity/v3/users/72635393a3b046f7bc4373a033a86516 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:12:53.507444 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44494fa-7ba8-491c-966b-1f4ec399928e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:53.507732 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44494fa-7ba8-491c-966b-1f4ec399928e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:53.508004 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44494fa-7ba8-491c-966b-1f4ec399928e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:53.525511 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e44494fa-7ba8-491c-966b-1f4ec399928e None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:53.526680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e44494fa-7ba8-491c-966b-1f4ec399928e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:53.584568 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1336/2693] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:53.594419 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371737be-0a05-4ac1-a509-737c3aee7f75 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:53.595856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-371737be-0a05-4ac1-a509-737c3aee7f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:53.651261 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371737be-0a05-4ac1-a509-737c3aee7f75 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:53.655100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba50d0c-90dd-4a2c-a70e-165386b9369d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:53.655737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba50d0c-90dd-4a2c-a70e-165386b9369d service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:53.656017 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba50d0c-90dd-4a2c-a70e-165386b9369d service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:53.656291 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba50d0c-90dd-4a2c-a70e-165386b9369d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:53.665163 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba50d0c-90dd-4a2c-a70e-165386b9369d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:53.666590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba50d0c-90dd-4a2c-a70e-165386b9369d service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:53.676238 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1358/2694] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:12:53.933397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44494fa-7ba8-491c-966b-1f4ec399928e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:53.935630 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e44494fa-7ba8-491c-966b-1f4ec399928e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:53.947529 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44494fa-7ba8-491c-966b-1f4ec399928e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:53.952649 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf22b19-f1ab-46f1-b90f-e81b9564a2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:53.953553 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf22b19-f1ab-46f1-b90f-e81b9564a2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:53.953880 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf22b19-f1ab-46f1-b90f-e81b9564a2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:53.954161 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf22b19-f1ab-46f1-b90f-e81b9564a2bf admin admin] PATH_INFO: `/v3/projects/ec97fccc92fb48c4b1be62ae522e7f18` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:53.955335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf22b19-f1ab-46f1-b90f-e81b9564a2bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec97fccc92fb48c4b1be62ae522e7f18)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:53.957269 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf22b19-f1ab-46f1-b90f-e81b9564a2bf admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:54.006157 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8cf22b19-f1ab-46f1-b90f-e81b9564a2bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec97fccc92fb48c4b1be62ae522e7f18', 'request_id': 'req-8cf22b19-f1ab-46f1-b90f-e81b9564a2bf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:54.013323 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8cf22b19-f1ab-46f1-b90f-e81b9564a2bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec97fccc92fb48c4b1be62ae522e7f18', 'request_id': 'req-8cf22b19-f1ab-46f1-b90f-e81b9564a2bf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:54.019702 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8cf22b19-f1ab-46f1-b90f-e81b9564a2bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec97fccc92fb48c4b1be62ae522e7f18', 'request_id': 'req-8cf22b19-f1ab-46f1-b90f-e81b9564a2bf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:54.030270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8cf22b19-f1ab-46f1-b90f-e81b9564a2bf admin admin] The token cache is being invalidate because project ec97fccc92fb48c4b1be62ae522e7f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:12:54.030556 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8cf22b19-f1ab-46f1-b90f-e81b9564a2bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:54.031181 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8cf22b19-f1ab-46f1-b90f-e81b9564a2bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:12:54.032721 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1337/2695] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:12:53 2022] DELETE /identity/v3/projects/ec97fccc92fb48c4b1be62ae522e7f18 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:12:54.037557 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9725f1-3096-4b5c-9e23-920c2bf9938f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:54.038008 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9725f1-3096-4b5c-9e23-920c2bf9938f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:54.038233 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9725f1-3096-4b5c-9e23-920c2bf9938f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:54.055993 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ba9725f1-3096-4b5c-9e23-920c2bf9938f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:54.057220 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ba9725f1-3096-4b5c-9e23-920c2bf9938f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:54.119569 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1359/2696] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:54.127681 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f18ce5-dbc2-4683-a183-9c7041b726e0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:54.127969 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f18ce5-dbc2-4683-a183-9c7041b726e0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:54.128246 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f18ce5-dbc2-4683-a183-9c7041b726e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:54.146519 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-96f18ce5-dbc2-4683-a183-9c7041b726e0 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:54.147708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-96f18ce5-dbc2-4683-a183-9c7041b726e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:54.156206 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1338/2697] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:54.160516 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9725f1-3096-4b5c-9e23-920c2bf9938f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:54.170905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9725f1-3096-4b5c-9e23-920c2bf9938f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:54.175500 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2027a21-7185-4c69-acf4-4421fd90f777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:54.176143 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2027a21-7185-4c69-acf4-4421fd90f777 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:54.176422 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2027a21-7185-4c69-acf4-4421fd90f777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:54.176755 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2027a21-7185-4c69-acf4-4421fd90f777 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:54.177572 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2027a21-7185-4c69-acf4-4421fd90f777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:12:54.177875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2027a21-7185-4c69-acf4-4421fd90f777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:54.179466 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2027a21-7185-4c69-acf4-4421fd90f777 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:54.190637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1360/2698] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:12:54.194986 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f18ce5-dbc2-4683-a183-9c7041b726e0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:54.204119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f18ce5-dbc2-4683-a183-9c7041b726e0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:54.208668 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c868e-99da-46bb-8ced-4a7c91467a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:54.209337 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c868e-99da-46bb-8ced-4a7c91467a36 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:54.209617 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c868e-99da-46bb-8ced-4a7c91467a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:54.209890 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c868e-99da-46bb-8ced-4a7c91467a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:54.210593 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c868e-99da-46bb-8ced-4a7c91467a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:54.212486 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c868e-99da-46bb-8ced-4a7c91467a36 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:54.238528 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1339/2699] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:12:54 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:12:54.242775 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2027a21-7185-4c69-acf4-4421fd90f777 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:54.252723 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2027a21-7185-4c69-acf4-4421fd90f777 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:54.307388 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea80c54-9c93-44bf-9532-d58bd8f6d093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:54.308038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea80c54-9c93-44bf-9532-d58bd8f6d093 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:54.308316 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea80c54-9c93-44bf-9532-d58bd8f6d093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:54.308587 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea80c54-9c93-44bf-9532-d58bd8f6d093 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:54.309338 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea80c54-9c93-44bf-9532-d58bd8f6d093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:54.311294 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea80c54-9c93-44bf-9532-d58bd8f6d093 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:54.332435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1361/2700] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:12:54 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:12:54.336330 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c868e-99da-46bb-8ced-4a7c91467a36 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:54.347350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c868e-99da-46bb-8ced-4a7c91467a36 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:54.351936 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08cf45-120b-4664-839b-6f7c42fc9a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:54.352587 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08cf45-120b-4664-839b-6f7c42fc9a72 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:54.352904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08cf45-120b-4664-839b-6f7c42fc9a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:54.353181 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08cf45-120b-4664-839b-6f7c42fc9a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:54.353904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08cf45-120b-4664-839b-6f7c42fc9a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:54.355499 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08cf45-120b-4664-839b-6f7c42fc9a72 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:54.366021 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1340/2701] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:12:54.369842 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea80c54-9c93-44bf-9532-d58bd8f6d093 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:54.379405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea80c54-9c93-44bf-9532-d58bd8f6d093 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:54.384185 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be36f0e-8e26-4eed-9e6d-490ace8e4c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:54.384858 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be36f0e-8e26-4eed-9e6d-490ace8e4c0c admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:54.385139 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be36f0e-8e26-4eed-9e6d-490ace8e4c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:54.385429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be36f0e-8e26-4eed-9e6d-490ace8e4c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:54.386154 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be36f0e-8e26-4eed-9e6d-490ace8e4c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:54.388726 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be36f0e-8e26-4eed-9e6d-490ace8e4c0c admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:54.398760 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1362/2702] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:12:54.403635 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08cf45-120b-4664-839b-6f7c42fc9a72 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:54.413272 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08cf45-120b-4664-839b-6f7c42fc9a72 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:54.417803 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405d453-e250-4428-bdb4-b084878bb01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:54.418686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405d453-e250-4428-bdb4-b084878bb01a admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:54.418964 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405d453-e250-4428-bdb4-b084878bb01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:54.419240 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405d453-e250-4428-bdb4-b084878bb01a admin admin] PATH_INFO: `/v3/projects/ec41c3523d5244049a60e6d8ad22e47b/users/22d86cd2f1f9459ea194cd67b39fd9e8/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:54.433448 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405d453-e250-4428-bdb4-b084878bb01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec41c3523d5244049a60e6d8ad22e47b, user_id=22d86cd2f1f9459ea194cd67b39fd9e8, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:54.436104 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405d453-e250-4428-bdb4-b084878bb01a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:54.448964 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1341/2703] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:12:54 2022] PUT /identity/v3/projects/ec41c3523d5244049a60e6d8ad22e47b/users/22d86cd2f1f9459ea194cd67b39fd9e8/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:12:54.454650 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bae78f-c617-4cc3-b169-8dd4f9b39180 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:54.454941 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bae78f-c617-4cc3-b169-8dd4f9b39180 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:54.455222 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bae78f-c617-4cc3-b169-8dd4f9b39180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:54.473677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-f7bae78f-c617-4cc3-b169-8dd4f9b39180 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:54.474902 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f7bae78f-c617-4cc3-b169-8dd4f9b39180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:54.531361 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1363/2704] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:54.541079 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405d453-e250-4428-bdb4-b084878bb01a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:54.542741 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9405d453-e250-4428-bdb4-b084878bb01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:54.597770 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405d453-e250-4428-bdb4-b084878bb01a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:54.601428 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c43833-0efb-4503-9f1e-04322420df32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:54.602062 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c43833-0efb-4503-9f1e-04322420df32 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:54.602342 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c43833-0efb-4503-9f1e-04322420df32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:54.602615 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c43833-0efb-4503-9f1e-04322420df32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:54.611737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c43833-0efb-4503-9f1e-04322420df32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:54.613246 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c43833-0efb-4503-9f1e-04322420df32 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:54.622724 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1342/2705] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:12:55.221246 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7b8ff-a5db-4055-bd48-8f600d9cd15e None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:55.221766 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7b8ff-a5db-4055-bd48-8f600d9cd15e None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:55.221863 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7b8ff-a5db-4055-bd48-8f600d9cd15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:55.249497 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-70d7b8ff-a5db-4055-bd48-8f600d9cd15e None None] MFA Rules not processed for user `22d86cd2f1f9459ea194cd67b39fd9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:55.250705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-70d7b8ff-a5db-4055-bd48-8f600d9cd15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:55.314729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1364/2706] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:12:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:12:55.325298 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c43833-0efb-4503-9f1e-04322420df32 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:12:55.326809 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c8c43833-0efb-4503-9f1e-04322420df32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:55.388419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c43833-0efb-4503-9f1e-04322420df32 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:12:55.393200 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf90997-c379-4461-8dcb-4f04cfec5f4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:12:55.393697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf90997-c379-4461-8dcb-4f04cfec5f4d service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:55.393978 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf90997-c379-4461-8dcb-4f04cfec5f4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:55.394250 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf90997-c379-4461-8dcb-4f04cfec5f4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:55.402833 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf90997-c379-4461-8dcb-4f04cfec5f4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:12:55.404310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf90997-c379-4461-8dcb-4f04cfec5f4d service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:12:55.413701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1343/2707] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:12:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:12:56.761103 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff4478-8542-446f-b9dd-9b7bd4149789 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:12:56.761615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff4478-8542-446f-b9dd-9b7bd4149789 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:12:56.761967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff4478-8542-446f-b9dd-9b7bd4149789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:12:56.779341 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-92ff4478-8542-446f-b9dd-9b7bd4149789 None None] MFA Rules not processed for user `22d86cd2f1f9459ea194cd67b39fd9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:12:56.780517 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-92ff4478-8542-446f-b9dd-9b7bd4149789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:12:56.787515 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1365/2708] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:12:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:13:09.738847 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c261c1e-9ac6-4ee1-b1fb-f8b6c7c2dbda None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:09.739396 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c261c1e-9ac6-4ee1-b1fb-f8b6c7c2dbda None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:09.739396 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c261c1e-9ac6-4ee1-b1fb-f8b6c7c2dbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:09.756886 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1c261c1e-9ac6-4ee1-b1fb-f8b6c7c2dbda None None] MFA Rules not processed for user `22d86cd2f1f9459ea194cd67b39fd9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:13:09.758086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1c261c1e-9ac6-4ee1-b1fb-f8b6c7c2dbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:09.765731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1344/2709] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:13:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:13:21.002831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff4478-8542-446f-b9dd-9b7bd4149789 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:21.012473 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff4478-8542-446f-b9dd-9b7bd4149789 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:21.016080 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb433f-f1de-4aca-936b-ccd58d4a0757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:21.017038 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb433f-f1de-4aca-936b-ccd58d4a0757 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:21.017317 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb433f-f1de-4aca-936b-ccd58d4a0757 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:21.017588 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb433f-f1de-4aca-936b-ccd58d4a0757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:21.019367 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fffb433f-f1de-4aca-936b-ccd58d4a0757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:21.032031 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb433f-f1de-4aca-936b-ccd58d4a0757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:21.033483 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb433f-f1de-4aca-936b-ccd58d4a0757 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:21.044093 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1366/2710] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:13:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:13:24.404447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c261c1e-9ac6-4ee1-b1fb-f8b6c7c2dbda None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:24.405965 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1c261c1e-9ac6-4ee1-b1fb-f8b6c7c2dbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:24.467137 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb433f-f1de-4aca-936b-ccd58d4a0757 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:24.468586 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-fffb433f-f1de-4aca-936b-ccd58d4a0757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:24.482632 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb433f-f1de-4aca-936b-ccd58d4a0757 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:24.487551 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd48260-c9c0-4941-94be-3868032ac399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:24.488418 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd48260-c9c0-4941-94be-3868032ac399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:24.488731 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd48260-c9c0-4941-94be-3868032ac399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:24.489042 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd48260-c9c0-4941-94be-3868032ac399 admin admin] PATH_INFO: `/v3/users/e5cb068154f04e93b2a301d46164d001` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:24.490242 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd48260-c9c0-4941-94be-3868032ac399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5cb068154f04e93b2a301d46164d001)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:24.492229 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd48260-c9c0-4941-94be-3868032ac399 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:24.495431 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c261c1e-9ac6-4ee1-b1fb-f8b6c7c2dbda None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:24.501196 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb8d74-8fc5-40ee-9215-a527beec37ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8489647547d544a681131dad99e058bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:24.501929 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb8d74-8fc5-40ee-9215-a527beec37ec service placement] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:24.502283 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb8d74-8fc5-40ee-9215-a527beec37ec service placement] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:24.502630 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb8d74-8fc5-40ee-9215-a527beec37ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:24.504490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9abb8d74-8fc5-40ee-9215-a527beec37ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:24.517908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb8d74-8fc5-40ee-9215-a527beec37ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:24.519516 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb8d74-8fc5-40ee-9215-a527beec37ec service placement] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:24.533093 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1345/2711] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:13:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:13:24.547959 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8fd48260-c9c0-4941-94be-3868032ac399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5cb068154f04e93b2a301d46164d001'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:24.548709 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8fd48260-c9c0-4941-94be-3868032ac399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5cb068154f04e93b2a301d46164d001'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:24.549304 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8fd48260-c9c0-4941-94be-3868032ac399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5cb068154f04e93b2a301d46164d001'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:24.559912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8fd48260-c9c0-4941-94be-3868032ac399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5cb068154f04e93b2a301d46164d001'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:24.572964 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-8fd48260-c9c0-4941-94be-3868032ac399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5cb068154f04e93b2a301d46164d001'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:24.585730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1367/2712] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:13:24 2022] DELETE /identity/v3/users/e5cb068154f04e93b2a301d46164d001 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:13:24.760944 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb8d74-8fc5-40ee-9215-a527beec37ec service placement] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:24.774397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb8d74-8fc5-40ee-9215-a527beec37ec service placement] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:24.833397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1156219-4714-4a19-a08c-24a0acb187c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:24.834187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1156219-4714-4a19-a08c-24a0acb187c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:24.834459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1156219-4714-4a19-a08c-24a0acb187c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:24.834728 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1156219-4714-4a19-a08c-24a0acb187c6 admin admin] PATH_INFO: `/v3/projects/b8550668d08c4227904042b8a49bc261` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:24.835884 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1156219-4714-4a19-a08c-24a0acb187c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8550668d08c4227904042b8a49bc261)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:24.837850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1156219-4714-4a19-a08c-24a0acb187c6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:24.882106 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e1156219-4714-4a19-a08c-24a0acb187c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8550668d08c4227904042b8a49bc261', 'request_id': 'req-e1156219-4714-4a19-a08c-24a0acb187c6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:24.889714 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e1156219-4714-4a19-a08c-24a0acb187c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8550668d08c4227904042b8a49bc261', 'request_id': 'req-e1156219-4714-4a19-a08c-24a0acb187c6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:24.896925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e1156219-4714-4a19-a08c-24a0acb187c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8550668d08c4227904042b8a49bc261', 'request_id': 'req-e1156219-4714-4a19-a08c-24a0acb187c6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:24.907109 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e1156219-4714-4a19-a08c-24a0acb187c6 admin admin] The token cache is being invalidate because project b8550668d08c4227904042b8a49bc261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:13:24.907393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e1156219-4714-4a19-a08c-24a0acb187c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:24.908013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e1156219-4714-4a19-a08c-24a0acb187c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:24.909594 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1346/2713] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:13:24 2022] DELETE /identity/v3/projects/b8550668d08c4227904042b8a49bc261 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:13:24.914475 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78211ea-ed8d-4456-a86e-95d13511751b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:24.914766 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78211ea-ed8d-4456-a86e-95d13511751b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:24.915047 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78211ea-ed8d-4456-a86e-95d13511751b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:24.932896 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d78211ea-ed8d-4456-a86e-95d13511751b None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:13:24.934601 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d78211ea-ed8d-4456-a86e-95d13511751b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:24.993037 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1368/2714] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:13:25.001477 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52724a59-a4c5-4045-9ba2-f4e8668fde16 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:25.001836 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52724a59-a4c5-4045-9ba2-f4e8668fde16 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:25.002124 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52724a59-a4c5-4045-9ba2-f4e8668fde16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:25.021265 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-52724a59-a4c5-4045-9ba2-f4e8668fde16 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:13:25.022443 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-52724a59-a4c5-4045-9ba2-f4e8668fde16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:25.030557 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1347/2715] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:13:25.034880 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78211ea-ed8d-4456-a86e-95d13511751b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:25.044530 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78211ea-ed8d-4456-a86e-95d13511751b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:25.049128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49465528-b76f-49bd-8672-8ba904e06692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:25.049771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49465528-b76f-49bd-8672-8ba904e06692 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:25.050053 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49465528-b76f-49bd-8672-8ba904e06692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:25.050332 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49465528-b76f-49bd-8672-8ba904e06692 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:25.051053 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49465528-b76f-49bd-8672-8ba904e06692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:13:25.051363 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49465528-b76f-49bd-8672-8ba904e06692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:25.052995 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49465528-b76f-49bd-8672-8ba904e06692 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:25.064771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1369/2716] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:13:25.068959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52724a59-a4c5-4045-9ba2-f4e8668fde16 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:25.078718 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52724a59-a4c5-4045-9ba2-f4e8668fde16 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:25.083329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3961b5-9399-4712-8943-42fa4d561faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:25.084016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3961b5-9399-4712-8943-42fa4d561faa admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:25.084268 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3961b5-9399-4712-8943-42fa4d561faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:25.084540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3961b5-9399-4712-8943-42fa4d561faa admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:25.085265 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3961b5-9399-4712-8943-42fa4d561faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:25.087195 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3961b5-9399-4712-8943-42fa4d561faa admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:25.112457 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1348/2717] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:13:25 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:13:25.116684 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49465528-b76f-49bd-8672-8ba904e06692 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:25.127374 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49465528-b76f-49bd-8672-8ba904e06692 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:25.182160 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa4861-8e54-4a8f-a916-809adf1fe388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:25.182814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa4861-8e54-4a8f-a916-809adf1fe388 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:25.183091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa4861-8e54-4a8f-a916-809adf1fe388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:25.184053 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa4861-8e54-4a8f-a916-809adf1fe388 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:25.185062 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa4861-8e54-4a8f-a916-809adf1fe388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:25.186976 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa4861-8e54-4a8f-a916-809adf1fe388 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:25.206213 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1370/2718] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:13:25 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:13:25.210346 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3961b5-9399-4712-8943-42fa4d561faa admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:25.220423 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3961b5-9399-4712-8943-42fa4d561faa admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:25.225225 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d8b8b-a9f9-48a0-afa1-72451be88d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:25.225873 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d8b8b-a9f9-48a0-afa1-72451be88d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:25.226150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d8b8b-a9f9-48a0-afa1-72451be88d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:25.226422 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d8b8b-a9f9-48a0-afa1-72451be88d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:25.227138 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d8b8b-a9f9-48a0-afa1-72451be88d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:25.228715 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d8b8b-a9f9-48a0-afa1-72451be88d45 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:25.239288 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1349/2719] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:13:25.243274 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa4861-8e54-4a8f-a916-809adf1fe388 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:25.253596 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa4861-8e54-4a8f-a916-809adf1fe388 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:25.258170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5627d25-eefb-438f-87f3-346cfbd8acb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:25.258811 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5627d25-eefb-438f-87f3-346cfbd8acb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:25.259091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5627d25-eefb-438f-87f3-346cfbd8acb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:25.259365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5627d25-eefb-438f-87f3-346cfbd8acb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:25.260081 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5627d25-eefb-438f-87f3-346cfbd8acb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:25.261778 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5627d25-eefb-438f-87f3-346cfbd8acb3 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:25.271598 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1371/2720] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:13:25.275482 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d8b8b-a9f9-48a0-afa1-72451be88d45 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:25.285248 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d8b8b-a9f9-48a0-afa1-72451be88d45 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:25.289803 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a73ca-a65c-44e1-8a07-e95223368ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:25.290696 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a73ca-a65c-44e1-8a07-e95223368ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:25.290994 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a73ca-a65c-44e1-8a07-e95223368ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:25.291262 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a73ca-a65c-44e1-8a07-e95223368ed2 admin admin] PATH_INFO: `/v3/projects/1dfb55fd8c674196b50d4d7fcb5cfa7f/users/d2a95bcb895549578da19e7d723cebb7/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:25.306818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a73ca-a65c-44e1-8a07-e95223368ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dfb55fd8c674196b50d4d7fcb5cfa7f, user_id=d2a95bcb895549578da19e7d723cebb7, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:25.310478 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a73ca-a65c-44e1-8a07-e95223368ed2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:25.322982 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1350/2721] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:13:25 2022] PUT /identity/v3/projects/1dfb55fd8c674196b50d4d7fcb5cfa7f/users/d2a95bcb895549578da19e7d723cebb7/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:13:25.328301 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71ef6c-cb11-476d-bc34-bf51d5542471 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:25.328590 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71ef6c-cb11-476d-bc34-bf51d5542471 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:25.328904 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71ef6c-cb11-476d-bc34-bf51d5542471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:25.347696 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4e71ef6c-cb11-476d-bc34-bf51d5542471 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:13:25.348849 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4e71ef6c-cb11-476d-bc34-bf51d5542471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:25.406296 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1372/2722] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:13:25.416023 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a73ca-a65c-44e1-8a07-e95223368ed2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:25.418318 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f62a73ca-a65c-44e1-8a07-e95223368ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:25.474916 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a73ca-a65c-44e1-8a07-e95223368ed2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:25.478567 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c949c-05f4-4c62-b47f-f64ee39fff1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:25.479207 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c949c-05f4-4c62-b47f-f64ee39fff1d service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:25.479485 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c949c-05f4-4c62-b47f-f64ee39fff1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:25.479756 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c949c-05f4-4c62-b47f-f64ee39fff1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:25.490014 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c949c-05f4-4c62-b47f-f64ee39fff1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:25.491566 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c949c-05f4-4c62-b47f-f64ee39fff1d service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:25.501902 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1351/2723] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:13:27.544773 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d683fe-6772-441a-bb88-6e4a911002f5 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:27.545614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d683fe-6772-441a-bb88-6e4a911002f5 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:27.546064 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d683fe-6772-441a-bb88-6e4a911002f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:27.566109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-28d683fe-6772-441a-bb88-6e4a911002f5 None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:13:27.567732 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-28d683fe-6772-441a-bb88-6e4a911002f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:27.647318 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1373/2724] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 27 05:13:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:13:27.671391 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c949c-05f4-4c62-b47f-f64ee39fff1d service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:27.672841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-348c949c-05f4-4c62-b47f-f64ee39fff1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:27.755666 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c949c-05f4-4c62-b47f-f64ee39fff1d service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:27.761484 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4814007-9e2a-4e29-aa6d-e3dd3aa8d13c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:27.762962 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4814007-9e2a-4e29-aa6d-e3dd3aa8d13c service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:27.763250 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4814007-9e2a-4e29-aa6d-e3dd3aa8d13c service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:27.763523 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4814007-9e2a-4e29-aa6d-e3dd3aa8d13c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:27.773371 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4814007-9e2a-4e29-aa6d-e3dd3aa8d13c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:27.775050 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4814007-9e2a-4e29-aa6d-e3dd3aa8d13c service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:27.785102 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1352/2725] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 05:13:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 05:13:29.907459 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d33ba2-9fc7-4817-ab54-1457a64ff6a7 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:29.908451 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d33ba2-9fc7-4817-ab54-1457a64ff6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:29.908738 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d33ba2-9fc7-4817-ab54-1457a64ff6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:29.940559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-17d33ba2-9fc7-4817-ab54-1457a64ff6a7 None None] MFA Rules not processed for user `d2a95bcb895549578da19e7d723cebb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:13:29.941685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-17d33ba2-9fc7-4817-ab54-1457a64ff6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:30.037685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1374/2726] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:13:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:13:30.052838 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4814007-9e2a-4e29-aa6d-e3dd3aa8d13c service swift] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:30.054514 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a4814007-9e2a-4e29-aa6d-e3dd3aa8d13c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:30.162517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4814007-9e2a-4e29-aa6d-e3dd3aa8d13c service swift] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:30.169139 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce33802-ca7f-400f-8ac6-62b49a8e4ba9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:30.169833 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce33802-ca7f-400f-8ac6-62b49a8e4ba9 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:30.170114 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce33802-ca7f-400f-8ac6-62b49a8e4ba9 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:30.170508 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce33802-ca7f-400f-8ac6-62b49a8e4ba9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:30.180904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce33802-ca7f-400f-8ac6-62b49a8e4ba9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:30.182555 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce33802-ca7f-400f-8ac6-62b49a8e4ba9 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:30.218074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1353/2727] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:13:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:13:32.036675 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d04a2-01cc-4c98-82c9-138edc70fe6d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:32.037443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d04a2-01cc-4c98-82c9-138edc70fe6d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:32.037443 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d04a2-01cc-4c98-82c9-138edc70fe6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:32.062894 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-5a9d04a2-01cc-4c98-82c9-138edc70fe6d None None] MFA Rules not processed for user `d2a95bcb895549578da19e7d723cebb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:13:32.064402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-5a9d04a2-01cc-4c98-82c9-138edc70fe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:32.077134 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1375/2728] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:13:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:13:44.661322 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b330bd-0764-466b-afb3-65e0041ce215 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:44.661809 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b330bd-0764-466b-afb3-65e0041ce215 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:44.662185 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b330bd-0764-466b-afb3-65e0041ce215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:44.681074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e7b330bd-0764-466b-afb3-65e0041ce215 None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:13:44.682258 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e7b330bd-0764-466b-afb3-65e0041ce215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:44.690779 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1354/2729] 10.222.0.27 () {58 vars in 967 bytes} [Tue Sep 27 05:13:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:13:44.703026 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d04a2-01cc-4c98-82c9-138edc70fe6d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:44.715103 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d04a2-01cc-4c98-82c9-138edc70fe6d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:44.720051 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6958d-a5a5-4792-9228-6ec55996a81b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:44.720713 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6958d-a5a5-4792-9228-6ec55996a81b service swift] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:44.721054 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6958d-a5a5-4792-9228-6ec55996a81b service swift] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:44.721330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6958d-a5a5-4792-9228-6ec55996a81b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:44.729430 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6958d-a5a5-4792-9228-6ec55996a81b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:44.731774 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6958d-a5a5-4792-9228-6ec55996a81b service swift] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:44.740375 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1376/2730] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 05:13:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 05:13:47.076937 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b330bd-0764-466b-afb3-65e0041ce215 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:47.078573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e7b330bd-0764-466b-afb3-65e0041ce215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:47.098412 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b330bd-0764-466b-afb3-65e0041ce215 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:47.103609 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37a000-b11c-4d91-8ddd-11d028b0a55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:47.105246 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a000-b11c-4d91-8ddd-11d028b0a55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:47.105759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a000-b11c-4d91-8ddd-11d028b0a55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:47.106092 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a000-b11c-4d91-8ddd-11d028b0a55c admin admin] PATH_INFO: `/v3/users/22d86cd2f1f9459ea194cd67b39fd9e8` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:47.107354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37a000-b11c-4d91-8ddd-11d028b0a55c admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d86cd2f1f9459ea194cd67b39fd9e8)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:47.109681 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37a000-b11c-4d91-8ddd-11d028b0a55c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:47.167669 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3f37a000-b11c-4d91-8ddd-11d028b0a55c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d86cd2f1f9459ea194cd67b39fd9e8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:47.170453 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3f37a000-b11c-4d91-8ddd-11d028b0a55c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d86cd2f1f9459ea194cd67b39fd9e8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:47.170950 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3f37a000-b11c-4d91-8ddd-11d028b0a55c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d86cd2f1f9459ea194cd67b39fd9e8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:47.179881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3f37a000-b11c-4d91-8ddd-11d028b0a55c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d86cd2f1f9459ea194cd67b39fd9e8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:47.193779 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3f37a000-b11c-4d91-8ddd-11d028b0a55c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d86cd2f1f9459ea194cd67b39fd9e8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:47.210514 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1355/2731] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:13:47 2022] DELETE /identity/v3/users/22d86cd2f1f9459ea194cd67b39fd9e8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:13:47.394378 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6958d-a5a5-4792-9228-6ec55996a81b service swift] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:47.406355 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6958d-a5a5-4792-9228-6ec55996a81b service swift] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:47.469330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81348bc0-4d06-4086-8883-08be6f3c9c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:47.470461 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81348bc0-4d06-4086-8883-08be6f3c9c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:47.470742 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81348bc0-4d06-4086-8883-08be6f3c9c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:47.471018 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81348bc0-4d06-4086-8883-08be6f3c9c13 admin admin] PATH_INFO: `/v3/projects/ec41c3523d5244049a60e6d8ad22e47b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:47.472451 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81348bc0-4d06-4086-8883-08be6f3c9c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec41c3523d5244049a60e6d8ad22e47b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:47.474471 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81348bc0-4d06-4086-8883-08be6f3c9c13 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:47.530555 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81348bc0-4d06-4086-8883-08be6f3c9c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec41c3523d5244049a60e6d8ad22e47b', 'request_id': 'req-81348bc0-4d06-4086-8883-08be6f3c9c13'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:47.537705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81348bc0-4d06-4086-8883-08be6f3c9c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec41c3523d5244049a60e6d8ad22e47b', 'request_id': 'req-81348bc0-4d06-4086-8883-08be6f3c9c13'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:47.547141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81348bc0-4d06-4086-8883-08be6f3c9c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec41c3523d5244049a60e6d8ad22e47b', 'request_id': 'req-81348bc0-4d06-4086-8883-08be6f3c9c13'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:47.558870 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81348bc0-4d06-4086-8883-08be6f3c9c13 admin admin] The token cache is being invalidate because project ec41c3523d5244049a60e6d8ad22e47b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:13:47.558870 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81348bc0-4d06-4086-8883-08be6f3c9c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:47.559745 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-81348bc0-4d06-4086-8883-08be6f3c9c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:13:47.561553 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1377/2732] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:13:47 2022] DELETE /identity/v3/projects/ec41c3523d5244049a60e6d8ad22e47b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:13:47.568184 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af1787-29a8-431f-ab61-4d91cb6c667a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:47.568460 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af1787-29a8-431f-ab61-4d91cb6c667a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:47.568923 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af1787-29a8-431f-ab61-4d91cb6c667a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:47.591246 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-82af1787-29a8-431f-ab61-4d91cb6c667a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:13:47.592458 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-82af1787-29a8-431f-ab61-4d91cb6c667a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:47.657603 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1356/2733] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:13:47.665103 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545decfd-99fe-4162-abdf-b659d997970b None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:47.665387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545decfd-99fe-4162-abdf-b659d997970b None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:47.665662 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545decfd-99fe-4162-abdf-b659d997970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:47.686855 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-545decfd-99fe-4162-abdf-b659d997970b None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:13:47.688058 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-545decfd-99fe-4162-abdf-b659d997970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:47.696253 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1378/2734] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:13:47.700512 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af1787-29a8-431f-ab61-4d91cb6c667a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:47.711074 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af1787-29a8-431f-ab61-4d91cb6c667a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:47.717239 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db4848-bfbd-437b-9ff3-5ba2ceaf5638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:47.718016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db4848-bfbd-437b-9ff3-5ba2ceaf5638 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:47.718171 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db4848-bfbd-437b-9ff3-5ba2ceaf5638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:47.718453 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db4848-bfbd-437b-9ff3-5ba2ceaf5638 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:47.719188 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db4848-bfbd-437b-9ff3-5ba2ceaf5638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:13:47.719551 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db4848-bfbd-437b-9ff3-5ba2ceaf5638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:47.721175 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db4848-bfbd-437b-9ff3-5ba2ceaf5638 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:47.734864 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1357/2735] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:13:47.739080 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545decfd-99fe-4162-abdf-b659d997970b None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:47.749208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545decfd-99fe-4162-abdf-b659d997970b None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:47.757207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457e816-d9f1-45d5-98b6-4f35401202ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:47.757881 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457e816-d9f1-45d5-98b6-4f35401202ec admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:47.758165 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457e816-d9f1-45d5-98b6-4f35401202ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:47.758441 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457e816-d9f1-45d5-98b6-4f35401202ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:47.759152 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457e816-d9f1-45d5-98b6-4f35401202ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:47.761358 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457e816-d9f1-45d5-98b6-4f35401202ec admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:47.788829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1379/2736] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:13:47 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:13:47.792027 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db4848-bfbd-437b-9ff3-5ba2ceaf5638 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:47.805018 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db4848-bfbd-437b-9ff3-5ba2ceaf5638 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:47.869491 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4da3a-6d64-4fd2-bdb3-dd19b41871fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:47.871107 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4da3a-6d64-4fd2-bdb3-dd19b41871fe admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:47.871389 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4da3a-6d64-4fd2-bdb3-dd19b41871fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:47.872111 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4da3a-6d64-4fd2-bdb3-dd19b41871fe admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:47.872857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4da3a-6d64-4fd2-bdb3-dd19b41871fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:47.876053 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4da3a-6d64-4fd2-bdb3-dd19b41871fe admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:47.904835 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1358/2737] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:13:47 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:13:47.908677 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457e816-d9f1-45d5-98b6-4f35401202ec admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:47.920945 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457e816-d9f1-45d5-98b6-4f35401202ec admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:47.932429 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a253f-f660-4135-b6bb-b7179ba23634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:47.933743 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a253f-f660-4135-b6bb-b7179ba23634 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:47.934050 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a253f-f660-4135-b6bb-b7179ba23634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:47.934365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a253f-f660-4135-b6bb-b7179ba23634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:47.935294 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a253f-f660-4135-b6bb-b7179ba23634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:47.936980 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a253f-f660-4135-b6bb-b7179ba23634 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:47.950168 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1380/2738] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:13:47.954790 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4da3a-6d64-4fd2-bdb3-dd19b41871fe admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:47.967662 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4da3a-6d64-4fd2-bdb3-dd19b41871fe admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:47.975823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f9dc7-2716-4b1a-b80e-5916d10fd7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:47.976619 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f9dc7-2716-4b1a-b80e-5916d10fd7aa admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:47.977133 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f9dc7-2716-4b1a-b80e-5916d10fd7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:47.977539 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f9dc7-2716-4b1a-b80e-5916d10fd7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:47.978393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f9dc7-2716-4b1a-b80e-5916d10fd7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:47.980474 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f9dc7-2716-4b1a-b80e-5916d10fd7aa admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:48.002350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1359/2739] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:13:48.003667 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a253f-f660-4135-b6bb-b7179ba23634 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:48.016230 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a253f-f660-4135-b6bb-b7179ba23634 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:48.021988 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073f464-6d46-43cf-bb61-b4e54b76e7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:48.022896 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073f464-6d46-43cf-bb61-b4e54b76e7bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:48.023170 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073f464-6d46-43cf-bb61-b4e54b76e7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:48.023440 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073f464-6d46-43cf-bb61-b4e54b76e7bb admin admin] PATH_INFO: `/v3/projects/505f8ca50e7042bfadcc5b9b5c433696/users/1555c9543d5f4c1a85a48e04b612cad9/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:48.040163 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073f464-6d46-43cf-bb61-b4e54b76e7bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=505f8ca50e7042bfadcc5b9b5c433696, user_id=1555c9543d5f4c1a85a48e04b612cad9, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:48.043749 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073f464-6d46-43cf-bb61-b4e54b76e7bb admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:48.060468 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1381/2740] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:13:48 2022] PUT /identity/v3/projects/505f8ca50e7042bfadcc5b9b5c433696/users/1555c9543d5f4c1a85a48e04b612cad9/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:13:48.065695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94cd0d-c8ea-4bbf-ba39-6605d214c7db None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:48.066105 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94cd0d-c8ea-4bbf-ba39-6605d214c7db None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:48.066393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94cd0d-c8ea-4bbf-ba39-6605d214c7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:48.091462 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3b94cd0d-c8ea-4bbf-ba39-6605d214c7db None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:13:48.092849 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3b94cd0d-c8ea-4bbf-ba39-6605d214c7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:48.174990 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1360/2741] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:13:48.185852 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073f464-6d46-43cf-bb61-b4e54b76e7bb admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:48.187694 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-f073f464-6d46-43cf-bb61-b4e54b76e7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:48.253575 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073f464-6d46-43cf-bb61-b4e54b76e7bb admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:48.257529 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51019e-36e0-428d-b650-5e34e609bf81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:48.258249 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51019e-36e0-428d-b650-5e34e609bf81 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:48.258601 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51019e-36e0-428d-b650-5e34e609bf81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:48.258917 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51019e-36e0-428d-b650-5e34e609bf81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:48.269786 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51019e-36e0-428d-b650-5e34e609bf81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:48.271291 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51019e-36e0-428d-b650-5e34e609bf81 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:48.283514 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1382/2742] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:13:50.699072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94cd0d-c8ea-4bbf-ba39-6605d214c7db None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:50.702149 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3b94cd0d-c8ea-4bbf-ba39-6605d214c7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:50.781042 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94cd0d-c8ea-4bbf-ba39-6605d214c7db None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:50.786547 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa5f3c-9c89-4f4d-bf09-ccde2c629c7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8489647547d544a681131dad99e058bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:50.787566 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa5f3c-9c89-4f4d-bf09-ccde2c629c7d service placement] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:50.788147 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa5f3c-9c89-4f4d-bf09-ccde2c629c7d service placement] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:50.788472 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa5f3c-9c89-4f4d-bf09-ccde2c629c7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:50.790529 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-aaaa5f3c-9c89-4f4d-bf09-ccde2c629c7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:50.805204 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa5f3c-9c89-4f4d-bf09-ccde2c629c7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:50.807310 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa5f3c-9c89-4f4d-bf09-ccde2c629c7d service placement] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:50.818443 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1361/2743] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:13:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:13:52.380207 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bb379-a80b-40d6-b8fa-73d4904479e0 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:52.380777 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bb379-a80b-40d6-b8fa-73d4904479e0 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:52.380777 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bb379-a80b-40d6-b8fa-73d4904479e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:52.408683 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-0f3bb379-a80b-40d6-b8fa-73d4904479e0 None None] MFA Rules not processed for user `1555c9543d5f4c1a85a48e04b612cad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:13:52.410705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0f3bb379-a80b-40d6-b8fa-73d4904479e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:52.487132 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1383/2744] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:13:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:13:52.488979 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa5f3c-9c89-4f4d-bf09-ccde2c629c7d service placement] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:52.500165 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa5f3c-9c89-4f4d-bf09-ccde2c629c7d service placement] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:52.506398 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f5949-8a3e-43f3-9d4f-706b9450365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:52.507110 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f5949-8a3e-43f3-9d4f-706b9450365d admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:52.507392 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f5949-8a3e-43f3-9d4f-706b9450365d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:52.507665 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f5949-8a3e-43f3-9d4f-706b9450365d admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:52.508556 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f5949-8a3e-43f3-9d4f-706b9450365d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:52.510504 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f5949-8a3e-43f3-9d4f-706b9450365d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:52.540294 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1362/2745] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:13:52 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:13:52.544904 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bb379-a80b-40d6-b8fa-73d4904479e0 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:52.556919 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bb379-a80b-40d6-b8fa-73d4904479e0 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:52.625433 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60da422-60e4-4230-852c-849d0e43fc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:52.626125 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60da422-60e4-4230-852c-849d0e43fc61 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:52.626410 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60da422-60e4-4230-852c-849d0e43fc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:52.626685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60da422-60e4-4230-852c-849d0e43fc61 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:52.627447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60da422-60e4-4230-852c-849d0e43fc61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:52.630300 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60da422-60e4-4230-852c-849d0e43fc61 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:52.655685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1384/2746] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:13:52 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:13:52.660208 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f5949-8a3e-43f3-9d4f-706b9450365d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:52.674523 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f5949-8a3e-43f3-9d4f-706b9450365d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:52.679134 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb843ad-0b7e-4f6e-91ca-b5292d80c254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:52.679791 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb843ad-0b7e-4f6e-91ca-b5292d80c254 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:52.680070 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb843ad-0b7e-4f6e-91ca-b5292d80c254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:52.680344 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb843ad-0b7e-4f6e-91ca-b5292d80c254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:52.681191 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb843ad-0b7e-4f6e-91ca-b5292d80c254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:52.683365 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb843ad-0b7e-4f6e-91ca-b5292d80c254 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:52.694531 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1363/2747] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:13:52.700449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60da422-60e4-4230-852c-849d0e43fc61 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:52.710784 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60da422-60e4-4230-852c-849d0e43fc61 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:52.715842 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5552612-5416-4645-819c-fb7b60be35f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:52.716723 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5552612-5416-4645-819c-fb7b60be35f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:52.717040 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5552612-5416-4645-819c-fb7b60be35f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:52.717317 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5552612-5416-4645-819c-fb7b60be35f5 admin admin] PATH_INFO: `/v3/projects/7605c13f05ee40b38c99111c5042d0a1/users/27e6b1fef7ca43559df88d097872becf/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:52.732907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5552612-5416-4645-819c-fb7b60be35f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7605c13f05ee40b38c99111c5042d0a1, user_id=27e6b1fef7ca43559df88d097872becf, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:52.735799 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5552612-5416-4645-819c-fb7b60be35f5 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:52.756059 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1385/2748] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:13:52 2022] PUT /identity/v3/projects/7605c13f05ee40b38c99111c5042d0a1/users/27e6b1fef7ca43559df88d097872becf/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:13:52.765622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb843ad-0b7e-4f6e-91ca-b5292d80c254 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:52.779288 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb843ad-0b7e-4f6e-91ca-b5292d80c254 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:52.848218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a61440-6828-41fa-9a40-ab91dc49ca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:52.848959 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a61440-6828-41fa-9a40-ab91dc49ca55 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:52.849218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a61440-6828-41fa-9a40-ab91dc49ca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:52.849497 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a61440-6828-41fa-9a40-ab91dc49ca55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:52.850239 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a61440-6828-41fa-9a40-ab91dc49ca55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:52.851927 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a61440-6828-41fa-9a40-ab91dc49ca55 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:52.863036 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1364/2749] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:13:52.867269 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5552612-5416-4645-819c-fb7b60be35f5 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:52.879016 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5552612-5416-4645-819c-fb7b60be35f5 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:52.883829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305001d5-8bf7-425b-b92d-4cef521a8df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:52.884715 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305001d5-8bf7-425b-b92d-4cef521a8df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:52.885032 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305001d5-8bf7-425b-b92d-4cef521a8df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:52.885311 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305001d5-8bf7-425b-b92d-4cef521a8df0 admin admin] PATH_INFO: `/v3/projects/7605c13f05ee40b38c99111c5042d0a1/users/27e6b1fef7ca43559df88d097872becf/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:52.887555 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305001d5-8bf7-425b-b92d-4cef521a8df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7605c13f05ee40b38c99111c5042d0a1, user_id=27e6b1fef7ca43559df88d097872becf, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:52.890374 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305001d5-8bf7-425b-b92d-4cef521a8df0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:52.903110 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1386/2750] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:13:52 2022] PUT /identity/v3/projects/7605c13f05ee40b38c99111c5042d0a1/users/27e6b1fef7ca43559df88d097872becf/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:13:53.619215 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a61440-6828-41fa-9a40-ab91dc49ca55 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:53.621863 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-52a61440-6828-41fa-9a40-ab91dc49ca55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:53.699819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a61440-6828-41fa-9a40-ab91dc49ca55 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:53.767703 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97ed3d-b702-4074-b18c-ca258f295a8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:53.768722 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97ed3d-b702-4074-b18c-ca258f295a8e service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:53.769180 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97ed3d-b702-4074-b18c-ca258f295a8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:53.769858 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97ed3d-b702-4074-b18c-ca258f295a8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:53.772165 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3f97ed3d-b702-4074-b18c-ca258f295a8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:53.848540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97ed3d-b702-4074-b18c-ca258f295a8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:53.850224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97ed3d-b702-4074-b18c-ca258f295a8e service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:53.861247 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1365/2751] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:13:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:13:57.367837 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c341782-6651-4a11-abf1-9c89520745d8 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:57.368353 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c341782-6651-4a11-abf1-9c89520745d8 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:57.368449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c341782-6651-4a11-abf1-9c89520745d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:57.400614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9c341782-6651-4a11-abf1-9c89520745d8 None None] MFA Rules not processed for user `27e6b1fef7ca43559df88d097872becf`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:13:57.402564 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9c341782-6651-4a11-abf1-9c89520745d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:57.475947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1387/2752] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:13:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:13:57.488359 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97ed3d-b702-4074-b18c-ca258f295a8e service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:57.489810 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3f97ed3d-b702-4074-b18c-ca258f295a8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:57.567445 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97ed3d-b702-4074-b18c-ca258f295a8e service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:57.571693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd43536-2eaa-48fc-9ddf-0277d579895f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93e04bf8c51c4d89bbb45e96223e7409', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:57.572610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd43536-2eaa-48fc-9ddf-0277d579895f service glance] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:57.573073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd43536-2eaa-48fc-9ddf-0277d579895f service glance] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:57.574141 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd43536-2eaa-48fc-9ddf-0277d579895f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:57.647205 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd43536-2eaa-48fc-9ddf-0277d579895f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:57.649155 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd43536-2eaa-48fc-9ddf-0277d579895f service glance] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:57.658999 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1366/2753] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:13:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:13:57.787088 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd017a9-3fb4-4938-8cc1-dd30772cae46 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:57.787298 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd017a9-3fb4-4938-8cc1-dd30772cae46 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:57.787549 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd017a9-3fb4-4938-8cc1-dd30772cae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:57.808485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2cd017a9-3fb4-4938-8cc1-dd30772cae46 None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:13:57.809854 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2cd017a9-3fb4-4938-8cc1-dd30772cae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:57.870354 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1388/2754] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 27 05:13:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:13:57.884623 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd43536-2eaa-48fc-9ddf-0277d579895f service glance] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:13:57.886329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fcd43536-2eaa-48fc-9ddf-0277d579895f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:13:57.975746 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd43536-2eaa-48fc-9ddf-0277d579895f service glance] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:13:57.982730 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bb2c8-1c9a-458e-8627-22702fecbac8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:13:57.983430 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bb2c8-1c9a-458e-8627-22702fecbac8 service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:13:57.983711 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bb2c8-1c9a-458e-8627-22702fecbac8 service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:13:57.983988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bb2c8-1c9a-458e-8627-22702fecbac8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:13:57.992857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bb2c8-1c9a-458e-8627-22702fecbac8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:13:57.994515 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bb2c8-1c9a-458e-8627-22702fecbac8 service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:13:58.004225 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1367/2755] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 05:13:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 05:14:01.060970 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7728f79-a1dd-474c-9656-63cab6a58b27 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:14:01.061531 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7728f79-a1dd-474c-9656-63cab6a58b27 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:14:01.061531 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7728f79-a1dd-474c-9656-63cab6a58b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:14:01.094684 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d7728f79-a1dd-474c-9656-63cab6a58b27 None None] MFA Rules not processed for user `fc9b5f276d17426fa2dca5dd1d35505e`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:14:01.096009 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d7728f79-a1dd-474c-9656-63cab6a58b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:14:01.106258 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1389/2756] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:14:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:14:07.587032 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7199cf-86e6-4203-8ce9-2427aa586eba None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:14:07.587550 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7199cf-86e6-4203-8ce9-2427aa586eba None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:14:07.587654 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7199cf-86e6-4203-8ce9-2427aa586eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:14:07.610872 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-db7199cf-86e6-4203-8ce9-2427aa586eba None None] MFA Rules not processed for user `1555c9543d5f4c1a85a48e04b612cad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:14:07.612337 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-db7199cf-86e6-4203-8ce9-2427aa586eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:14:07.619081 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1368/2757] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:14:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:14:09.363373 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743880f8-6d02-4766-a78e-81640d7bce42 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:14:09.363875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743880f8-6d02-4766-a78e-81640d7bce42 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:14:09.364002 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743880f8-6d02-4766-a78e-81640d7bce42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:14:09.384934 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-743880f8-6d02-4766-a78e-81640d7bce42 None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:14:09.386384 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-743880f8-6d02-4766-a78e-81640d7bce42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:14:09.394577 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1390/2758] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Sep 27 05:14:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:14:09.409410 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7199cf-86e6-4203-8ce9-2427aa586eba None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:14:09.422563 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7199cf-86e6-4203-8ce9-2427aa586eba None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:14:09.427865 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c8f14-6892-4cfb-a476-5a8460a5606f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:14:09.428550 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c8f14-6892-4cfb-a476-5a8460a5606f service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:14:09.428870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c8f14-6892-4cfb-a476-5a8460a5606f service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:14:09.429139 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c8f14-6892-4cfb-a476-5a8460a5606f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:14:09.437925 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c8f14-6892-4cfb-a476-5a8460a5606f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:14:09.439507 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c8f14-6892-4cfb-a476-5a8460a5606f service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:14:09.447644 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1369/2759] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 05:14:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 27 05:14:40.308474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743880f8-6d02-4766-a78e-81640d7bce42 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:14:40.309903 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-743880f8-6d02-4766-a78e-81640d7bce42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:14:40.363924 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743880f8-6d02-4766-a78e-81640d7bce42 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:14:40.367518 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf7828-b070-45ed-bd08-a5e298c2e019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:14:40.368157 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7828-b070-45ed-bd08-a5e298c2e019 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:14:40.368439 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7828-b070-45ed-bd08-a5e298c2e019 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:14:40.368713 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf7828-b070-45ed-bd08-a5e298c2e019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:14:40.378027 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf7828-b070-45ed-bd08-a5e298c2e019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:14:40.379455 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf7828-b070-45ed-bd08-a5e298c2e019 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:14:40.389096 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1391/2760] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:14:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:15:52.993100 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c8f14-6892-4cfb-a476-5a8460a5606f service swift] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:15:53.004539 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c8f14-6892-4cfb-a476-5a8460a5606f service swift] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:15:53.009370 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ff5dd-1b37-4357-b9d7-a04c468bab90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:15:53.010339 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ff5dd-1b37-4357-b9d7-a04c468bab90 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:15:53.010622 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ff5dd-1b37-4357-b9d7-a04c468bab90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:15:53.010893 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ff5dd-1b37-4357-b9d7-a04c468bab90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:15:53.014050 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3d8ff5dd-1b37-4357-b9d7-a04c468bab90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:15:53.089927 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ff5dd-1b37-4357-b9d7-a04c468bab90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:15:53.091313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ff5dd-1b37-4357-b9d7-a04c468bab90 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:15:53.103068 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1370/2761] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:15:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:15:54.255737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b2908-c479-47ca-b569-eca1b7f22838 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:15:54.256211 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b2908-c479-47ca-b569-eca1b7f22838 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:15:54.256303 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b2908-c479-47ca-b569-eca1b7f22838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:15:54.274654 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-9e2b2908-c479-47ca-b569-eca1b7f22838 None None] MFA Rules not processed for user `d27fb10124d24c8ea208a4d020274269`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:15:54.275899 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-9e2b2908-c479-47ca-b569-eca1b7f22838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:15:54.283445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1392/2762] 10.222.0.27 () {58 vars in 967 bytes} [Tue Sep 27 05:15:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:15:54.323269 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ff5dd-1b37-4357-b9d7-a04c468bab90 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:15:54.335305 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ff5dd-1b37-4357-b9d7-a04c468bab90 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:15:54.340254 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dae809-8918-41eb-a79e-456729b55368 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfea15b51919441b921c10d02d11f693', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:15:54.340909 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dae809-8918-41eb-a79e-456729b55368 service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:15:54.341217 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dae809-8918-41eb-a79e-456729b55368 service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:15:54.341491 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dae809-8918-41eb-a79e-456729b55368 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:15:54.351143 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dae809-8918-41eb-a79e-456729b55368 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:15:54.352812 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dae809-8918-41eb-a79e-456729b55368 service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:15:54.360941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1371/2763] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Sep 27 05:15:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 27 05:16:01.078808 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b2908-c479-47ca-b569-eca1b7f22838 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:01.143039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b2908-c479-47ca-b569-eca1b7f22838 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:01.147599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac38cc-fea5-4c9b-9cea-1029db487480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:01.148464 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac38cc-fea5-4c9b-9cea-1029db487480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:01.148740 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac38cc-fea5-4c9b-9cea-1029db487480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:01.149041 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac38cc-fea5-4c9b-9cea-1029db487480 admin admin] PATH_INFO: `/v3/users/1555c9543d5f4c1a85a48e04b612cad9` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:01.150256 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac38cc-fea5-4c9b-9cea-1029db487480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1555c9543d5f4c1a85a48e04b612cad9)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:01.152181 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac38cc-fea5-4c9b-9cea-1029db487480 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:01.199583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-09ac38cc-fea5-4c9b-9cea-1029db487480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1555c9543d5f4c1a85a48e04b612cad9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:01.200335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-09ac38cc-fea5-4c9b-9cea-1029db487480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1555c9543d5f4c1a85a48e04b612cad9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:01.201204 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-09ac38cc-fea5-4c9b-9cea-1029db487480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1555c9543d5f4c1a85a48e04b612cad9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:01.209282 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-09ac38cc-fea5-4c9b-9cea-1029db487480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1555c9543d5f4c1a85a48e04b612cad9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:01.221798 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-09ac38cc-fea5-4c9b-9cea-1029db487480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1555c9543d5f4c1a85a48e04b612cad9'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:01.234525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1393/2764] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:16:01 2022] DELETE /identity/v3/users/1555c9543d5f4c1a85a48e04b612cad9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:16:01.426485 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dae809-8918-41eb-a79e-456729b55368 service swift] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:01.439102 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dae809-8918-41eb-a79e-456729b55368 service swift] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:01.515525 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87acab9-45bb-4e8f-80c3-3772ae314b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:01.516842 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87acab9-45bb-4e8f-80c3-3772ae314b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:01.517467 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87acab9-45bb-4e8f-80c3-3772ae314b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:01.517978 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87acab9-45bb-4e8f-80c3-3772ae314b51 admin admin] PATH_INFO: `/v3/projects/505f8ca50e7042bfadcc5b9b5c433696` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:01.522009 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87acab9-45bb-4e8f-80c3-3772ae314b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=505f8ca50e7042bfadcc5b9b5c433696)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:01.524331 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87acab9-45bb-4e8f-80c3-3772ae314b51 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:01.618768 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f87acab9-45bb-4e8f-80c3-3772ae314b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '505f8ca50e7042bfadcc5b9b5c433696', 'request_id': 'req-f87acab9-45bb-4e8f-80c3-3772ae314b51'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:01.636922 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f87acab9-45bb-4e8f-80c3-3772ae314b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '505f8ca50e7042bfadcc5b9b5c433696', 'request_id': 'req-f87acab9-45bb-4e8f-80c3-3772ae314b51'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:01.647754 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f87acab9-45bb-4e8f-80c3-3772ae314b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '505f8ca50e7042bfadcc5b9b5c433696', 'request_id': 'req-f87acab9-45bb-4e8f-80c3-3772ae314b51'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:01.664346 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f87acab9-45bb-4e8f-80c3-3772ae314b51 admin admin] The token cache is being invalidate because project 505f8ca50e7042bfadcc5b9b5c433696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:16:01.664894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f87acab9-45bb-4e8f-80c3-3772ae314b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:01.666043 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f87acab9-45bb-4e8f-80c3-3772ae314b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:01.669066 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1372/2765] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:16:01 2022] DELETE /identity/v3/projects/505f8ca50e7042bfadcc5b9b5c433696 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:16:01.673797 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac38cc-fea5-4c9b-9cea-1029db487480 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:01.676220 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-09ac38cc-fea5-4c9b-9cea-1029db487480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:01.696271 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac38cc-fea5-4c9b-9cea-1029db487480 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:01.779150 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af47e7a-bb5c-4654-b115-c6dab8b5eb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:01.781559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af47e7a-bb5c-4654-b115-c6dab8b5eb89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:01.781559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af47e7a-bb5c-4654-b115-c6dab8b5eb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:01.781559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af47e7a-bb5c-4654-b115-c6dab8b5eb89 admin admin] PATH_INFO: `/v3/users/27e6b1fef7ca43559df88d097872becf` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:01.782690 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af47e7a-bb5c-4654-b115-c6dab8b5eb89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e6b1fef7ca43559df88d097872becf)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:01.784862 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af47e7a-bb5c-4654-b115-c6dab8b5eb89 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:01.840578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7af47e7a-bb5c-4654-b115-c6dab8b5eb89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e6b1fef7ca43559df88d097872becf'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:01.841409 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7af47e7a-bb5c-4654-b115-c6dab8b5eb89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e6b1fef7ca43559df88d097872becf'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:01.842111 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7af47e7a-bb5c-4654-b115-c6dab8b5eb89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e6b1fef7ca43559df88d097872becf'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:01.850384 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7af47e7a-bb5c-4654-b115-c6dab8b5eb89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e6b1fef7ca43559df88d097872becf'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:01.864322 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7af47e7a-bb5c-4654-b115-c6dab8b5eb89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e6b1fef7ca43559df88d097872becf'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:01.878758 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1394/2766] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:16:01 2022] DELETE /identity/v3/users/27e6b1fef7ca43559df88d097872becf => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:16:02.068897 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87acab9-45bb-4e8f-80c3-3772ae314b51 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:02.071151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f87acab9-45bb-4e8f-80c3-3772ae314b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:02.086078 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87acab9-45bb-4e8f-80c3-3772ae314b51 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:02.144864 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff04d8-983e-42a0-905a-2113130588c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:02.145845 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff04d8-983e-42a0-905a-2113130588c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:02.146159 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff04d8-983e-42a0-905a-2113130588c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:02.146435 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff04d8-983e-42a0-905a-2113130588c6 admin admin] PATH_INFO: `/v3/projects/7605c13f05ee40b38c99111c5042d0a1` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:02.147647 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff04d8-983e-42a0-905a-2113130588c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7605c13f05ee40b38c99111c5042d0a1)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:02.149591 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff04d8-983e-42a0-905a-2113130588c6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:02.196490 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5cff04d8-983e-42a0-905a-2113130588c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7605c13f05ee40b38c99111c5042d0a1', 'request_id': 'req-5cff04d8-983e-42a0-905a-2113130588c6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:02.205416 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5cff04d8-983e-42a0-905a-2113130588c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7605c13f05ee40b38c99111c5042d0a1', 'request_id': 'req-5cff04d8-983e-42a0-905a-2113130588c6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:02.212161 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5cff04d8-983e-42a0-905a-2113130588c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7605c13f05ee40b38c99111c5042d0a1', 'request_id': 'req-5cff04d8-983e-42a0-905a-2113130588c6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:02.222875 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5cff04d8-983e-42a0-905a-2113130588c6 admin admin] The token cache is being invalidate because project 7605c13f05ee40b38c99111c5042d0a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:16:02.223160 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5cff04d8-983e-42a0-905a-2113130588c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:02.223807 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5cff04d8-983e-42a0-905a-2113130588c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:02.225366 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1373/2767] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:16:02 2022] DELETE /identity/v3/projects/7605c13f05ee40b38c99111c5042d0a1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:16:02.230643 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce52fd1-1cdf-40ac-bbb6-b9cb60b96cb6 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:02.231145 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce52fd1-1cdf-40ac-bbb6-b9cb60b96cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:02.231245 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce52fd1-1cdf-40ac-bbb6-b9cb60b96cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:02.250250 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-7ce52fd1-1cdf-40ac-bbb6-b9cb60b96cb6 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:16:02.252321 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7ce52fd1-1cdf-40ac-bbb6-b9cb60b96cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:02.315205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1395/2768] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:16:02.323413 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb250b3-77d6-4972-b39c-20ff3ae6e407 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:02.323713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb250b3-77d6-4972-b39c-20ff3ae6e407 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:02.323992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb250b3-77d6-4972-b39c-20ff3ae6e407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:02.343596 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2fb250b3-77d6-4972-b39c-20ff3ae6e407 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:16:02.344659 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2fb250b3-77d6-4972-b39c-20ff3ae6e407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:02.354692 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1374/2769] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:16:02.359199 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce52fd1-1cdf-40ac-bbb6-b9cb60b96cb6 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:02.369082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce52fd1-1cdf-40ac-bbb6-b9cb60b96cb6 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:02.373991 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd0ba1-1568-4509-a5d3-59b570e9d420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:02.374684 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd0ba1-1568-4509-a5d3-59b570e9d420 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:02.374994 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd0ba1-1568-4509-a5d3-59b570e9d420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:02.375270 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd0ba1-1568-4509-a5d3-59b570e9d420 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:02.376000 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd0ba1-1568-4509-a5d3-59b570e9d420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:16:02.376325 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd0ba1-1568-4509-a5d3-59b570e9d420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:02.378028 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd0ba1-1568-4509-a5d3-59b570e9d420 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:02.393808 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1396/2770] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:16:02.398112 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb250b3-77d6-4972-b39c-20ff3ae6e407 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:02.408399 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb250b3-77d6-4972-b39c-20ff3ae6e407 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:02.413413 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472f537-e42b-4e57-9097-55a6629487d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:02.414093 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f537-e42b-4e57-9097-55a6629487d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:02.414368 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f537-e42b-4e57-9097-55a6629487d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:02.414639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f537-e42b-4e57-9097-55a6629487d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:02.415333 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472f537-e42b-4e57-9097-55a6629487d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:02.417390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472f537-e42b-4e57-9097-55a6629487d3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:02.448912 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1375/2771] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:16:02 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:16:02.449974 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd0ba1-1568-4509-a5d3-59b570e9d420 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:02.460981 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd0ba1-1568-4509-a5d3-59b570e9d420 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:02.520188 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6aa5f9-a070-40cf-b7e2-6a8878d0882d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:02.520917 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aa5f9-a070-40cf-b7e2-6a8878d0882d admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:02.521205 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aa5f9-a070-40cf-b7e2-6a8878d0882d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:02.521505 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6aa5f9-a070-40cf-b7e2-6a8878d0882d admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:02.522208 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6aa5f9-a070-40cf-b7e2-6a8878d0882d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:02.524129 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6aa5f9-a070-40cf-b7e2-6a8878d0882d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:02.543322 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1397/2772] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:16:02 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:16:02.547729 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472f537-e42b-4e57-9097-55a6629487d3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:02.558122 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472f537-e42b-4e57-9097-55a6629487d3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:02.563610 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d866c-ae63-4a82-b4f3-8f7fb3335c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:02.564283 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d866c-ae63-4a82-b4f3-8f7fb3335c46 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:02.564567 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d866c-ae63-4a82-b4f3-8f7fb3335c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:02.564867 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d866c-ae63-4a82-b4f3-8f7fb3335c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:02.565604 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d866c-ae63-4a82-b4f3-8f7fb3335c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:02.567222 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d866c-ae63-4a82-b4f3-8f7fb3335c46 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:02.579426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1376/2773] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:16:02.583424 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6aa5f9-a070-40cf-b7e2-6a8878d0882d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:02.593427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6aa5f9-a070-40cf-b7e2-6a8878d0882d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:02.598123 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0cd38-0c9d-4b1b-a189-32440f6d872f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:02.598743 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0cd38-0c9d-4b1b-a189-32440f6d872f admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:02.599025 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0cd38-0c9d-4b1b-a189-32440f6d872f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:02.599343 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0cd38-0c9d-4b1b-a189-32440f6d872f admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:02.600064 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0cd38-0c9d-4b1b-a189-32440f6d872f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:02.601673 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0cd38-0c9d-4b1b-a189-32440f6d872f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:02.612018 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1398/2774] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:16:02.615904 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d866c-ae63-4a82-b4f3-8f7fb3335c46 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:02.626579 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d866c-ae63-4a82-b4f3-8f7fb3335c46 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:02.631174 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c59127-693b-45ea-b14d-14426b3b429d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:02.632095 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c59127-693b-45ea-b14d-14426b3b429d admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:02.632373 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c59127-693b-45ea-b14d-14426b3b429d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:02.632644 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c59127-693b-45ea-b14d-14426b3b429d admin admin] PATH_INFO: `/v3/projects/89e5839579a747caaa9b2e0712499dca/users/b4894c9e9f914351a69aed7e00761e08/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:02.647470 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c59127-693b-45ea-b14d-14426b3b429d admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e5839579a747caaa9b2e0712499dca, user_id=b4894c9e9f914351a69aed7e00761e08, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:02.650158 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c59127-693b-45ea-b14d-14426b3b429d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:02.662794 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1377/2775] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:16:02 2022] PUT /identity/v3/projects/89e5839579a747caaa9b2e0712499dca/users/b4894c9e9f914351a69aed7e00761e08/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:16:02.667797 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dc469-96de-46da-b607-265d758b5c1f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:02.668089 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dc469-96de-46da-b607-265d758b5c1f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:02.668365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dc469-96de-46da-b607-265d758b5c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:02.685659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-626dc469-96de-46da-b607-265d758b5c1f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:16:02.687371 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-626dc469-96de-46da-b607-265d758b5c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:02.743844 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1399/2776] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:16:02.754706 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c59127-693b-45ea-b14d-14426b3b429d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:02.756724 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d8c59127-693b-45ea-b14d-14426b3b429d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:02.784122 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626dc469-96de-46da-b607-265d758b5c1f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:02.785504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-626dc469-96de-46da-b607-265d758b5c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:02.814569 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c59127-693b-45ea-b14d-14426b3b429d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:02.818335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e30ba-4911-4405-94dc-9955c2e1664c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:02.818981 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e30ba-4911-4405-94dc-9955c2e1664c service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:02.819265 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e30ba-4911-4405-94dc-9955c2e1664c service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:02.819541 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e30ba-4911-4405-94dc-9955c2e1664c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:02.829049 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e30ba-4911-4405-94dc-9955c2e1664c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:02.830514 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e30ba-4911-4405-94dc-9955c2e1664c service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:02.840427 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1378/2777] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:16:02.844989 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626dc469-96de-46da-b607-265d758b5c1f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:02.849049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530580ae-85fa-4974-85e5-800d8cf25861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:02.849692 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530580ae-85fa-4974-85e5-800d8cf25861 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:02.849970 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530580ae-85fa-4974-85e5-800d8cf25861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:02.850239 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530580ae-85fa-4974-85e5-800d8cf25861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:02.852251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-530580ae-85fa-4974-85e5-800d8cf25861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:02.926475 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530580ae-85fa-4974-85e5-800d8cf25861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:02.928379 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530580ae-85fa-4974-85e5-800d8cf25861 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:02.941302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1400/2778] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:16:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:16:07.241322 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eddcc-99f6-4849-80fa-5c3fed24c40a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:07.241836 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eddcc-99f6-4849-80fa-5c3fed24c40a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:07.241945 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64eddcc-99f6-4849-80fa-5c3fed24c40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:07.269020 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d64eddcc-99f6-4849-80fa-5c3fed24c40a None None] MFA Rules not processed for user `b4894c9e9f914351a69aed7e00761e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:16:07.270222 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d64eddcc-99f6-4849-80fa-5c3fed24c40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:07.355229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1379/2779] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:16:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:16:07.359869 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530580ae-85fa-4974-85e5-800d8cf25861 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:07.372325 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530580ae-85fa-4974-85e5-800d8cf25861 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:07.380031 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76698f-303d-4dcf-b958-e19d056c0bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:07.380737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76698f-303d-4dcf-b958-e19d056c0bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:07.381072 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76698f-303d-4dcf-b958-e19d056c0bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:07.381350 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76698f-303d-4dcf-b958-e19d056c0bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:07.382055 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76698f-303d-4dcf-b958-e19d056c0bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:07.383983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76698f-303d-4dcf-b958-e19d056c0bf8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:07.412834 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1401/2780] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:16:07 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:16:07.416675 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eddcc-99f6-4849-80fa-5c3fed24c40a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:07.428556 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64eddcc-99f6-4849-80fa-5c3fed24c40a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:07.494106 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939bd74-85aa-4575-9d80-d2af384cf68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:07.494796 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939bd74-85aa-4575-9d80-d2af384cf68d admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:07.495257 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939bd74-85aa-4575-9d80-d2af384cf68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:07.495540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939bd74-85aa-4575-9d80-d2af384cf68d admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:07.496243 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939bd74-85aa-4575-9d80-d2af384cf68d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:07.498313 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939bd74-85aa-4575-9d80-d2af384cf68d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:07.522323 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1380/2781] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:16:07 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:16:07.526241 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76698f-303d-4dcf-b958-e19d056c0bf8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:07.537790 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76698f-303d-4dcf-b958-e19d056c0bf8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:07.542522 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e0cf6-1123-4ca6-abd5-3a03fcf9b53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:07.543196 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e0cf6-1123-4ca6-abd5-3a03fcf9b53b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:07.543480 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e0cf6-1123-4ca6-abd5-3a03fcf9b53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:07.543761 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e0cf6-1123-4ca6-abd5-3a03fcf9b53b admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:07.544520 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e0cf6-1123-4ca6-abd5-3a03fcf9b53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:07.546440 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e0cf6-1123-4ca6-abd5-3a03fcf9b53b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:07.558630 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1402/2782] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:16:07.562409 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939bd74-85aa-4575-9d80-d2af384cf68d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:07.573642 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939bd74-85aa-4575-9d80-d2af384cf68d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:07.580870 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09883756-ff1e-4f25-bd6e-c1207deffdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:07.581906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09883756-ff1e-4f25-bd6e-c1207deffdfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:07.582277 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09883756-ff1e-4f25-bd6e-c1207deffdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:07.582718 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09883756-ff1e-4f25-bd6e-c1207deffdfa admin admin] PATH_INFO: `/v3/projects/fcf9a652487149e697216ccac9464a91/users/9dfc0729cb374370b17e98d9696f491b/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:07.602090 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09883756-ff1e-4f25-bd6e-c1207deffdfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf9a652487149e697216ccac9464a91, user_id=9dfc0729cb374370b17e98d9696f491b, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:07.605120 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09883756-ff1e-4f25-bd6e-c1207deffdfa admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:07.627402 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1381/2783] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:16:07 2022] PUT /identity/v3/projects/fcf9a652487149e697216ccac9464a91/users/9dfc0729cb374370b17e98d9696f491b/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:16:07.631449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e0cf6-1123-4ca6-abd5-3a03fcf9b53b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:07.648600 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e0cf6-1123-4ca6-abd5-3a03fcf9b53b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:07.753446 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d19c0c-6dfd-4cb7-8ce0-f2def15d557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:07.754365 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d19c0c-6dfd-4cb7-8ce0-f2def15d557d admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:07.754755 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d19c0c-6dfd-4cb7-8ce0-f2def15d557d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:07.755142 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d19c0c-6dfd-4cb7-8ce0-f2def15d557d admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:07.755988 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d19c0c-6dfd-4cb7-8ce0-f2def15d557d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:07.757721 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d19c0c-6dfd-4cb7-8ce0-f2def15d557d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:07.778804 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1403/2784] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:16:07.780527 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09883756-ff1e-4f25-bd6e-c1207deffdfa admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:07.794883 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09883756-ff1e-4f25-bd6e-c1207deffdfa admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:07.801194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e1107-fe9b-4847-ae19-b72a582323d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:07.802106 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e1107-fe9b-4847-ae19-b72a582323d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:07.802381 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e1107-fe9b-4847-ae19-b72a582323d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:07.802668 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e1107-fe9b-4847-ae19-b72a582323d7 admin admin] PATH_INFO: `/v3/projects/fcf9a652487149e697216ccac9464a91/users/9dfc0729cb374370b17e98d9696f491b/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:07.804738 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e1107-fe9b-4847-ae19-b72a582323d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf9a652487149e697216ccac9464a91, user_id=9dfc0729cb374370b17e98d9696f491b, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:07.808237 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e1107-fe9b-4847-ae19-b72a582323d7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:07.840220 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1382/2785] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:16:07 2022] PUT /identity/v3/projects/fcf9a652487149e697216ccac9464a91/users/9dfc0729cb374370b17e98d9696f491b/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:16:13.353564 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348ca19-0c89-46ec-8472-4d5ff4af8631 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:13.354089 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348ca19-0c89-46ec-8472-4d5ff4af8631 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:13.354477 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348ca19-0c89-46ec-8472-4d5ff4af8631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:13.386387 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3348ca19-0c89-46ec-8472-4d5ff4af8631 None None] MFA Rules not processed for user `9dfc0729cb374370b17e98d9696f491b`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:16:13.389311 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3348ca19-0c89-46ec-8472-4d5ff4af8631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:13.497297 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1404/2786] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:16:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:16:13.507867 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e1107-fe9b-4847-ae19-b72a582323d7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:13.510157 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d31e1107-fe9b-4847-ae19-b72a582323d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:13.659179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e1107-fe9b-4847-ae19-b72a582323d7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:13.669699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ec961-579b-4c86-8d0f-cc0dd6a20b52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:13.670400 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ec961-579b-4c86-8d0f-cc0dd6a20b52 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:13.670658 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ec961-579b-4c86-8d0f-cc0dd6a20b52 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:13.670937 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ec961-579b-4c86-8d0f-cc0dd6a20b52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:13.764125 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ec961-579b-4c86-8d0f-cc0dd6a20b52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:13.767558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ec961-579b-4c86-8d0f-cc0dd6a20b52 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:13.808906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1383/2787] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:16:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:16:15.017705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348ca19-0c89-46ec-8472-4d5ff4af8631 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:15.152774 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348ca19-0c89-46ec-8472-4d5ff4af8631 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:15.163231 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05890b16-f868-4dc8-968d-a860d33f06b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:15.164485 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05890b16-f868-4dc8-968d-a860d33f06b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:15.165157 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05890b16-f868-4dc8-968d-a860d33f06b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:15.165517 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05890b16-f868-4dc8-968d-a860d33f06b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:15.168440 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-05890b16-f868-4dc8-968d-a860d33f06b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:15.256951 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05890b16-f868-4dc8-968d-a860d33f06b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:15.258480 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05890b16-f868-4dc8-968d-a860d33f06b2 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:15.271390 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1405/2788] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:16:15.341757 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c1c38-fa8c-4e95-a5ad-ca094fff1eb2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:15.342814 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c1c38-fa8c-4e95-a5ad-ca094fff1eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:15.342814 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c1c38-fa8c-4e95-a5ad-ca094fff1eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:15.368355 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-829c1c38-fa8c-4e95-a5ad-ca094fff1eb2 None None] MFA Rules not processed for user `b4894c9e9f914351a69aed7e00761e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:16:15.369614 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-829c1c38-fa8c-4e95-a5ad-ca094fff1eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:15.377907 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1384/2789] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:16:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:16:19.061582 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094215b1-f5aa-433c-b375-de6fcc687345 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:19.062357 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094215b1-f5aa-433c-b375-de6fcc687345 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:19.062357 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094215b1-f5aa-433c-b375-de6fcc687345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:19.093346 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-094215b1-f5aa-433c-b375-de6fcc687345 None None] MFA Rules not processed for user `d2a95bcb895549578da19e7d723cebb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:16:19.094579 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-094215b1-f5aa-433c-b375-de6fcc687345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:19.201907 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1406/2790] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:16:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:16:19.852520 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c1c38-fa8c-4e95-a5ad-ca094fff1eb2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:19.854064 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-829c1c38-fa8c-4e95-a5ad-ca094fff1eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:19.948628 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c1c38-fa8c-4e95-a5ad-ca094fff1eb2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:19.958639 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ebe54-b862-4b0d-a8fc-05b2c61f2bd8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8489647547d544a681131dad99e058bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:19.959249 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ebe54-b862-4b0d-a8fc-05b2c61f2bd8 service placement] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:19.959576 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ebe54-b862-4b0d-a8fc-05b2c61f2bd8 service placement] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:19.962187 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ebe54-b862-4b0d-a8fc-05b2c61f2bd8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:19.964196 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d84ebe54-b862-4b0d-a8fc-05b2c61f2bd8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:19.977628 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ebe54-b862-4b0d-a8fc-05b2c61f2bd8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:19.979731 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ebe54-b862-4b0d-a8fc-05b2c61f2bd8 service placement] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:19.997588 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1385/2791] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:16:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:16:23.895762 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094215b1-f5aa-433c-b375-de6fcc687345 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:23.897380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-094215b1-f5aa-433c-b375-de6fcc687345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:23.915967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094215b1-f5aa-433c-b375-de6fcc687345 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:23.921142 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91564f-ece1-452b-a042-f28d0d1909ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:23.922035 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91564f-ece1-452b-a042-f28d0d1909ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:23.922311 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91564f-ece1-452b-a042-f28d0d1909ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:23.922584 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91564f-ece1-452b-a042-f28d0d1909ad admin admin] PATH_INFO: `/v3/users/fc9b5f276d17426fa2dca5dd1d35505e` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:23.923804 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91564f-ece1-452b-a042-f28d0d1909ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc9b5f276d17426fa2dca5dd1d35505e)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:23.925778 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91564f-ece1-452b-a042-f28d0d1909ad admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:23.981279 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cd91564f-ece1-452b-a042-f28d0d1909ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc9b5f276d17426fa2dca5dd1d35505e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:23.981953 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cd91564f-ece1-452b-a042-f28d0d1909ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc9b5f276d17426fa2dca5dd1d35505e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:23.982624 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cd91564f-ece1-452b-a042-f28d0d1909ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc9b5f276d17426fa2dca5dd1d35505e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:23.991504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cd91564f-ece1-452b-a042-f28d0d1909ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc9b5f276d17426fa2dca5dd1d35505e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.007795 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-cd91564f-ece1-452b-a042-f28d0d1909ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc9b5f276d17426fa2dca5dd1d35505e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.021285 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1407/2792] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:16:23 2022] DELETE /identity/v3/users/fc9b5f276d17426fa2dca5dd1d35505e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:16:24.205118 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ebe54-b862-4b0d-a8fc-05b2c61f2bd8 service placement] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:24.217883 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ebe54-b862-4b0d-a8fc-05b2c61f2bd8 service placement] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:24.277671 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:24.278530 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:24.278805 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:24.279075 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de admin admin] PATH_INFO: `/v3/projects/dd9cd5a85d76484386fc1b7e91ce66c7` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:24.280518 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd9cd5a85d76484386fc1b7e91ce66c7)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:24.282497 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:24.328293 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd9cd5a85d76484386fc1b7e91ce66c7', 'request_id': 'req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.335597 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd9cd5a85d76484386fc1b7e91ce66c7', 'request_id': 'req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.342152 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd9cd5a85d76484386fc1b7e91ce66c7', 'request_id': 'req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.352723 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de admin admin] The token cache is being invalidate because project dd9cd5a85d76484386fc1b7e91ce66c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:16:24.353034 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.353742 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.355279 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1386/2793] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:16:24 2022] DELETE /identity/v3/projects/dd9cd5a85d76484386fc1b7e91ce66c7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:16:24.359318 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91564f-ece1-452b-a042-f28d0d1909ad admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:24.360725 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-cd91564f-ece1-452b-a042-f28d0d1909ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:24.374383 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91564f-ece1-452b-a042-f28d0d1909ad admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:24.431680 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400ee1b-166a-45ed-9bf9-e3e3ec3406ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:24.432550 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400ee1b-166a-45ed-9bf9-e3e3ec3406ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:24.433192 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400ee1b-166a-45ed-9bf9-e3e3ec3406ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:24.433480 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400ee1b-166a-45ed-9bf9-e3e3ec3406ff admin admin] PATH_INFO: `/v3/users/69d295f898444965b550c2e81c1bbf66` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:24.434675 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400ee1b-166a-45ed-9bf9-e3e3ec3406ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=69d295f898444965b550c2e81c1bbf66)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:24.437186 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400ee1b-166a-45ed-9bf9-e3e3ec3406ff admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:24.486051 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0400ee1b-166a-45ed-9bf9-e3e3ec3406ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69d295f898444965b550c2e81c1bbf66'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.486703 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0400ee1b-166a-45ed-9bf9-e3e3ec3406ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69d295f898444965b550c2e81c1bbf66'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.487308 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0400ee1b-166a-45ed-9bf9-e3e3ec3406ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69d295f898444965b550c2e81c1bbf66'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.494483 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0400ee1b-166a-45ed-9bf9-e3e3ec3406ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69d295f898444965b550c2e81c1bbf66'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.507061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0400ee1b-166a-45ed-9bf9-e3e3ec3406ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69d295f898444965b550c2e81c1bbf66'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.520427 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1408/2794] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:16:24 2022] DELETE /identity/v3/users/69d295f898444965b550c2e81c1bbf66 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:16:24.696001 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:24.697502 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:24.713440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcb9c3-8ec0-4cf7-91c5-9990d9d942de admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:24.773823 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:24.774721 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:24.775042 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:24.775325 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf admin admin] PATH_INFO: `/v3/projects/f215b2cd18cf479e978e48943466579e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:24.776530 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f215b2cd18cf479e978e48943466579e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:24.778624 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:24.825504 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f215b2cd18cf479e978e48943466579e', 'request_id': 'req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.833895 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f215b2cd18cf479e978e48943466579e', 'request_id': 'req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.840060 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f215b2cd18cf479e978e48943466579e', 'request_id': 'req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.850156 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf admin admin] The token cache is being invalidate because project f215b2cd18cf479e978e48943466579e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:16:24.850439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.851075 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:16:24.852617 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1387/2795] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:16:24 2022] DELETE /identity/v3/projects/f215b2cd18cf479e978e48943466579e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:16:45.494388 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400ee1b-166a-45ed-9bf9-e3e3ec3406ff admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:45.495802 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0400ee1b-166a-45ed-9bf9-e3e3ec3406ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:45.551525 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400ee1b-166a-45ed-9bf9-e3e3ec3406ff admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:45.598753 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bcfe4-1529-4992-88f4-950e46a82614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:45.599405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bcfe4-1529-4992-88f4-950e46a82614 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:45.599688 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bcfe4-1529-4992-88f4-950e46a82614 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:45.599965 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bcfe4-1529-4992-88f4-950e46a82614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:45.601791 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-001bcfe4-1529-4992-88f4-950e46a82614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:45.662385 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bcfe4-1529-4992-88f4-950e46a82614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:45.663836 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bcfe4-1529-4992-88f4-950e46a82614 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:45.673163 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1409/2796] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:16:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:16:47.551285 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:47.552737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:47.626342 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a8eff-d02e-45b0-b8b9-8bb0e7518dcf admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:47.633314 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b3f4f-0d2c-42e6-a72e-1270762125e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:47.633963 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b3f4f-0d2c-42e6-a72e-1270762125e9 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:47.634240 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b3f4f-0d2c-42e6-a72e-1270762125e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:47.634510 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b3f4f-0d2c-42e6-a72e-1270762125e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:47.636245 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-389b3f4f-0d2c-42e6-a72e-1270762125e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:47.649505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b3f4f-0d2c-42e6-a72e-1270762125e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:47.651241 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b3f4f-0d2c-42e6-a72e-1270762125e9 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:47.662684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1388/2797] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:16:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:16:47.724272 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bcfe4-1529-4992-88f4-950e46a82614 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:16:47.725855 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-001bcfe4-1529-4992-88f4-950e46a82614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:47.736871 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bcfe4-1529-4992-88f4-950e46a82614 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:16:47.741140 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e5a97-927d-4cbd-8c7a-a433c49168d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:16:47.741782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e5a97-927d-4cbd-8c7a-a433c49168d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:16:47.742062 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e5a97-927d-4cbd-8c7a-a433c49168d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:16:47.742335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e5a97-927d-4cbd-8c7a-a433c49168d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:16:47.744100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0f4e5a97-927d-4cbd-8c7a-a433c49168d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:16:47.753726 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e5a97-927d-4cbd-8c7a-a433c49168d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:16:47.755301 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e5a97-927d-4cbd-8c7a-a433c49168d7 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:16:47.763437 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1410/2798] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:16:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:17:30.456926 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b3f4f-0d2c-42e6-a72e-1270762125e9 service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:30.458570 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-389b3f4f-0d2c-42e6-a72e-1270762125e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:30.481786 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b3f4f-0d2c-42e6-a72e-1270762125e9 service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:30.487452 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf2de8-c851-4bd0-8593-2d8ad81894c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:30.488631 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf2de8-c851-4bd0-8593-2d8ad81894c9 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:30.488988 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf2de8-c851-4bd0-8593-2d8ad81894c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:30.489271 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf2de8-c851-4bd0-8593-2d8ad81894c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:30.491329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-40cf2de8-c851-4bd0-8593-2d8ad81894c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:30.505792 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf2de8-c851-4bd0-8593-2d8ad81894c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:30.509145 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf2de8-c851-4bd0-8593-2d8ad81894c9 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:30.523845 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1389/2799] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:17:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:17:38.611513 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e5a97-927d-4cbd-8c7a-a433c49168d7 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:38.613813 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0f4e5a97-927d-4cbd-8c7a-a433c49168d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:38.700923 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e5a97-927d-4cbd-8c7a-a433c49168d7 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:38.705400 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8f8bb-4b8b-4188-b72b-924e85cb9616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:38.706256 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8f8bb-4b8b-4188-b72b-924e85cb9616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:38.707073 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8f8bb-4b8b-4188-b72b-924e85cb9616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:38.707351 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8f8bb-4b8b-4188-b72b-924e85cb9616 admin admin] PATH_INFO: `/v3/users/d2a95bcb895549578da19e7d723cebb7` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:38.708692 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8f8bb-4b8b-4188-b72b-924e85cb9616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2a95bcb895549578da19e7d723cebb7)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:38.710682 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d8f8bb-4b8b-4188-b72b-924e85cb9616 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:38.754874 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-90d8f8bb-4b8b-4188-b72b-924e85cb9616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2a95bcb895549578da19e7d723cebb7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:38.755523 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-90d8f8bb-4b8b-4188-b72b-924e85cb9616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2a95bcb895549578da19e7d723cebb7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:38.756115 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-90d8f8bb-4b8b-4188-b72b-924e85cb9616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2a95bcb895549578da19e7d723cebb7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:38.763177 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-90d8f8bb-4b8b-4188-b72b-924e85cb9616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2a95bcb895549578da19e7d723cebb7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:38.775236 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-90d8f8bb-4b8b-4188-b72b-924e85cb9616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2a95bcb895549578da19e7d723cebb7'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:38.787402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1411/2800] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:17:38 2022] DELETE /identity/v3/users/d2a95bcb895549578da19e7d723cebb7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:38.965786 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf2de8-c851-4bd0-8593-2d8ad81894c9 service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:38.978193 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf2de8-c851-4bd0-8593-2d8ad81894c9 service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:39.034954 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604f7cb-69d3-4ade-84d8-be8a5ae519a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:39.035899 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604f7cb-69d3-4ade-84d8-be8a5ae519a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:39.036172 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604f7cb-69d3-4ade-84d8-be8a5ae519a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:39.036441 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604f7cb-69d3-4ade-84d8-be8a5ae519a3 admin admin] PATH_INFO: `/v3/projects/1dfb55fd8c674196b50d4d7fcb5cfa7f` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:39.037638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604f7cb-69d3-4ade-84d8-be8a5ae519a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dfb55fd8c674196b50d4d7fcb5cfa7f)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:39.039530 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604f7cb-69d3-4ade-84d8-be8a5ae519a3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:39.084949 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f604f7cb-69d3-4ade-84d8-be8a5ae519a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dfb55fd8c674196b50d4d7fcb5cfa7f', 'request_id': 'req-f604f7cb-69d3-4ade-84d8-be8a5ae519a3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:39.091997 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f604f7cb-69d3-4ade-84d8-be8a5ae519a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dfb55fd8c674196b50d4d7fcb5cfa7f', 'request_id': 'req-f604f7cb-69d3-4ade-84d8-be8a5ae519a3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:39.097915 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f604f7cb-69d3-4ade-84d8-be8a5ae519a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dfb55fd8c674196b50d4d7fcb5cfa7f', 'request_id': 'req-f604f7cb-69d3-4ade-84d8-be8a5ae519a3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:39.107627 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f604f7cb-69d3-4ade-84d8-be8a5ae519a3 admin admin] The token cache is being invalidate because project 1dfb55fd8c674196b50d4d7fcb5cfa7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:17:39.107907 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f604f7cb-69d3-4ade-84d8-be8a5ae519a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:39.108526 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f604f7cb-69d3-4ade-84d8-be8a5ae519a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:39.110021 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1390/2801] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:17:38 2022] DELETE /identity/v3/projects/1dfb55fd8c674196b50d4d7fcb5cfa7f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:39.115014 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc52bc-2c28-4e9f-914e-b6678431e25a None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:39.115480 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc52bc-2c28-4e9f-914e-b6678431e25a None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:39.115802 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc52bc-2c28-4e9f-914e-b6678431e25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:39.133369 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-24fc52bc-2c28-4e9f-914e-b6678431e25a None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:39.134549 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-24fc52bc-2c28-4e9f-914e-b6678431e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:39.193826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1412/2802] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:39.201448 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e6ea5-6cdd-468c-8194-c246fedec385 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:39.201741 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e6ea5-6cdd-468c-8194-c246fedec385 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:39.202021 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e6ea5-6cdd-468c-8194-c246fedec385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:39.221112 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ab4e6ea5-6cdd-468c-8194-c246fedec385 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:39.222453 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ab4e6ea5-6cdd-468c-8194-c246fedec385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:39.230419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1391/2803] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:39.234532 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc52bc-2c28-4e9f-914e-b6678431e25a None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:39.244067 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc52bc-2c28-4e9f-914e-b6678431e25a None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:39.248655 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfedd3f-6b82-488a-ab23-f3d72674a3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:39.249335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfedd3f-6b82-488a-ab23-f3d72674a3ca admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:39.249625 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfedd3f-6b82-488a-ab23-f3d72674a3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:39.249900 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfedd3f-6b82-488a-ab23-f3d72674a3ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:39.250621 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfedd3f-6b82-488a-ab23-f3d72674a3ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:17:39.250930 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfedd3f-6b82-488a-ab23-f3d72674a3ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:39.252564 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfedd3f-6b82-488a-ab23-f3d72674a3ca admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:39.264488 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1413/2804] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:17:39.268885 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e6ea5-6cdd-468c-8194-c246fedec385 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:39.278836 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e6ea5-6cdd-468c-8194-c246fedec385 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:39.283459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8326e0-dcf9-4ae6-9c52-b9fc654dbe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:39.284105 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8326e0-dcf9-4ae6-9c52-b9fc654dbe36 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:39.284384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8326e0-dcf9-4ae6-9c52-b9fc654dbe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:39.284674 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8326e0-dcf9-4ae6-9c52-b9fc654dbe36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:39.285819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8326e0-dcf9-4ae6-9c52-b9fc654dbe36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:39.287931 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8326e0-dcf9-4ae6-9c52-b9fc654dbe36 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:39.313375 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1392/2805] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:17:39 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:17:39.318281 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfedd3f-6b82-488a-ab23-f3d72674a3ca admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:39.327992 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfedd3f-6b82-488a-ab23-f3d72674a3ca admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:39.384448 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8bd8d-da53-4873-941a-8d5993b97b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:39.385144 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8bd8d-da53-4873-941a-8d5993b97b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:39.385422 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8bd8d-da53-4873-941a-8d5993b97b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:39.385692 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8bd8d-da53-4873-941a-8d5993b97b56 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:39.386373 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8bd8d-da53-4873-941a-8d5993b97b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:39.388285 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8bd8d-da53-4873-941a-8d5993b97b56 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:39.411508 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1414/2806] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:17:39 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:17:39.413007 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8326e0-dcf9-4ae6-9c52-b9fc654dbe36 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:39.423803 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8326e0-dcf9-4ae6-9c52-b9fc654dbe36 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:39.429333 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796134dc-45db-4bdb-b8fd-10661faf22c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:39.430044 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796134dc-45db-4bdb-b8fd-10661faf22c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:39.430326 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796134dc-45db-4bdb-b8fd-10661faf22c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:39.430601 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796134dc-45db-4bdb-b8fd-10661faf22c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:39.431509 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796134dc-45db-4bdb-b8fd-10661faf22c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:39.433148 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796134dc-45db-4bdb-b8fd-10661faf22c3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:39.444107 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1393/2807] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:17:39.448119 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8bd8d-da53-4873-941a-8d5993b97b56 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:39.458342 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8bd8d-da53-4873-941a-8d5993b97b56 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:39.463219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea82dd5-0810-464a-bfd5-d7dbc6c166c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:39.463898 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea82dd5-0810-464a-bfd5-d7dbc6c166c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:39.464180 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea82dd5-0810-464a-bfd5-d7dbc6c166c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:39.464455 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea82dd5-0810-464a-bfd5-d7dbc6c166c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:39.465215 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea82dd5-0810-464a-bfd5-d7dbc6c166c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:39.466808 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea82dd5-0810-464a-bfd5-d7dbc6c166c7 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:39.476599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1415/2808] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:17:39.480489 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796134dc-45db-4bdb-b8fd-10661faf22c3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:39.490713 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796134dc-45db-4bdb-b8fd-10661faf22c3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:39.495284 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da26716-0746-4c35-943c-51e24ab65c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:39.496144 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da26716-0746-4c35-943c-51e24ab65c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:39.496422 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da26716-0746-4c35-943c-51e24ab65c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:39.496695 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da26716-0746-4c35-943c-51e24ab65c02 admin admin] PATH_INFO: `/v3/projects/879bb5c75b43413a93e8c72bb5d4597c/users/ae679cbc135a4422bb802ca081ddf1e4/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:39.511229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da26716-0746-4c35-943c-51e24ab65c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879bb5c75b43413a93e8c72bb5d4597c, user_id=ae679cbc135a4422bb802ca081ddf1e4, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:39.513921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da26716-0746-4c35-943c-51e24ab65c02 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:39.526616 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1394/2809] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:17:39 2022] PUT /identity/v3/projects/879bb5c75b43413a93e8c72bb5d4597c/users/ae679cbc135a4422bb802ca081ddf1e4/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:17:39.538412 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1e8de-16fe-4855-8cef-b7fc39b52e39 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:39.538698 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1e8de-16fe-4855-8cef-b7fc39b52e39 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:39.538975 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1e8de-16fe-4855-8cef-b7fc39b52e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:39.568074 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d8e1e8de-16fe-4855-8cef-b7fc39b52e39 None None] MFA Rules not processed for user `ae679cbc135a4422bb802ca081ddf1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:39.569362 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d8e1e8de-16fe-4855-8cef-b7fc39b52e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:39.630513 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1416/2810] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:39.636090 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da26716-0746-4c35-943c-51e24ab65c02 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:39.697757 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da26716-0746-4c35-943c-51e24ab65c02 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:39.702362 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757911b-86cb-477b-bd8c-1eeaee8d1ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:39.703012 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757911b-86cb-477b-bd8c-1eeaee8d1ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:39.703289 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757911b-86cb-477b-bd8c-1eeaee8d1ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:39.703559 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757911b-86cb-477b-bd8c-1eeaee8d1ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:39.704236 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757911b-86cb-477b-bd8c-1eeaee8d1ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:39.706155 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757911b-86cb-477b-bd8c-1eeaee8d1ad6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:39.731059 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1395/2811] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:17:39 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:17:39.734975 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1e8de-16fe-4855-8cef-b7fc39b52e39 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:39.746360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1e8de-16fe-4855-8cef-b7fc39b52e39 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:39.802589 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb217f0-4319-4c10-b7b5-f3fe5e66d6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:39.803265 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb217f0-4319-4c10-b7b5-f3fe5e66d6dd admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:39.803544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb217f0-4319-4c10-b7b5-f3fe5e66d6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:39.803820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb217f0-4319-4c10-b7b5-f3fe5e66d6dd admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:39.804611 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb217f0-4319-4c10-b7b5-f3fe5e66d6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:39.806478 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb217f0-4319-4c10-b7b5-f3fe5e66d6dd admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:39.826961 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1417/2812] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:17:39 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:17:39.830855 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757911b-86cb-477b-bd8c-1eeaee8d1ad6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:39.841856 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757911b-86cb-477b-bd8c-1eeaee8d1ad6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:39.846408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7a687-6089-40e5-86a3-ee386588adce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:39.847055 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7a687-6089-40e5-86a3-ee386588adce admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:39.847378 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7a687-6089-40e5-86a3-ee386588adce admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:39.847646 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7a687-6089-40e5-86a3-ee386588adce admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:39.848355 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7a687-6089-40e5-86a3-ee386588adce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:39.849952 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7a687-6089-40e5-86a3-ee386588adce admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:39.859480 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1396/2813] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:17:39.863917 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb217f0-4319-4c10-b7b5-f3fe5e66d6dd admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:39.873771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb217f0-4319-4c10-b7b5-f3fe5e66d6dd admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:39.878304 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ece9d9-b8d8-4eff-b700-e3d8c753d13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:39.879885 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ece9d9-b8d8-4eff-b700-e3d8c753d13f admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:39.880162 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ece9d9-b8d8-4eff-b700-e3d8c753d13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:39.880434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ece9d9-b8d8-4eff-b700-e3d8c753d13f admin admin] PATH_INFO: `/v3/projects/2b66e6014af1427c9957e74c29aab6c0/users/dddd7cbd295b4bd2984fa60cde361d93/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:39.895923 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ece9d9-b8d8-4eff-b700-e3d8c753d13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b66e6014af1427c9957e74c29aab6c0, user_id=dddd7cbd295b4bd2984fa60cde361d93, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:39.898629 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ece9d9-b8d8-4eff-b700-e3d8c753d13f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:39.910919 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1418/2814] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:17:39 2022] PUT /identity/v3/projects/2b66e6014af1427c9957e74c29aab6c0/users/dddd7cbd295b4bd2984fa60cde361d93/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:39.914898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7a687-6089-40e5-86a3-ee386588adce admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:39.924850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7a687-6089-40e5-86a3-ee386588adce admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:39.979694 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201d04f-05c5-443b-9f18-b649f7c4f48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:39.980365 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201d04f-05c5-443b-9f18-b649f7c4f48c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:39.980644 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201d04f-05c5-443b-9f18-b649f7c4f48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:39.980961 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201d04f-05c5-443b-9f18-b649f7c4f48c admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:39.981686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201d04f-05c5-443b-9f18-b649f7c4f48c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:39.983278 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201d04f-05c5-443b-9f18-b649f7c4f48c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:39.995958 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1397/2815] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:17:40.000091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ece9d9-b8d8-4eff-b700-e3d8c753d13f admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:40.010832 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ece9d9-b8d8-4eff-b700-e3d8c753d13f admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:40.015493 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ce999-6cfb-49bd-9b54-2fa836190760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:40.016619 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ce999-6cfb-49bd-9b54-2fa836190760 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:40.017006 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ce999-6cfb-49bd-9b54-2fa836190760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:40.017283 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ce999-6cfb-49bd-9b54-2fa836190760 admin admin] PATH_INFO: `/v3/projects/2b66e6014af1427c9957e74c29aab6c0/users/dddd7cbd295b4bd2984fa60cde361d93/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:40.019863 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ce999-6cfb-49bd-9b54-2fa836190760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b66e6014af1427c9957e74c29aab6c0, user_id=dddd7cbd295b4bd2984fa60cde361d93, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:40.022542 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ce999-6cfb-49bd-9b54-2fa836190760 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:40.032434 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1419/2816] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:17:39 2022] PUT /identity/v3/projects/2b66e6014af1427c9957e74c29aab6c0/users/dddd7cbd295b4bd2984fa60cde361d93/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:17:40.042454 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c34a31-a718-4a8a-b274-9d470890a97d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:40.042752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c34a31-a718-4a8a-b274-9d470890a97d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:40.043054 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c34a31-a718-4a8a-b274-9d470890a97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:40.069789 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-63c34a31-a718-4a8a-b274-9d470890a97d None None] MFA Rules not processed for user `dddd7cbd295b4bd2984fa60cde361d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:40.071001 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-63c34a31-a718-4a8a-b274-9d470890a97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:40.137434 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1398/2817] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:40.149157 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ce999-6cfb-49bd-9b54-2fa836190760 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:40.150853 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-258ce999-6cfb-49bd-9b54-2fa836190760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:40.206343 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ce999-6cfb-49bd-9b54-2fa836190760 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:40.210244 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271787-e258-42e3-90f6-a970547d4c27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:40.210911 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271787-e258-42e3-90f6-a970547d4c27 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:40.211196 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271787-e258-42e3-90f6-a970547d4c27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:40.211474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d271787-e258-42e3-90f6-a970547d4c27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:40.220715 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d271787-e258-42e3-90f6-a970547d4c27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:40.222234 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d271787-e258-42e3-90f6-a970547d4c27 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:40.231568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1420/2818] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:17:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:17:40.306163 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c34a31-a718-4a8a-b274-9d470890a97d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:40.315681 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c34a31-a718-4a8a-b274-9d470890a97d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:40.319456 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f8f4c-378c-4846-bcf4-0d32fa94039e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:40.320090 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f8f4c-378c-4846-bcf4-0d32fa94039e service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:40.320374 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f8f4c-378c-4846-bcf4-0d32fa94039e service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:40.320649 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f8f4c-378c-4846-bcf4-0d32fa94039e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:40.377129 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f8f4c-378c-4846-bcf4-0d32fa94039e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:40.378660 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f8f4c-378c-4846-bcf4-0d32fa94039e service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:40.387532 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1399/2819] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:17:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:17:49.126623 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271787-e258-42e3-90f6-a970547d4c27 service cinder] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:49.190461 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d271787-e258-42e3-90f6-a970547d4c27 service cinder] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:49.194975 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38304890-69cf-4772-9215-6d0091d04018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:49.195829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38304890-69cf-4772-9215-6d0091d04018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:49.196100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38304890-69cf-4772-9215-6d0091d04018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:49.196366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38304890-69cf-4772-9215-6d0091d04018 admin admin] PATH_INFO: `/v3/users/ae679cbc135a4422bb802ca081ddf1e4` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:49.197568 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38304890-69cf-4772-9215-6d0091d04018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae679cbc135a4422bb802ca081ddf1e4)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:49.199476 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38304890-69cf-4772-9215-6d0091d04018 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:49.243386 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-38304890-69cf-4772-9215-6d0091d04018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae679cbc135a4422bb802ca081ddf1e4'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:49.243956 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-38304890-69cf-4772-9215-6d0091d04018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae679cbc135a4422bb802ca081ddf1e4'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:49.244552 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-38304890-69cf-4772-9215-6d0091d04018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae679cbc135a4422bb802ca081ddf1e4'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:49.251049 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-38304890-69cf-4772-9215-6d0091d04018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae679cbc135a4422bb802ca081ddf1e4'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:49.262554 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-38304890-69cf-4772-9215-6d0091d04018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae679cbc135a4422bb802ca081ddf1e4'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:49.274918 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1421/2820] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:17:49 2022] DELETE /identity/v3/users/ae679cbc135a4422bb802ca081ddf1e4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:49.279363 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9aafe-babc-4590-988d-4bec14c37e2c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:49.279857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9aafe-babc-4590-988d-4bec14c37e2c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:49.279947 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9aafe-babc-4590-988d-4bec14c37e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:49.297440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b1a9aafe-babc-4590-988d-4bec14c37e2c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:49.298637 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b1a9aafe-babc-4590-988d-4bec14c37e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:49.355125 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1400/2821] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:49.365350 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38304890-69cf-4772-9215-6d0091d04018 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:49.366773 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-38304890-69cf-4772-9215-6d0091d04018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:49.422826 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38304890-69cf-4772-9215-6d0091d04018 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:49.427150 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47626963-cc08-4341-8d4f-88a32925e531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:49.427789 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47626963-cc08-4341-8d4f-88a32925e531 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:49.428070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47626963-cc08-4341-8d4f-88a32925e531 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:49.428360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47626963-cc08-4341-8d4f-88a32925e531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:49.437321 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47626963-cc08-4341-8d4f-88a32925e531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:49.438762 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47626963-cc08-4341-8d4f-88a32925e531 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:49.448645 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1422/2822] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:17:49.709369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9aafe-babc-4590-988d-4bec14c37e2c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:49.710780 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b1a9aafe-babc-4590-988d-4bec14c37e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:49.723792 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9aafe-babc-4590-988d-4bec14c37e2c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:49.728757 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec53811-c089-40bc-a100-cb2104391603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:49.729684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec53811-c089-40bc-a100-cb2104391603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:49.730060 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec53811-c089-40bc-a100-cb2104391603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:49.731280 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec53811-c089-40bc-a100-cb2104391603 admin admin] PATH_INFO: `/v3/projects/879bb5c75b43413a93e8c72bb5d4597c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:49.731528 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec53811-c089-40bc-a100-cb2104391603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=879bb5c75b43413a93e8c72bb5d4597c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:49.733486 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec53811-c089-40bc-a100-cb2104391603 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:49.780840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5ec53811-c089-40bc-a100-cb2104391603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879bb5c75b43413a93e8c72bb5d4597c', 'request_id': 'req-5ec53811-c089-40bc-a100-cb2104391603'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:49.787745 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5ec53811-c089-40bc-a100-cb2104391603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879bb5c75b43413a93e8c72bb5d4597c', 'request_id': 'req-5ec53811-c089-40bc-a100-cb2104391603'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:49.793952 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5ec53811-c089-40bc-a100-cb2104391603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879bb5c75b43413a93e8c72bb5d4597c', 'request_id': 'req-5ec53811-c089-40bc-a100-cb2104391603'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:49.804439 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5ec53811-c089-40bc-a100-cb2104391603 admin admin] The token cache is being invalidate because project 879bb5c75b43413a93e8c72bb5d4597c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:17:49.804708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5ec53811-c089-40bc-a100-cb2104391603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:49.805361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5ec53811-c089-40bc-a100-cb2104391603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:49.806866 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1401/2823] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:17:49 2022] DELETE /identity/v3/projects/879bb5c75b43413a93e8c72bb5d4597c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:49.810781 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47626963-cc08-4341-8d4f-88a32925e531 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:49.820781 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47626963-cc08-4341-8d4f-88a32925e531 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:49.874622 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124d945-f7ac-4b09-826b-86f583998576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:49.875478 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124d945-f7ac-4b09-826b-86f583998576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:49.875757 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124d945-f7ac-4b09-826b-86f583998576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:49.876032 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124d945-f7ac-4b09-826b-86f583998576 admin admin] PATH_INFO: `/v3/users/dddd7cbd295b4bd2984fa60cde361d93` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:49.877229 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124d945-f7ac-4b09-826b-86f583998576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dddd7cbd295b4bd2984fa60cde361d93)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:49.879758 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124d945-f7ac-4b09-826b-86f583998576 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:49.922411 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7124d945-f7ac-4b09-826b-86f583998576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dddd7cbd295b4bd2984fa60cde361d93'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:49.923116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7124d945-f7ac-4b09-826b-86f583998576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dddd7cbd295b4bd2984fa60cde361d93'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:49.923713 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7124d945-f7ac-4b09-826b-86f583998576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dddd7cbd295b4bd2984fa60cde361d93'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:49.930842 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7124d945-f7ac-4b09-826b-86f583998576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dddd7cbd295b4bd2984fa60cde361d93'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:49.943447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7124d945-f7ac-4b09-826b-86f583998576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dddd7cbd295b4bd2984fa60cde361d93'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:49.955541 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1423/2824] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:17:49 2022] DELETE /identity/v3/users/dddd7cbd295b4bd2984fa60cde361d93 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:50.220243 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec53811-c089-40bc-a100-cb2104391603 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:50.221694 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5ec53811-c089-40bc-a100-cb2104391603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:50.234952 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec53811-c089-40bc-a100-cb2104391603 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:50.290929 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1c8c0-5222-4556-b0c1-b18fdb0e1367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:50.291788 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c8c0-5222-4556-b0c1-b18fdb0e1367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:50.292064 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c8c0-5222-4556-b0c1-b18fdb0e1367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:50.292334 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1c8c0-5222-4556-b0c1-b18fdb0e1367 admin admin] PATH_INFO: `/v3/projects/2b66e6014af1427c9957e74c29aab6c0` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:50.293514 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1c8c0-5222-4556-b0c1-b18fdb0e1367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b66e6014af1427c9957e74c29aab6c0)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:50.295419 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1c8c0-5222-4556-b0c1-b18fdb0e1367 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:50.339065 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3bc1c8c0-5222-4556-b0c1-b18fdb0e1367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b66e6014af1427c9957e74c29aab6c0', 'request_id': 'req-3bc1c8c0-5222-4556-b0c1-b18fdb0e1367'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:50.345984 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3bc1c8c0-5222-4556-b0c1-b18fdb0e1367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b66e6014af1427c9957e74c29aab6c0', 'request_id': 'req-3bc1c8c0-5222-4556-b0c1-b18fdb0e1367'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:50.352732 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3bc1c8c0-5222-4556-b0c1-b18fdb0e1367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b66e6014af1427c9957e74c29aab6c0', 'request_id': 'req-3bc1c8c0-5222-4556-b0c1-b18fdb0e1367'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:50.362883 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3bc1c8c0-5222-4556-b0c1-b18fdb0e1367 admin admin] The token cache is being invalidate because project 2b66e6014af1427c9957e74c29aab6c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:17:50.363164 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3bc1c8c0-5222-4556-b0c1-b18fdb0e1367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:50.364566 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3bc1c8c0-5222-4556-b0c1-b18fdb0e1367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:50.366097 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1402/2825] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:17:50 2022] DELETE /identity/v3/projects/2b66e6014af1427c9957e74c29aab6c0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:50.370867 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839807d-4dba-4799-8f46-b5c7d9dc7152 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:50.371371 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839807d-4dba-4799-8f46-b5c7d9dc7152 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:50.371488 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839807d-4dba-4799-8f46-b5c7d9dc7152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:50.388620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-8839807d-4dba-4799-8f46-b5c7d9dc7152 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:50.390029 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8839807d-4dba-4799-8f46-b5c7d9dc7152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:50.448560 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1424/2826] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:50.456437 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793815c7-f1c9-4101-b1d1-544784c279c7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:50.456726 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793815c7-f1c9-4101-b1d1-544784c279c7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:50.457083 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793815c7-f1c9-4101-b1d1-544784c279c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:50.475311 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-793815c7-f1c9-4101-b1d1-544784c279c7 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:50.476479 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-793815c7-f1c9-4101-b1d1-544784c279c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:50.484431 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1403/2827] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:50.489169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839807d-4dba-4799-8f46-b5c7d9dc7152 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:50.498802 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839807d-4dba-4799-8f46-b5c7d9dc7152 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:50.503437 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb59ad-f85c-4a9d-acce-220609dd6e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:50.504468 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb59ad-f85c-4a9d-acce-220609dd6e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:50.504805 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb59ad-f85c-4a9d-acce-220609dd6e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:50.505087 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb59ad-f85c-4a9d-acce-220609dd6e98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:50.505812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb59ad-f85c-4a9d-acce-220609dd6e98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:17:50.506114 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb59ad-f85c-4a9d-acce-220609dd6e98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:50.507708 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb59ad-f85c-4a9d-acce-220609dd6e98 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:50.519240 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1425/2828] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:17:50.523563 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793815c7-f1c9-4101-b1d1-544784c279c7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:50.533438 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793815c7-f1c9-4101-b1d1-544784c279c7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:50.538710 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1d44e-eb69-4f53-a831-0960f6558974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:50.539349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1d44e-eb69-4f53-a831-0960f6558974 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:50.539625 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1d44e-eb69-4f53-a831-0960f6558974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:50.539894 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1d44e-eb69-4f53-a831-0960f6558974 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:50.540573 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1d44e-eb69-4f53-a831-0960f6558974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:50.542533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1d44e-eb69-4f53-a831-0960f6558974 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:50.567527 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1404/2829] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:17:50 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:17:50.571644 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb59ad-f85c-4a9d-acce-220609dd6e98 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:50.581615 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb59ad-f85c-4a9d-acce-220609dd6e98 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:50.638759 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d97cf-a450-4176-a0e2-e7a122538933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:50.639423 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d97cf-a450-4176-a0e2-e7a122538933 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:50.639697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d97cf-a450-4176-a0e2-e7a122538933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:50.639968 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d97cf-a450-4176-a0e2-e7a122538933 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:50.640644 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d97cf-a450-4176-a0e2-e7a122538933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:50.642847 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d97cf-a450-4176-a0e2-e7a122538933 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:50.662065 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1426/2830] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:17:50 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:17:50.666357 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1d44e-eb69-4f53-a831-0960f6558974 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:50.677111 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1d44e-eb69-4f53-a831-0960f6558974 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:50.681698 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc928d-8ede-4361-800e-fcc6ac166010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:50.682348 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc928d-8ede-4361-800e-fcc6ac166010 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:50.682626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc928d-8ede-4361-800e-fcc6ac166010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:50.682900 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc928d-8ede-4361-800e-fcc6ac166010 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:50.683624 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc928d-8ede-4361-800e-fcc6ac166010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:50.685250 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc928d-8ede-4361-800e-fcc6ac166010 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:50.696140 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1405/2831] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:17:50.699895 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d97cf-a450-4176-a0e2-e7a122538933 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:50.709495 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d97cf-a450-4176-a0e2-e7a122538933 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:50.714223 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34cd05-13a6-41ef-80de-7d54683f50cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:50.714875 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34cd05-13a6-41ef-80de-7d54683f50cf admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:50.715154 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34cd05-13a6-41ef-80de-7d54683f50cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:50.715426 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34cd05-13a6-41ef-80de-7d54683f50cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:50.716166 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34cd05-13a6-41ef-80de-7d54683f50cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:50.717788 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34cd05-13a6-41ef-80de-7d54683f50cf admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:50.727607 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1427/2832] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:17:50.731486 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc928d-8ede-4361-800e-fcc6ac166010 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:50.741708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc928d-8ede-4361-800e-fcc6ac166010 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:50.746255 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff103167-3d2c-409b-8ab4-563b4eec4d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:50.747146 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff103167-3d2c-409b-8ab4-563b4eec4d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:50.747426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff103167-3d2c-409b-8ab4-563b4eec4d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:50.747697 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff103167-3d2c-409b-8ab4-563b4eec4d8e admin admin] PATH_INFO: `/v3/projects/bcef03449bcb425dac0c6aeb1d15a9ce/users/33e0d690bc2c45d79a2fb712731a3210/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:50.762385 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff103167-3d2c-409b-8ab4-563b4eec4d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcef03449bcb425dac0c6aeb1d15a9ce, user_id=33e0d690bc2c45d79a2fb712731a3210, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:50.765073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff103167-3d2c-409b-8ab4-563b4eec4d8e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:50.780095 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1406/2833] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:17:50 2022] PUT /identity/v3/projects/bcef03449bcb425dac0c6aeb1d15a9ce/users/33e0d690bc2c45d79a2fb712731a3210/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:50.791635 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78943b4-77db-46cd-8f12-2b4dc898fc5d None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:50.791926 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78943b4-77db-46cd-8f12-2b4dc898fc5d None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:50.792206 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78943b4-77db-46cd-8f12-2b4dc898fc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:50.820890 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-b78943b4-77db-46cd-8f12-2b4dc898fc5d None None] MFA Rules not processed for user `33e0d690bc2c45d79a2fb712731a3210`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:50.822075 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-b78943b4-77db-46cd-8f12-2b4dc898fc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:50.883593 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1428/2834] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:50.888128 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff103167-3d2c-409b-8ab4-563b4eec4d8e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:50.948741 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff103167-3d2c-409b-8ab4-563b4eec4d8e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:50.953290 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add86f54-7560-4d83-a89e-72c66ecb1dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:50.953943 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add86f54-7560-4d83-a89e-72c66ecb1dcb admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:50.954221 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add86f54-7560-4d83-a89e-72c66ecb1dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:50.954495 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add86f54-7560-4d83-a89e-72c66ecb1dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:50.955179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add86f54-7560-4d83-a89e-72c66ecb1dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:50.957129 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add86f54-7560-4d83-a89e-72c66ecb1dcb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:50.982361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1407/2835] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:17:50 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:17:50.986486 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78943b4-77db-46cd-8f12-2b4dc898fc5d None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:50.997952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78943b4-77db-46cd-8f12-2b4dc898fc5d None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:51.050955 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68390e-0662-4c04-a0c3-63163ad4e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:51.052099 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68390e-0662-4c04-a0c3-63163ad4e23d admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:51.052381 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68390e-0662-4c04-a0c3-63163ad4e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:51.052653 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68390e-0662-4c04-a0c3-63163ad4e23d admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:51.053366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68390e-0662-4c04-a0c3-63163ad4e23d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:51.055281 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68390e-0662-4c04-a0c3-63163ad4e23d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:51.075130 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1429/2836] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:17:50 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:17:51.079229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add86f54-7560-4d83-a89e-72c66ecb1dcb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:51.089716 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add86f54-7560-4d83-a89e-72c66ecb1dcb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:51.094294 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2079a-f25b-4a85-92d4-4424f5c38f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:51.094950 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2079a-f25b-4a85-92d4-4424f5c38f59 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:51.095231 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2079a-f25b-4a85-92d4-4424f5c38f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:51.095505 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2079a-f25b-4a85-92d4-4424f5c38f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:51.096236 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2079a-f25b-4a85-92d4-4424f5c38f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:51.098465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2079a-f25b-4a85-92d4-4424f5c38f59 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:51.108057 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1408/2837] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:17:51.112143 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68390e-0662-4c04-a0c3-63163ad4e23d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:51.122528 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68390e-0662-4c04-a0c3-63163ad4e23d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:51.127044 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74ed00-f0df-4275-9f4e-4c5adeb6fdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:51.127904 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74ed00-f0df-4275-9f4e-4c5adeb6fdf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:51.128178 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74ed00-f0df-4275-9f4e-4c5adeb6fdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:51.128445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74ed00-f0df-4275-9f4e-4c5adeb6fdf8 admin admin] PATH_INFO: `/v3/projects/3a90310956bc43adaacc50cf8e4ff981/users/f4d14c2debc34c87b0e087cbb1f249b4/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:51.143463 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74ed00-f0df-4275-9f4e-4c5adeb6fdf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a90310956bc43adaacc50cf8e4ff981, user_id=f4d14c2debc34c87b0e087cbb1f249b4, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:51.146266 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74ed00-f0df-4275-9f4e-4c5adeb6fdf8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:51.158880 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1430/2838] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:17:51 2022] PUT /identity/v3/projects/3a90310956bc43adaacc50cf8e4ff981/users/f4d14c2debc34c87b0e087cbb1f249b4/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:51.163663 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2079a-f25b-4a85-92d4-4424f5c38f59 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:51.173384 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2079a-f25b-4a85-92d4-4424f5c38f59 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:51.228433 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765ba24-a0e2-4d7f-a12e-b913c4f81a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:51.229039 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765ba24-a0e2-4d7f-a12e-b913c4f81a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:51.229315 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765ba24-a0e2-4d7f-a12e-b913c4f81a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:51.229584 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765ba24-a0e2-4d7f-a12e-b913c4f81a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:51.230487 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765ba24-a0e2-4d7f-a12e-b913c4f81a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:51.232119 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765ba24-a0e2-4d7f-a12e-b913c4f81a04 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:51.242408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1409/2839] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:17:51.246657 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74ed00-f0df-4275-9f4e-4c5adeb6fdf8 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:51.256637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74ed00-f0df-4275-9f4e-4c5adeb6fdf8 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:51.261169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ff24-bdae-4b5e-980b-34f51ae99c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:51.262024 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ff24-bdae-4b5e-980b-34f51ae99c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:51.262294 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ff24-bdae-4b5e-980b-34f51ae99c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:51.262561 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ff24-bdae-4b5e-980b-34f51ae99c10 admin admin] PATH_INFO: `/v3/projects/3a90310956bc43adaacc50cf8e4ff981/users/f4d14c2debc34c87b0e087cbb1f249b4/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:51.264527 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4ff24-bdae-4b5e-980b-34f51ae99c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a90310956bc43adaacc50cf8e4ff981, user_id=f4d14c2debc34c87b0e087cbb1f249b4, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:51.268068 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4ff24-bdae-4b5e-980b-34f51ae99c10 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:51.278199 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1431/2840] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:17:51 2022] PUT /identity/v3/projects/3a90310956bc43adaacc50cf8e4ff981/users/f4d14c2debc34c87b0e087cbb1f249b4/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:51.289078 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d1f49-450f-49b4-89e7-b3bd792e0456 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:51.289396 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d1f49-450f-49b4-89e7-b3bd792e0456 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:51.289676 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d1f49-450f-49b4-89e7-b3bd792e0456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:51.316052 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3e3d1f49-450f-49b4-89e7-b3bd792e0456 None None] MFA Rules not processed for user `f4d14c2debc34c87b0e087cbb1f249b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:51.317288 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3e3d1f49-450f-49b4-89e7-b3bd792e0456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:51.383951 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1410/2841] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:51.395918 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ff24-bdae-4b5e-980b-34f51ae99c10 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:51.397715 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-8df4ff24-bdae-4b5e-980b-34f51ae99c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:51.452599 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ff24-bdae-4b5e-980b-34f51ae99c10 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:51.456290 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478892b-1698-4cdc-8e05-9b57f08c4624 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:51.456968 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478892b-1698-4cdc-8e05-9b57f08c4624 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:51.457821 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478892b-1698-4cdc-8e05-9b57f08c4624 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:51.458100 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478892b-1698-4cdc-8e05-9b57f08c4624 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:51.466830 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478892b-1698-4cdc-8e05-9b57f08c4624 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:51.468262 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478892b-1698-4cdc-8e05-9b57f08c4624 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:51.478136 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1432/2842] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:17:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:17:51.545275 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d1f49-450f-49b4-89e7-b3bd792e0456 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:51.605701 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d1f49-450f-49b4-89e7-b3bd792e0456 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:51.610350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2042a-4210-4730-8c3b-c5b0bca5da23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:51.611215 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2042a-4210-4730-8c3b-c5b0bca5da23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:51.611504 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2042a-4210-4730-8c3b-c5b0bca5da23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:51.611785 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2042a-4210-4730-8c3b-c5b0bca5da23 admin admin] PATH_INFO: `/v3/users/33e0d690bc2c45d79a2fb712731a3210` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:51.613010 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2042a-4210-4730-8c3b-c5b0bca5da23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e0d690bc2c45d79a2fb712731a3210)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:51.615435 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2042a-4210-4730-8c3b-c5b0bca5da23 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:51.658742 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-45e2042a-4210-4730-8c3b-c5b0bca5da23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e0d690bc2c45d79a2fb712731a3210'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:51.659398 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-45e2042a-4210-4730-8c3b-c5b0bca5da23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e0d690bc2c45d79a2fb712731a3210'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:51.659999 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-45e2042a-4210-4730-8c3b-c5b0bca5da23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e0d690bc2c45d79a2fb712731a3210'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:51.667165 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-45e2042a-4210-4730-8c3b-c5b0bca5da23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e0d690bc2c45d79a2fb712731a3210'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:51.679319 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-45e2042a-4210-4730-8c3b-c5b0bca5da23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e0d690bc2c45d79a2fb712731a3210'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:51.691151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1411/2843] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:17:51 2022] DELETE /identity/v3/users/33e0d690bc2c45d79a2fb712731a3210 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:51.696247 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178e11f-7b27-4ddf-8706-5cc3e6b9de2f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:51.696540 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178e11f-7b27-4ddf-8706-5cc3e6b9de2f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:51.696845 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178e11f-7b27-4ddf-8706-5cc3e6b9de2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:51.714551 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-4178e11f-7b27-4ddf-8706-5cc3e6b9de2f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:51.715733 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4178e11f-7b27-4ddf-8706-5cc3e6b9de2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:51.774237 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1433/2844] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:51.783818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2042a-4210-4730-8c3b-c5b0bca5da23 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:51.785769 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-45e2042a-4210-4730-8c3b-c5b0bca5da23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:51.841080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2042a-4210-4730-8c3b-c5b0bca5da23 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:51.844736 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffed077-055e-4bab-8fd1-5969ecb17ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:51.845405 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed077-055e-4bab-8fd1-5969ecb17ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:51.845686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed077-055e-4bab-8fd1-5969ecb17ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:51.846315 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed077-055e-4bab-8fd1-5969ecb17ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:51.856060 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffed077-055e-4bab-8fd1-5969ecb17ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:51.857540 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffed077-055e-4bab-8fd1-5969ecb17ce7 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:51.868062 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1412/2845] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:17:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:17:52.198256 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178e11f-7b27-4ddf-8706-5cc3e6b9de2f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:52.199683 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4178e11f-7b27-4ddf-8706-5cc3e6b9de2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:52.211823 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178e11f-7b27-4ddf-8706-5cc3e6b9de2f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:52.217120 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfa7b5-509d-4b97-a4a7-104dfede1353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:52.218061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfa7b5-509d-4b97-a4a7-104dfede1353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:52.218442 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfa7b5-509d-4b97-a4a7-104dfede1353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:52.218793 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfa7b5-509d-4b97-a4a7-104dfede1353 admin admin] PATH_INFO: `/v3/projects/bcef03449bcb425dac0c6aeb1d15a9ce` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:52.220106 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfa7b5-509d-4b97-a4a7-104dfede1353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcef03449bcb425dac0c6aeb1d15a9ce)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:52.222133 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfa7b5-509d-4b97-a4a7-104dfede1353 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:52.270610 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-11dfa7b5-509d-4b97-a4a7-104dfede1353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcef03449bcb425dac0c6aeb1d15a9ce', 'request_id': 'req-11dfa7b5-509d-4b97-a4a7-104dfede1353'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:52.277102 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-11dfa7b5-509d-4b97-a4a7-104dfede1353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcef03449bcb425dac0c6aeb1d15a9ce', 'request_id': 'req-11dfa7b5-509d-4b97-a4a7-104dfede1353'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:52.285052 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-11dfa7b5-509d-4b97-a4a7-104dfede1353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcef03449bcb425dac0c6aeb1d15a9ce', 'request_id': 'req-11dfa7b5-509d-4b97-a4a7-104dfede1353'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:52.296750 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-11dfa7b5-509d-4b97-a4a7-104dfede1353 admin admin] The token cache is being invalidate because project bcef03449bcb425dac0c6aeb1d15a9ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:17:52.297059 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-11dfa7b5-509d-4b97-a4a7-104dfede1353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:52.297697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-11dfa7b5-509d-4b97-a4a7-104dfede1353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:52.299260 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1434/2846] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:17:52 2022] DELETE /identity/v3/projects/bcef03449bcb425dac0c6aeb1d15a9ce => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:52.303437 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffed077-055e-4bab-8fd1-5969ecb17ce7 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:52.313092 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffed077-055e-4bab-8fd1-5969ecb17ce7 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:52.371300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeece65-eaae-4433-972b-4799590db188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:52.372184 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeece65-eaae-4433-972b-4799590db188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:52.372465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeece65-eaae-4433-972b-4799590db188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:52.372741 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeece65-eaae-4433-972b-4799590db188 admin admin] PATH_INFO: `/v3/users/f4d14c2debc34c87b0e087cbb1f249b4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:52.373974 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeece65-eaae-4433-972b-4799590db188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d14c2debc34c87b0e087cbb1f249b4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:52.375906 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeece65-eaae-4433-972b-4799590db188 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:52.421570 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8aeece65-eaae-4433-972b-4799590db188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d14c2debc34c87b0e087cbb1f249b4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:52.422217 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8aeece65-eaae-4433-972b-4799590db188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d14c2debc34c87b0e087cbb1f249b4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:52.422813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8aeece65-eaae-4433-972b-4799590db188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d14c2debc34c87b0e087cbb1f249b4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:52.432508 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8aeece65-eaae-4433-972b-4799590db188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d14c2debc34c87b0e087cbb1f249b4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:52.446124 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8aeece65-eaae-4433-972b-4799590db188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d14c2debc34c87b0e087cbb1f249b4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:52.458705 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1413/2847] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:17:52 2022] DELETE /identity/v3/users/f4d14c2debc34c87b0e087cbb1f249b4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:52.729112 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfa7b5-509d-4b97-a4a7-104dfede1353 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:52.730862 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-11dfa7b5-509d-4b97-a4a7-104dfede1353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:52.744816 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfa7b5-509d-4b97-a4a7-104dfede1353 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:52.801729 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33fbe6-62b5-4016-a831-bf1cee7f9239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:52.802587 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33fbe6-62b5-4016-a831-bf1cee7f9239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:52.802866 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33fbe6-62b5-4016-a831-bf1cee7f9239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:52.803139 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33fbe6-62b5-4016-a831-bf1cee7f9239 admin admin] PATH_INFO: `/v3/projects/3a90310956bc43adaacc50cf8e4ff981` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:52.804314 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33fbe6-62b5-4016-a831-bf1cee7f9239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a90310956bc43adaacc50cf8e4ff981)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:52.806264 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33fbe6-62b5-4016-a831-bf1cee7f9239 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:52.852017 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4c33fbe6-62b5-4016-a831-bf1cee7f9239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a90310956bc43adaacc50cf8e4ff981', 'request_id': 'req-4c33fbe6-62b5-4016-a831-bf1cee7f9239'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:52.858308 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4c33fbe6-62b5-4016-a831-bf1cee7f9239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a90310956bc43adaacc50cf8e4ff981', 'request_id': 'req-4c33fbe6-62b5-4016-a831-bf1cee7f9239'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:52.865820 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4c33fbe6-62b5-4016-a831-bf1cee7f9239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a90310956bc43adaacc50cf8e4ff981', 'request_id': 'req-4c33fbe6-62b5-4016-a831-bf1cee7f9239'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:52.876598 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4c33fbe6-62b5-4016-a831-bf1cee7f9239 admin admin] The token cache is being invalidate because project 3a90310956bc43adaacc50cf8e4ff981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:17:52.876912 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4c33fbe6-62b5-4016-a831-bf1cee7f9239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:52.877552 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-4c33fbe6-62b5-4016-a831-bf1cee7f9239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:52.879089 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1435/2848] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:17:52 2022] DELETE /identity/v3/projects/3a90310956bc43adaacc50cf8e4ff981 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:52.884072 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7971cf7-5b69-4b50-9c58-678214529ff0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:52.884361 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7971cf7-5b69-4b50-9c58-678214529ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:52.884686 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7971cf7-5b69-4b50-9c58-678214529ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:52.903283 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d7971cf7-5b69-4b50-9c58-678214529ff0 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:52.904481 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d7971cf7-5b69-4b50-9c58-678214529ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:52.962033 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1414/2849] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:52.970990 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192957d-72de-4aa0-89c9-8c134621bd95 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:52.971280 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192957d-72de-4aa0-89c9-8c134621bd95 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:52.971563 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192957d-72de-4aa0-89c9-8c134621bd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:52.990732 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-3192957d-72de-4aa0-89c9-8c134621bd95 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:52.992109 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-3192957d-72de-4aa0-89c9-8c134621bd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:53.000091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1436/2850] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:53.004440 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7971cf7-5b69-4b50-9c58-678214529ff0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:53.014113 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7971cf7-5b69-4b50-9c58-678214529ff0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:53.019115 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cf5ff-d4dc-4b92-b94e-c4a671abcc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:53.020290 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cf5ff-d4dc-4b92-b94e-c4a671abcc9e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:53.020588 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cf5ff-d4dc-4b92-b94e-c4a671abcc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:53.020992 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cf5ff-d4dc-4b92-b94e-c4a671abcc9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:53.021706 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cf5ff-d4dc-4b92-b94e-c4a671abcc9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:17:53.022032 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cf5ff-d4dc-4b92-b94e-c4a671abcc9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:53.023633 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cf5ff-d4dc-4b92-b94e-c4a671abcc9e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:53.034818 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1415/2851] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 27 05:17:53.039718 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192957d-72de-4aa0-89c9-8c134621bd95 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:53.048811 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192957d-72de-4aa0-89c9-8c134621bd95 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:53.053449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02279716-ba5f-49ef-a49b-b42085aa232d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:53.054095 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02279716-ba5f-49ef-a49b-b42085aa232d admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:53.054383 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02279716-ba5f-49ef-a49b-b42085aa232d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:53.054664 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02279716-ba5f-49ef-a49b-b42085aa232d admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:53.055343 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02279716-ba5f-49ef-a49b-b42085aa232d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:53.057287 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02279716-ba5f-49ef-a49b-b42085aa232d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:53.081276 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1437/2852] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:17:53 2022] POST /identity/v3/projects => generated 381 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:17:53.085929 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cf5ff-d4dc-4b92-b94e-c4a671abcc9e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:53.095815 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cf5ff-d4dc-4b92-b94e-c4a671abcc9e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:53.155943 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3aff2d-69d9-4a15-902d-3f0f464c38ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:53.156615 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3aff2d-69d9-4a15-902d-3f0f464c38ac admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:53.156939 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3aff2d-69d9-4a15-902d-3f0f464c38ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:53.157210 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3aff2d-69d9-4a15-902d-3f0f464c38ac admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:53.157941 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3aff2d-69d9-4a15-902d-3f0f464c38ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:53.159987 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3aff2d-69d9-4a15-902d-3f0f464c38ac admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:53.181381 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1416/2853] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:17:53 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:17:53.185440 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02279716-ba5f-49ef-a49b-b42085aa232d admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:53.197128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02279716-ba5f-49ef-a49b-b42085aa232d admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:53.201812 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb742c-d376-4003-a593-a36d1a26f49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:53.202492 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb742c-d376-4003-a593-a36d1a26f49a admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:53.202771 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb742c-d376-4003-a593-a36d1a26f49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:53.203070 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb742c-d376-4003-a593-a36d1a26f49a admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:53.203789 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb742c-d376-4003-a593-a36d1a26f49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:53.205416 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb742c-d376-4003-a593-a36d1a26f49a admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:53.216647 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1438/2854] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:17:53.220556 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3aff2d-69d9-4a15-902d-3f0f464c38ac admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:53.230633 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3aff2d-69d9-4a15-902d-3f0f464c38ac admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:53.235218 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10533c1-7568-43f6-863d-f852c146047d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:53.235866 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10533c1-7568-43f6-863d-f852c146047d admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:53.236150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10533c1-7568-43f6-863d-f852c146047d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:53.236426 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10533c1-7568-43f6-863d-f852c146047d admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:53.237211 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10533c1-7568-43f6-863d-f852c146047d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:53.238908 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10533c1-7568-43f6-863d-f852c146047d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:53.250459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1417/2855] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:17:53.255018 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb742c-d376-4003-a593-a36d1a26f49a admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:53.264905 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb742c-d376-4003-a593-a36d1a26f49a admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:53.270412 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ab87b-1073-4209-8602-f8e48e68e58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:53.271380 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ab87b-1073-4209-8602-f8e48e68e58e admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:53.271687 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ab87b-1073-4209-8602-f8e48e68e58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:53.271962 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ab87b-1073-4209-8602-f8e48e68e58e admin admin] PATH_INFO: `/v3/projects/80ec2fecb3ee4d219e2181cca6979788/users/f647b419f1d44738abe736f48519c6b9/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:53.287331 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ab87b-1073-4209-8602-f8e48e68e58e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ec2fecb3ee4d219e2181cca6979788, user_id=f647b419f1d44738abe736f48519c6b9, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:53.290044 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ab87b-1073-4209-8602-f8e48e68e58e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:53.302540 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1439/2856] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:17:53 2022] PUT /identity/v3/projects/80ec2fecb3ee4d219e2181cca6979788/users/f647b419f1d44738abe736f48519c6b9/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:53.368873 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76c46b-d782-402f-90e2-0f5e306ac7de None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:53.369165 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76c46b-d782-402f-90e2-0f5e306ac7de None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:53.369444 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76c46b-d782-402f-90e2-0f5e306ac7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:53.395920 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-bc76c46b-d782-402f-90e2-0f5e306ac7de None None] MFA Rules not processed for user `f647b419f1d44738abe736f48519c6b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:53.397163 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bc76c46b-d782-402f-90e2-0f5e306ac7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:53.460834 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1418/2857] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:53.465259 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ab87b-1073-4209-8602-f8e48e68e58e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:53.525776 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ab87b-1073-4209-8602-f8e48e68e58e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:53.530377 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecae75-3522-4cee-83aa-c4e5bec4c813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:53.531023 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecae75-3522-4cee-83aa-c4e5bec4c813 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:53.531305 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecae75-3522-4cee-83aa-c4e5bec4c813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:53.531583 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecae75-3522-4cee-83aa-c4e5bec4c813 admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:53.532255 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecae75-3522-4cee-83aa-c4e5bec4c813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:53.534177 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecae75-3522-4cee-83aa-c4e5bec4c813 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:53.559189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1440/2858] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:17:53 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:17:53.563238 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76c46b-d782-402f-90e2-0f5e306ac7de None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:53.574047 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76c46b-d782-402f-90e2-0f5e306ac7de None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:53.627994 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab9f84-20fd-4ebe-8887-f3aa20082a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:53.628653 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab9f84-20fd-4ebe-8887-f3aa20082a9f admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:53.628970 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab9f84-20fd-4ebe-8887-f3aa20082a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:53.629254 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab9f84-20fd-4ebe-8887-f3aa20082a9f admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:53.629955 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab9f84-20fd-4ebe-8887-f3aa20082a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:53.631875 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab9f84-20fd-4ebe-8887-f3aa20082a9f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:53.653484 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1419/2859] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:17:53 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:17:53.657401 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecae75-3522-4cee-83aa-c4e5bec4c813 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:53.668082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecae75-3522-4cee-83aa-c4e5bec4c813 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:53.672690 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be6e3b-f620-4d07-967d-baab031a524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:53.673362 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be6e3b-f620-4d07-967d-baab031a524b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:53.673642 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be6e3b-f620-4d07-967d-baab031a524b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:53.673914 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be6e3b-f620-4d07-967d-baab031a524b admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:53.674637 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be6e3b-f620-4d07-967d-baab031a524b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:53.676248 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be6e3b-f620-4d07-967d-baab031a524b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:53.686426 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1441/2860] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:17:53.690369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab9f84-20fd-4ebe-8887-f3aa20082a9f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:53.700087 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab9f84-20fd-4ebe-8887-f3aa20082a9f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:53.704782 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbecc8-e949-4436-a86e-c4ba0cd833dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:53.705670 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbecc8-e949-4436-a86e-c4ba0cd833dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:53.705952 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbecc8-e949-4436-a86e-c4ba0cd833dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:53.706224 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbecc8-e949-4436-a86e-c4ba0cd833dd admin admin] PATH_INFO: `/v3/projects/6cda3e1906a444ad9478d65e283dc29f/users/d1ef0c88f60444e087df1c7acc74bec0/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:53.721658 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbecc8-e949-4436-a86e-c4ba0cd833dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cda3e1906a444ad9478d65e283dc29f, user_id=d1ef0c88f60444e087df1c7acc74bec0, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:53.725015 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbecc8-e949-4436-a86e-c4ba0cd833dd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:53.738860 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1420/2861] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:17:53 2022] PUT /identity/v3/projects/6cda3e1906a444ad9478d65e283dc29f/users/d1ef0c88f60444e087df1c7acc74bec0/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:53.742810 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be6e3b-f620-4d07-967d-baab031a524b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:53.752925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be6e3b-f620-4d07-967d-baab031a524b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:53.807347 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443647c-153f-4bd3-88e1-2c75c64e45c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:53.808003 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443647c-153f-4bd3-88e1-2c75c64e45c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:53.808281 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443647c-153f-4bd3-88e1-2c75c64e45c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:53.808554 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443647c-153f-4bd3-88e1-2c75c64e45c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:53.809305 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443647c-153f-4bd3-88e1-2c75c64e45c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:53.810888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443647c-153f-4bd3-88e1-2c75c64e45c8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:53.820302 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1442/2862] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:17:53.824516 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbecc8-e949-4436-a86e-c4ba0cd833dd admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:53.835568 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbecc8-e949-4436-a86e-c4ba0cd833dd admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:53.840076 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ac65d-d35c-4ba8-aa78-3c6e0f09ff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:53.840976 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ac65d-d35c-4ba8-aa78-3c6e0f09ff10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:53.841251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ac65d-d35c-4ba8-aa78-3c6e0f09ff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:53.841517 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ac65d-d35c-4ba8-aa78-3c6e0f09ff10 admin admin] PATH_INFO: `/v3/projects/6cda3e1906a444ad9478d65e283dc29f/users/d1ef0c88f60444e087df1c7acc74bec0/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:53.843447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ac65d-d35c-4ba8-aa78-3c6e0f09ff10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cda3e1906a444ad9478d65e283dc29f, user_id=d1ef0c88f60444e087df1c7acc74bec0, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:53.846116 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ac65d-d35c-4ba8-aa78-3c6e0f09ff10 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:53.856829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1421/2863] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:17:53 2022] PUT /identity/v3/projects/6cda3e1906a444ad9478d65e283dc29f/users/d1ef0c88f60444e087df1c7acc74bec0/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:17:53.866424 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7f5d0-d2e7-42fa-a789-c08ab2c2c228 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:53.866736 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7f5d0-d2e7-42fa-a789-c08ab2c2c228 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:53.867010 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7f5d0-d2e7-42fa-a789-c08ab2c2c228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:53.892730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-c7d7f5d0-d2e7-42fa-a789-c08ab2c2c228 None None] MFA Rules not processed for user `d1ef0c88f60444e087df1c7acc74bec0`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:53.894085 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-c7d7f5d0-d2e7-42fa-a789-c08ab2c2c228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:53.959952 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1443/2864] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:53.970348 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ac65d-d35c-4ba8-aa78-3c6e0f09ff10 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:53.972030 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-709ac65d-d35c-4ba8-aa78-3c6e0f09ff10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:54.027699 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ac65d-d35c-4ba8-aa78-3c6e0f09ff10 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:54.031278 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494975e-5866-4481-86a9-bcecb060820e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:54.031910 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494975e-5866-4481-86a9-bcecb060820e service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:54.032194 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494975e-5866-4481-86a9-bcecb060820e service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:54.032465 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494975e-5866-4481-86a9-bcecb060820e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:54.041448 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494975e-5866-4481-86a9-bcecb060820e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:54.042876 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494975e-5866-4481-86a9-bcecb060820e service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:54.052171 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1422/2865] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:17:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:17:54.155335 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7f5d0-d2e7-42fa-a789-c08ab2c2c228 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:54.165268 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7f5d0-d2e7-42fa-a789-c08ab2c2c228 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:54.168746 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ea7eb-e276-489c-8476-9bbcdba86dc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:54.169402 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ea7eb-e276-489c-8476-9bbcdba86dc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:54.169675 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ea7eb-e276-489c-8476-9bbcdba86dc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:54.169947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ea7eb-e276-489c-8476-9bbcdba86dc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:54.225479 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ea7eb-e276-489c-8476-9bbcdba86dc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:54.226842 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ea7eb-e276-489c-8476-9bbcdba86dc7 service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:54.235685 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1444/2866] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:17:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:17:56.803533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494975e-5866-4481-86a9-bcecb060820e service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:56.870046 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494975e-5866-4481-86a9-bcecb060820e service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:56.874574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211bf4b-2664-4cf5-b5e1-5f67c403c4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:56.875423 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211bf4b-2664-4cf5-b5e1-5f67c403c4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:56.875706 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211bf4b-2664-4cf5-b5e1-5f67c403c4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:56.875978 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211bf4b-2664-4cf5-b5e1-5f67c403c4ca admin admin] PATH_INFO: `/v3/users/f647b419f1d44738abe736f48519c6b9` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:56.877339 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211bf4b-2664-4cf5-b5e1-5f67c403c4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f647b419f1d44738abe736f48519c6b9)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:56.881135 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211bf4b-2664-4cf5-b5e1-5f67c403c4ca admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:56.929956 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3211bf4b-2664-4cf5-b5e1-5f67c403c4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f647b419f1d44738abe736f48519c6b9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:56.930618 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3211bf4b-2664-4cf5-b5e1-5f67c403c4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f647b419f1d44738abe736f48519c6b9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:56.931225 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3211bf4b-2664-4cf5-b5e1-5f67c403c4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f647b419f1d44738abe736f48519c6b9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:56.938117 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3211bf4b-2664-4cf5-b5e1-5f67c403c4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f647b419f1d44738abe736f48519c6b9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:56.951671 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3211bf4b-2664-4cf5-b5e1-5f67c403c4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f647b419f1d44738abe736f48519c6b9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:56.976416 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1423/2867] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:17:56 2022] DELETE /identity/v3/users/f647b419f1d44738abe736f48519c6b9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:56.980954 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8b768-d3b7-4175-959c-e5128866423c None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:56.981378 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8b768-d3b7-4175-959c-e5128866423c None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:56.981499 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8b768-d3b7-4175-959c-e5128866423c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:57.004317 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-2df8b768-d3b7-4175-959c-e5128866423c None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:57.005565 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2df8b768-d3b7-4175-959c-e5128866423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:57.071563 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1445/2868] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:57.083127 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211bf4b-2664-4cf5-b5e1-5f67c403c4ca admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:57.084629 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3211bf4b-2664-4cf5-b5e1-5f67c403c4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:57.145974 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211bf4b-2664-4cf5-b5e1-5f67c403c4ca admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:57.149990 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9bb5c-db98-4efd-961d-9e65cb7d652a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:57.151428 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9bb5c-db98-4efd-961d-9e65cb7d652a service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:57.151428 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9bb5c-db98-4efd-961d-9e65cb7d652a service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:57.151428 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9bb5c-db98-4efd-961d-9e65cb7d652a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:57.161645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9bb5c-db98-4efd-961d-9e65cb7d652a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:57.163091 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9bb5c-db98-4efd-961d-9e65cb7d652a service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:57.173943 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1424/2869] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:17:57.451669 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8b768-d3b7-4175-959c-e5128866423c None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:57.453189 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-2df8b768-d3b7-4175-959c-e5128866423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:57.465799 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8b768-d3b7-4175-959c-e5128866423c None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:57.470754 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7f0c6-428f-43ab-8e56-befde10eb91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:57.471547 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7f0c6-428f-43ab-8e56-befde10eb91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:57.471829 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7f0c6-428f-43ab-8e56-befde10eb91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:57.472097 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7f0c6-428f-43ab-8e56-befde10eb91e admin admin] PATH_INFO: `/v3/projects/80ec2fecb3ee4d219e2181cca6979788` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:57.473947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7f0c6-428f-43ab-8e56-befde10eb91e admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ec2fecb3ee4d219e2181cca6979788)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:57.475965 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7f0c6-428f-43ab-8e56-befde10eb91e admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:57.522844 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-94c7f0c6-428f-43ab-8e56-befde10eb91e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ec2fecb3ee4d219e2181cca6979788', 'request_id': 'req-94c7f0c6-428f-43ab-8e56-befde10eb91e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:57.528856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-94c7f0c6-428f-43ab-8e56-befde10eb91e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ec2fecb3ee4d219e2181cca6979788', 'request_id': 'req-94c7f0c6-428f-43ab-8e56-befde10eb91e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:57.536877 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-94c7f0c6-428f-43ab-8e56-befde10eb91e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ec2fecb3ee4d219e2181cca6979788', 'request_id': 'req-94c7f0c6-428f-43ab-8e56-befde10eb91e'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:57.546911 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-94c7f0c6-428f-43ab-8e56-befde10eb91e admin admin] The token cache is being invalidate because project 80ec2fecb3ee4d219e2181cca6979788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:17:57.547187 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-94c7f0c6-428f-43ab-8e56-befde10eb91e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:57.547801 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-94c7f0c6-428f-43ab-8e56-befde10eb91e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:57.549340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1446/2870] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:17:57 2022] DELETE /identity/v3/projects/80ec2fecb3ee4d219e2181cca6979788 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:57.553976 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9bb5c-db98-4efd-961d-9e65cb7d652a service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:57.563489 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9bb5c-db98-4efd-961d-9e65cb7d652a service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:57.618309 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c9f6e-60c6-49a0-ac8e-d28b9c2fe4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:57.619171 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c9f6e-60c6-49a0-ac8e-d28b9c2fe4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:57.619449 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c9f6e-60c6-49a0-ac8e-d28b9c2fe4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:57.619719 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c9f6e-60c6-49a0-ac8e-d28b9c2fe4d3 admin admin] PATH_INFO: `/v3/users/d1ef0c88f60444e087df1c7acc74bec0` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:57.620922 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c9f6e-60c6-49a0-ac8e-d28b9c2fe4d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ef0c88f60444e087df1c7acc74bec0)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:57.622840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c9f6e-60c6-49a0-ac8e-d28b9c2fe4d3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:57.668936 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-581c9f6e-60c6-49a0-ac8e-d28b9c2fe4d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ef0c88f60444e087df1c7acc74bec0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:57.669631 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-581c9f6e-60c6-49a0-ac8e-d28b9c2fe4d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ef0c88f60444e087df1c7acc74bec0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:57.670253 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-581c9f6e-60c6-49a0-ac8e-d28b9c2fe4d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ef0c88f60444e087df1c7acc74bec0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:57.677591 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-581c9f6e-60c6-49a0-ac8e-d28b9c2fe4d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ef0c88f60444e087df1c7acc74bec0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:57.689057 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-581c9f6e-60c6-49a0-ac8e-d28b9c2fe4d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ef0c88f60444e087df1c7acc74bec0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:57.702069 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1425/2871] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:17:57 2022] DELETE /identity/v3/users/d1ef0c88f60444e087df1c7acc74bec0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:57.963360 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7f0c6-428f-43ab-8e56-befde10eb91e admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:57.964836 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-94c7f0c6-428f-43ab-8e56-befde10eb91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:57.977836 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7f0c6-428f-43ab-8e56-befde10eb91e admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:58.034057 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32dfcd-dff6-4a86-bbbb-4065ec90494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:58.035052 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32dfcd-dff6-4a86-bbbb-4065ec90494d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:58.035459 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32dfcd-dff6-4a86-bbbb-4065ec90494d admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:58.035739 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32dfcd-dff6-4a86-bbbb-4065ec90494d admin admin] PATH_INFO: `/v3/projects/6cda3e1906a444ad9478d65e283dc29f` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:58.036948 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32dfcd-dff6-4a86-bbbb-4065ec90494d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cda3e1906a444ad9478d65e283dc29f)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:58.038855 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32dfcd-dff6-4a86-bbbb-4065ec90494d admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:58.084212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1e32dfcd-dff6-4a86-bbbb-4065ec90494d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cda3e1906a444ad9478d65e283dc29f', 'request_id': 'req-1e32dfcd-dff6-4a86-bbbb-4065ec90494d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:58.090009 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1e32dfcd-dff6-4a86-bbbb-4065ec90494d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cda3e1906a444ad9478d65e283dc29f', 'request_id': 'req-1e32dfcd-dff6-4a86-bbbb-4065ec90494d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:58.096732 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1e32dfcd-dff6-4a86-bbbb-4065ec90494d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cda3e1906a444ad9478d65e283dc29f', 'request_id': 'req-1e32dfcd-dff6-4a86-bbbb-4065ec90494d'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:58.106632 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1e32dfcd-dff6-4a86-bbbb-4065ec90494d admin admin] The token cache is being invalidate because project 6cda3e1906a444ad9478d65e283dc29f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:17:58.106909 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1e32dfcd-dff6-4a86-bbbb-4065ec90494d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:58.107507 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1e32dfcd-dff6-4a86-bbbb-4065ec90494d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:58.109039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1447/2872] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:17:57 2022] DELETE /identity/v3/projects/6cda3e1906a444ad9478d65e283dc29f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:58.114473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da204e71-5ba1-4af4-b45e-0c81698593f4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:58.114954 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da204e71-5ba1-4af4-b45e-0c81698593f4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:58.115086 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da204e71-5ba1-4af4-b45e-0c81698593f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:58.132864 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-da204e71-5ba1-4af4-b45e-0c81698593f4 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:58.134093 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-da204e71-5ba1-4af4-b45e-0c81698593f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:58.193725 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1426/2873] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:58.202424 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c278-1575-4c98-b2b8-c42dbe924e9f None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:58.202739 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c278-1575-4c98-b2b8-c42dbe924e9f None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:58.203018 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547c278-1575-4c98-b2b8-c42dbe924e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:58.221256 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-a547c278-1575-4c98-b2b8-c42dbe924e9f None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:58.222458 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-a547c278-1575-4c98-b2b8-c42dbe924e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:58.230617 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1448/2874] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:58.234708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da204e71-5ba1-4af4-b45e-0c81698593f4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:58.244862 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da204e71-5ba1-4af4-b45e-0c81698593f4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:58.249475 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d9681-0f71-4557-ae23-4c7f9d61c710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:58.250163 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d9681-0f71-4557-ae23-4c7f9d61c710 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:58.250444 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d9681-0f71-4557-ae23-4c7f9d61c710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:58.250722 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d9681-0f71-4557-ae23-4c7f9d61c710 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:58.251447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d9681-0f71-4557-ae23-4c7f9d61c710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:17:58.251754 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d9681-0f71-4557-ae23-4c7f9d61c710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:58.253397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d9681-0f71-4557-ae23-4c7f9d61c710 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:58.265265 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1427/2875] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:17:58.270377 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547c278-1575-4c98-b2b8-c42dbe924e9f None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:58.279467 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547c278-1575-4c98-b2b8-c42dbe924e9f None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:58.284039 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9b052-7e45-4370-851a-e8482928073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:58.284672 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9b052-7e45-4370-851a-e8482928073f admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:58.285656 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9b052-7e45-4370-851a-e8482928073f admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:58.286162 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9b052-7e45-4370-851a-e8482928073f admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:58.286927 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9b052-7e45-4370-851a-e8482928073f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:58.288839 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9b052-7e45-4370-851a-e8482928073f admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:58.313482 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1449/2876] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:17:58 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:17:58.317459 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d9681-0f71-4557-ae23-4c7f9d61c710 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:58.326998 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d9681-0f71-4557-ae23-4c7f9d61c710 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:58.383946 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94bbfb-1ea8-483e-ac6b-3413e6f7461c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:58.384720 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94bbfb-1ea8-483e-ac6b-3413e6f7461c admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:58.385026 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94bbfb-1ea8-483e-ac6b-3413e6f7461c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:58.385300 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94bbfb-1ea8-483e-ac6b-3413e6f7461c admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:58.385989 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94bbfb-1ea8-483e-ac6b-3413e6f7461c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:58.387921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94bbfb-1ea8-483e-ac6b-3413e6f7461c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:58.407879 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1428/2877] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:17:58 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 27 05:17:58.412715 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9b052-7e45-4370-851a-e8482928073f admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:58.423003 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9b052-7e45-4370-851a-e8482928073f admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:58.427701 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f131b93-1290-4d8d-9df6-3d91d12b5a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:58.428354 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f131b93-1290-4d8d-9df6-3d91d12b5a7b admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:58.428635 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f131b93-1290-4d8d-9df6-3d91d12b5a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:58.428943 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f131b93-1290-4d8d-9df6-3d91d12b5a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:58.429667 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f131b93-1290-4d8d-9df6-3d91d12b5a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:58.431255 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f131b93-1290-4d8d-9df6-3d91d12b5a7b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:58.443361 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1450/2878] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:17:58.447612 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94bbfb-1ea8-483e-ac6b-3413e6f7461c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:58.457932 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94bbfb-1ea8-483e-ac6b-3413e6f7461c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:58.462577 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ee60d-e435-4e86-884d-9d4f942283bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:58.463220 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ee60d-e435-4e86-884d-9d4f942283bd admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:58.463495 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ee60d-e435-4e86-884d-9d4f942283bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:58.463762 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ee60d-e435-4e86-884d-9d4f942283bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:58.464473 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ee60d-e435-4e86-884d-9d4f942283bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:58.466107 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ee60d-e435-4e86-884d-9d4f942283bd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:58.477150 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1429/2879] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:17:58.481376 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f131b93-1290-4d8d-9df6-3d91d12b5a7b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:58.491721 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f131b93-1290-4d8d-9df6-3d91d12b5a7b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:58.496375 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bce179-bc8c-472e-834c-57150326ea73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:58.497254 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bce179-bc8c-472e-834c-57150326ea73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:58.497533 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bce179-bc8c-472e-834c-57150326ea73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:58.497804 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bce179-bc8c-472e-834c-57150326ea73 admin admin] PATH_INFO: `/v3/projects/bac7c926b0784dc496c2bfbfb4611b31/users/edfc40b2f453439f94129d23aa33166c/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:58.512449 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bce179-bc8c-472e-834c-57150326ea73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac7c926b0784dc496c2bfbfb4611b31, user_id=edfc40b2f453439f94129d23aa33166c, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:58.515150 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bce179-bc8c-472e-834c-57150326ea73 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:58.528981 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1451/2880] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:17:58 2022] PUT /identity/v3/projects/bac7c926b0784dc496c2bfbfb4611b31/users/edfc40b2f453439f94129d23aa33166c/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:58.539887 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b05f80-f84d-4932-85cc-8f02e4b17d99 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:58.540173 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b05f80-f84d-4932-85cc-8f02e4b17d99 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:58.540447 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b05f80-f84d-4932-85cc-8f02e4b17d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:58.566850 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f1b05f80-f84d-4932-85cc-8f02e4b17d99 None None] MFA Rules not processed for user `edfc40b2f453439f94129d23aa33166c`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:58.568350 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f1b05f80-f84d-4932-85cc-8f02e4b17d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:58.629168 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1430/2881] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:58.633808 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bce179-bc8c-472e-834c-57150326ea73 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:58.693418 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bce179-bc8c-472e-834c-57150326ea73 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:58.698141 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc37fd-5521-40a1-9057-b1d584dfabcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:58.698728 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc37fd-5521-40a1-9057-b1d584dfabcf admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:58.699010 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc37fd-5521-40a1-9057-b1d584dfabcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:58.699286 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc37fd-5521-40a1-9057-b1d584dfabcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:58.699975 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc37fd-5521-40a1-9057-b1d584dfabcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:58.701914 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc37fd-5521-40a1-9057-b1d584dfabcf admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:58.726767 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1452/2882] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:17:58 2022] POST /identity/v3/projects => generated 389 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:17:58.730739 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b05f80-f84d-4932-85cc-8f02e4b17d99 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:58.742516 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b05f80-f84d-4932-85cc-8f02e4b17d99 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:58.795978 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251313b-f8e4-4147-812c-8a9e68ca8a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:58.796638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251313b-f8e4-4147-812c-8a9e68ca8a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:58.796957 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251313b-f8e4-4147-812c-8a9e68ca8a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:58.797233 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251313b-f8e4-4147-812c-8a9e68ca8a8f admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:58.797923 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251313b-f8e4-4147-812c-8a9e68ca8a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:58.799829 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251313b-f8e4-4147-812c-8a9e68ca8a8f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:58.819495 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1431/2883] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:17:58 2022] POST /identity/v3/users => generated 301 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:17:58.823438 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc37fd-5521-40a1-9057-b1d584dfabcf admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:58.834122 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc37fd-5521-40a1-9057-b1d584dfabcf admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:58.838901 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70427eb-3e8d-4ec2-ad21-335d0a1076ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:58.839549 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70427eb-3e8d-4ec2-ad21-335d0a1076ec admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:58.839831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70427eb-3e8d-4ec2-ad21-335d0a1076ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:58.840137 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70427eb-3e8d-4ec2-ad21-335d0a1076ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:58.840892 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70427eb-3e8d-4ec2-ad21-335d0a1076ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:58.842532 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70427eb-3e8d-4ec2-ad21-335d0a1076ec admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:58.853738 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1453/2884] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:17:58.857825 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251313b-f8e4-4147-812c-8a9e68ca8a8f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:58.867590 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251313b-f8e4-4147-812c-8a9e68ca8a8f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:58.872354 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858ec0b-c0a5-4b6e-a7a8-d792fc1ee6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:58.873279 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858ec0b-c0a5-4b6e-a7a8-d792fc1ee6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:58.873557 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858ec0b-c0a5-4b6e-a7a8-d792fc1ee6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:58.873827 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858ec0b-c0a5-4b6e-a7a8-d792fc1ee6a8 admin admin] PATH_INFO: `/v3/projects/83aeb52bb38742158823b3b9c8ee93fe/users/93a5df2e6955496fb7864832a8553991/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:58.888135 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858ec0b-c0a5-4b6e-a7a8-d792fc1ee6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83aeb52bb38742158823b3b9c8ee93fe, user_id=93a5df2e6955496fb7864832a8553991, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:58.890811 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858ec0b-c0a5-4b6e-a7a8-d792fc1ee6a8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:58.904015 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1432/2885] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:17:58 2022] PUT /identity/v3/projects/83aeb52bb38742158823b3b9c8ee93fe/users/93a5df2e6955496fb7864832a8553991/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:17:58.907886 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70427eb-3e8d-4ec2-ad21-335d0a1076ec admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:58.918358 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70427eb-3e8d-4ec2-ad21-335d0a1076ec admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:58.971709 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f06480-85a5-46ca-a207-2e02456b0791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:58.972293 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f06480-85a5-46ca-a207-2e02456b0791 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:58.973155 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f06480-85a5-46ca-a207-2e02456b0791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:58.973445 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f06480-85a5-46ca-a207-2e02456b0791 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:58.974169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f06480-85a5-46ca-a207-2e02456b0791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:58.975777 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f06480-85a5-46ca-a207-2e02456b0791 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:58.985482 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1454/2886] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 27 05:17:58.989648 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858ec0b-c0a5-4b6e-a7a8-d792fc1ee6a8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:58.999816 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858ec0b-c0a5-4b6e-a7a8-d792fc1ee6a8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:59.004775 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64de6b4-903f-42c5-a8d7-91a21843b40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:59.005687 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64de6b4-903f-42c5-a8d7-91a21843b40c admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:59.005968 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64de6b4-903f-42c5-a8d7-91a21843b40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:59.006242 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64de6b4-903f-42c5-a8d7-91a21843b40c admin admin] PATH_INFO: `/v3/projects/83aeb52bb38742158823b3b9c8ee93fe/users/93a5df2e6955496fb7864832a8553991/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:59.008209 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64de6b4-903f-42c5-a8d7-91a21843b40c admin admin] RBAC: Authorizing `identity:create_grant(project_id=83aeb52bb38742158823b3b9c8ee93fe, user_id=93a5df2e6955496fb7864832a8553991, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:59.010898 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64de6b4-903f-42c5-a8d7-91a21843b40c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:59.024840 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1433/2887] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:17:58 2022] PUT /identity/v3/projects/83aeb52bb38742158823b3b9c8ee93fe/users/93a5df2e6955496fb7864832a8553991/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:59.036673 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fd31f-3b98-42fd-984b-3099e913aca4 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:59.037219 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fd31f-3b98-42fd-984b-3099e913aca4 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:59.037337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fd31f-3b98-42fd-984b-3099e913aca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:59.063457 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-606fd31f-3b98-42fd-984b-3099e913aca4 None None] MFA Rules not processed for user `93a5df2e6955496fb7864832a8553991`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:59.064640 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-606fd31f-3b98-42fd-984b-3099e913aca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:59.129899 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1455/2888] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:59.140698 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64de6b4-903f-42c5-a8d7-91a21843b40c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:59.142696 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a64de6b4-903f-42c5-a8d7-91a21843b40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:59.200506 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64de6b4-903f-42c5-a8d7-91a21843b40c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:59.204179 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333b8aa-4509-4492-8695-0d81ee1f0ede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:59.204847 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333b8aa-4509-4492-8695-0d81ee1f0ede service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:59.205130 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333b8aa-4509-4492-8695-0d81ee1f0ede service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:59.205401 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333b8aa-4509-4492-8695-0d81ee1f0ede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:59.214812 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333b8aa-4509-4492-8695-0d81ee1f0ede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:59.216251 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333b8aa-4509-4492-8695-0d81ee1f0ede service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:59.225472 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1434/2889] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:17:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:17:59.351102 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fd31f-3b98-42fd-984b-3099e913aca4 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:59.410828 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fd31f-3b98-42fd-984b-3099e913aca4 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:59.415554 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16178097-a0f8-4877-8188-6b5e944cbaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:59.416406 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16178097-a0f8-4877-8188-6b5e944cbaa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:59.416684 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16178097-a0f8-4877-8188-6b5e944cbaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:59.416996 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16178097-a0f8-4877-8188-6b5e944cbaa7 admin admin] PATH_INFO: `/v3/users/edfc40b2f453439f94129d23aa33166c` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:59.418171 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16178097-a0f8-4877-8188-6b5e944cbaa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edfc40b2f453439f94129d23aa33166c)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:59.420091 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16178097-a0f8-4877-8188-6b5e944cbaa7 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:59.464089 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-16178097-a0f8-4877-8188-6b5e944cbaa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edfc40b2f453439f94129d23aa33166c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:59.464727 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-16178097-a0f8-4877-8188-6b5e944cbaa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edfc40b2f453439f94129d23aa33166c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:59.465397 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-16178097-a0f8-4877-8188-6b5e944cbaa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edfc40b2f453439f94129d23aa33166c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:59.471848 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-16178097-a0f8-4877-8188-6b5e944cbaa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edfc40b2f453439f94129d23aa33166c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:59.483710 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-16178097-a0f8-4877-8188-6b5e944cbaa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edfc40b2f453439f94129d23aa33166c'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:17:59.496447 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1456/2890] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:17:59 2022] DELETE /identity/v3/users/edfc40b2f453439f94129d23aa33166c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:17:59.501277 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd411e-844e-43bb-ab8f-88a0020aebff None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:59.501577 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd411e-844e-43bb-ab8f-88a0020aebff None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:59.501857 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd411e-844e-43bb-ab8f-88a0020aebff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:59.520047 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-21fd411e-844e-43bb-ab8f-88a0020aebff None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:17:59.521272 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-21fd411e-844e-43bb-ab8f-88a0020aebff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:59.576579 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1435/2891] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:17:59.586600 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16178097-a0f8-4877-8188-6b5e944cbaa7 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:59.587970 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-16178097-a0f8-4877-8188-6b5e944cbaa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:59.642947 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16178097-a0f8-4877-8188-6b5e944cbaa7 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:59.647454 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cb26d-c97e-4f2a-8372-37ae3b118e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:59.648196 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cb26d-c97e-4f2a-8372-37ae3b118e1c service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:59.648544 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cb26d-c97e-4f2a-8372-37ae3b118e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:59.648906 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cb26d-c97e-4f2a-8372-37ae3b118e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:59.657921 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cb26d-c97e-4f2a-8372-37ae3b118e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:59.659340 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cb26d-c97e-4f2a-8372-37ae3b118e1c service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:59.669253 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1457/2892] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:17:59.927811 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd411e-844e-43bb-ab8f-88a0020aebff None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:17:59.929366 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-21fd411e-844e-43bb-ab8f-88a0020aebff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:17:59.942240 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd411e-844e-43bb-ab8f-88a0020aebff None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:17:59.946999 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cf604-b19e-49e3-876f-1e58dc9bce25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:17:59.947863 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cf604-b19e-49e3-876f-1e58dc9bce25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:17:59.948139 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cf604-b19e-49e3-876f-1e58dc9bce25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:17:59.948411 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cf604-b19e-49e3-876f-1e58dc9bce25 admin admin] PATH_INFO: `/v3/projects/bac7c926b0784dc496c2bfbfb4611b31` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:17:59.949627 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522cf604-b19e-49e3-876f-1e58dc9bce25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bac7c926b0784dc496c2bfbfb4611b31)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:17:59.951558 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522cf604-b19e-49e3-876f-1e58dc9bce25 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:17:59.999859 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-522cf604-b19e-49e3-876f-1e58dc9bce25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bac7c926b0784dc496c2bfbfb4611b31', 'request_id': 'req-522cf604-b19e-49e3-876f-1e58dc9bce25'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:00.007222 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-522cf604-b19e-49e3-876f-1e58dc9bce25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bac7c926b0784dc496c2bfbfb4611b31', 'request_id': 'req-522cf604-b19e-49e3-876f-1e58dc9bce25'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:00.013369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-522cf604-b19e-49e3-876f-1e58dc9bce25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bac7c926b0784dc496c2bfbfb4611b31', 'request_id': 'req-522cf604-b19e-49e3-876f-1e58dc9bce25'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:00.023785 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-522cf604-b19e-49e3-876f-1e58dc9bce25 admin admin] The token cache is being invalidate because project bac7c926b0784dc496c2bfbfb4611b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:18:00.024073 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-522cf604-b19e-49e3-876f-1e58dc9bce25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:00.024700 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-522cf604-b19e-49e3-876f-1e58dc9bce25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:00.026254 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1436/2893] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:17:59 2022] DELETE /identity/v3/projects/bac7c926b0784dc496c2bfbfb4611b31 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:18:00.030330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cb26d-c97e-4f2a-8372-37ae3b118e1c service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:00.040313 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cb26d-c97e-4f2a-8372-37ae3b118e1c service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:00.094011 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9e65e-4460-4fb0-b516-9ebbf111c5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:00.094877 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9e65e-4460-4fb0-b516-9ebbf111c5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:00.095159 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9e65e-4460-4fb0-b516-9ebbf111c5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:00.095435 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9e65e-4460-4fb0-b516-9ebbf111c5ac admin admin] PATH_INFO: `/v3/users/93a5df2e6955496fb7864832a8553991` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:00.096612 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9e65e-4460-4fb0-b516-9ebbf111c5ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a5df2e6955496fb7864832a8553991)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:00.099385 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9e65e-4460-4fb0-b516-9ebbf111c5ac admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:00.142737 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-edb9e65e-4460-4fb0-b516-9ebbf111c5ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a5df2e6955496fb7864832a8553991'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:00.143378 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-edb9e65e-4460-4fb0-b516-9ebbf111c5ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a5df2e6955496fb7864832a8553991'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:00.143976 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-edb9e65e-4460-4fb0-b516-9ebbf111c5ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a5df2e6955496fb7864832a8553991'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:00.150855 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-edb9e65e-4460-4fb0-b516-9ebbf111c5ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a5df2e6955496fb7864832a8553991'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:00.163344 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-edb9e65e-4460-4fb0-b516-9ebbf111c5ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a5df2e6955496fb7864832a8553991'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:00.175080 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1458/2894] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:18:00 2022] DELETE /identity/v3/users/93a5df2e6955496fb7864832a8553991 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:18:00.433961 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cf604-b19e-49e3-876f-1e58dc9bce25 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:00.435424 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-522cf604-b19e-49e3-876f-1e58dc9bce25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:00.449629 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cf604-b19e-49e3-876f-1e58dc9bce25 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:00.506401 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0c1a8-ec55-4905-a869-6ad85568d9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:00.507267 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0c1a8-ec55-4905-a869-6ad85568d9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:00.507547 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0c1a8-ec55-4905-a869-6ad85568d9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:00.507824 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0c1a8-ec55-4905-a869-6ad85568d9f8 admin admin] PATH_INFO: `/v3/projects/83aeb52bb38742158823b3b9c8ee93fe` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:00.509067 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0c1a8-ec55-4905-a869-6ad85568d9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83aeb52bb38742158823b3b9c8ee93fe)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:00.510983 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0c1a8-ec55-4905-a869-6ad85568d9f8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:00.555949 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f9c0c1a8-ec55-4905-a869-6ad85568d9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83aeb52bb38742158823b3b9c8ee93fe', 'request_id': 'req-f9c0c1a8-ec55-4905-a869-6ad85568d9f8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:00.562443 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f9c0c1a8-ec55-4905-a869-6ad85568d9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83aeb52bb38742158823b3b9c8ee93fe', 'request_id': 'req-f9c0c1a8-ec55-4905-a869-6ad85568d9f8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:00.568714 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f9c0c1a8-ec55-4905-a869-6ad85568d9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83aeb52bb38742158823b3b9c8ee93fe', 'request_id': 'req-f9c0c1a8-ec55-4905-a869-6ad85568d9f8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:00.578858 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f9c0c1a8-ec55-4905-a869-6ad85568d9f8 admin admin] The token cache is being invalidate because project 83aeb52bb38742158823b3b9c8ee93fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:18:00.579227 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f9c0c1a8-ec55-4905-a869-6ad85568d9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:00.579936 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f9c0c1a8-ec55-4905-a869-6ad85568d9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:00.585335 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1437/2895] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:18:00 2022] DELETE /identity/v3/projects/83aeb52bb38742158823b3b9c8ee93fe => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:18:00.588066 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812b38f-c3f0-4f1a-8b61-c37050bfe969 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:00.588490 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812b38f-c3f0-4f1a-8b61-c37050bfe969 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:00.589001 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812b38f-c3f0-4f1a-8b61-c37050bfe969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:00.610164 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-1812b38f-c3f0-4f1a-8b61-c37050bfe969 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:18:00.611366 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-1812b38f-c3f0-4f1a-8b61-c37050bfe969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:00.669578 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1459/2896] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:18:00.678270 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b07425-9b84-45f3-956f-577fd78035e1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:00.678566 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b07425-9b84-45f3-956f-577fd78035e1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:00.678841 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b07425-9b84-45f3-956f-577fd78035e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:00.697390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e0b07425-9b84-45f3-956f-577fd78035e1 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:18:00.698574 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e0b07425-9b84-45f3-956f-577fd78035e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:00.707176 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1438/2897] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:18:00.711393 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812b38f-c3f0-4f1a-8b61-c37050bfe969 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:00.721082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812b38f-c3f0-4f1a-8b61-c37050bfe969 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:00.726239 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce022483-ed3d-45e5-8407-46626fd902dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:00.726913 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce022483-ed3d-45e5-8407-46626fd902dc admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:00.727222 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce022483-ed3d-45e5-8407-46626fd902dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:00.727503 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce022483-ed3d-45e5-8407-46626fd902dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:00.728251 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce022483-ed3d-45e5-8407-46626fd902dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80022) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 27 05:18:00.728560 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce022483-ed3d-45e5-8407-46626fd902dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:00.730193 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce022483-ed3d-45e5-8407-46626fd902dc admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:00.741967 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1460/2898] 10.222.0.27 () {58 vars in 1153 bytes} [Tue Sep 27 05:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 27 05:18:00.746143 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b07425-9b84-45f3-956f-577fd78035e1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:00.755514 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b07425-9b84-45f3-956f-577fd78035e1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:00.760156 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95f0c1-e0d6-493e-bff4-23df1ee55b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:00.760819 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95f0c1-e0d6-493e-bff4-23df1ee55b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:00.761110 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95f0c1-e0d6-493e-bff4-23df1ee55b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:00.761390 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95f0c1-e0d6-493e-bff4-23df1ee55b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:00.762080 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95f0c1-e0d6-493e-bff4-23df1ee55b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:00.763984 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95f0c1-e0d6-493e-bff4-23df1ee55b68 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:00.790694 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1439/2899] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:18:00 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:18:00.794647 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce022483-ed3d-45e5-8407-46626fd902dc admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:00.805625 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce022483-ed3d-45e5-8407-46626fd902dc admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:00.858661 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300da86-16ac-46b0-a138-8fefe9c429f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:00.859285 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300da86-16ac-46b0-a138-8fefe9c429f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:00.859539 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300da86-16ac-46b0-a138-8fefe9c429f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:00.859811 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300da86-16ac-46b0-a138-8fefe9c429f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:00.860479 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300da86-16ac-46b0-a138-8fefe9c429f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:00.862417 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300da86-16ac-46b0-a138-8fefe9c429f0 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:00.882128 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1461/2900] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:18:00 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:18:00.886229 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95f0c1-e0d6-493e-bff4-23df1ee55b68 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:00.896564 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95f0c1-e0d6-493e-bff4-23df1ee55b68 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:00.901247 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3663d45-896c-4fae-b3e9-9ee6b23cea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:00.901912 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3663d45-896c-4fae-b3e9-9ee6b23cea83 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:00.902199 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3663d45-896c-4fae-b3e9-9ee6b23cea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:00.902478 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3663d45-896c-4fae-b3e9-9ee6b23cea83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:00.903210 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3663d45-896c-4fae-b3e9-9ee6b23cea83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:00.904952 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3663d45-896c-4fae-b3e9-9ee6b23cea83 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:00.916954 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1440/2901] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:18:00.920831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300da86-16ac-46b0-a138-8fefe9c429f0 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:00.931309 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300da86-16ac-46b0-a138-8fefe9c429f0 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:00.935928 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dc5a2-684d-42da-9cfe-0bac903186c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:00.936571 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dc5a2-684d-42da-9cfe-0bac903186c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:00.936901 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dc5a2-684d-42da-9cfe-0bac903186c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:00.937163 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dc5a2-684d-42da-9cfe-0bac903186c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:00.937904 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dc5a2-684d-42da-9cfe-0bac903186c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:00.939477 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dc5a2-684d-42da-9cfe-0bac903186c8 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:00.949175 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1462/2902] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:18:00.953211 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3663d45-896c-4fae-b3e9-9ee6b23cea83 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:00.963023 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3663d45-896c-4fae-b3e9-9ee6b23cea83 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:00.967645 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad3eeb-53b0-4f7a-ac91-938625b68a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:00.968519 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad3eeb-53b0-4f7a-ac91-938625b68a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:00.968809 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad3eeb-53b0-4f7a-ac91-938625b68a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:00.969103 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad3eeb-53b0-4f7a-ac91-938625b68a1c admin admin] PATH_INFO: `/v3/projects/422937c6150247d89813e73e85b2312c/users/51091d0b10e44c4fbca06fdd8141b451/roles/76a348ab64cc49e0b464e3578474c8d6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:00.984151 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad3eeb-53b0-4f7a-ac91-938625b68a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=422937c6150247d89813e73e85b2312c, user_id=51091d0b10e44c4fbca06fdd8141b451, role_id=76a348ab64cc49e0b464e3578474c8d6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:00.986916 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad3eeb-53b0-4f7a-ac91-938625b68a1c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:01.000262 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1441/2903] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:18:00 2022] PUT /identity/v3/projects/422937c6150247d89813e73e85b2312c/users/51091d0b10e44c4fbca06fdd8141b451/roles/76a348ab64cc49e0b464e3578474c8d6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:18:01.011333 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce5bda-0c4e-4b08-83fd-4572390b3c14 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:01.011621 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce5bda-0c4e-4b08-83fd-4572390b3c14 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:01.011897 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce5bda-0c4e-4b08-83fd-4572390b3c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:01.039255 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-d9ce5bda-0c4e-4b08-83fd-4572390b3c14 None None] MFA Rules not processed for user `51091d0b10e44c4fbca06fdd8141b451`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:18:01.040614 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-d9ce5bda-0c4e-4b08-83fd-4572390b3c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:01.102115 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1463/2904] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:18:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:18:01.106684 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad3eeb-53b0-4f7a-ac91-938625b68a1c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:01.166808 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad3eeb-53b0-4f7a-ac91-938625b68a1c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:01.171373 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a812d2-7de5-4775-86b3-99a95779afb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:01.172017 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a812d2-7de5-4775-86b3-99a95779afb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:01.172294 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a812d2-7de5-4775-86b3-99a95779afb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:01.172562 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a812d2-7de5-4775-86b3-99a95779afb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:01.173273 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a812d2-7de5-4775-86b3-99a95779afb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:01.175148 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a812d2-7de5-4775-86b3-99a95779afb3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:01.200405 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1442/2905] 10.222.0.27 () {60 vars in 1153 bytes} [Tue Sep 27 05:18:01 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:18:01.204474 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce5bda-0c4e-4b08-83fd-4572390b3c14 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:01.215641 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce5bda-0c4e-4b08-83fd-4572390b3c14 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:01.269884 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a1aa6-4974-46cd-a101-32c3f47d7770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:01.270549 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a1aa6-4974-46cd-a101-32c3f47d7770 admin admin] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:01.270831 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a1aa6-4974-46cd-a101-32c3f47d7770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:01.271102 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a1aa6-4974-46cd-a101-32c3f47d7770 admin admin] PATH_INFO: `/v3/users` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:01.271785 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a1aa6-4974-46cd-a101-32c3f47d7770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:01.273730 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a1aa6-4974-46cd-a101-32c3f47d7770 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:01.292682 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1464/2906] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Sep 27 05:18:01 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 27 05:18:01.296647 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a812d2-7de5-4775-86b3-99a95779afb3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:01.307207 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a812d2-7de5-4775-86b3-99a95779afb3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:01.311784 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac96b7a-667a-48e8-9203-51e00992120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:01.312460 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac96b7a-667a-48e8-9203-51e00992120e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:01.312742 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac96b7a-667a-48e8-9203-51e00992120e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:01.313050 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac96b7a-667a-48e8-9203-51e00992120e admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:01.313775 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac96b7a-667a-48e8-9203-51e00992120e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:01.315364 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac96b7a-667a-48e8-9203-51e00992120e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:01.326098 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1443/2907] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:18:01.330239 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a1aa6-4974-46cd-a101-32c3f47d7770 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:01.341116 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a1aa6-4974-46cd-a101-32c3f47d7770 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:01.345856 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fece6b-9678-4bed-b27e-8b5ec5d104e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:01.346723 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fece6b-9678-4bed-b27e-8b5ec5d104e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:01.347002 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fece6b-9678-4bed-b27e-8b5ec5d104e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:01.347273 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fece6b-9678-4bed-b27e-8b5ec5d104e6 admin admin] PATH_INFO: `/v3/projects/40e295334d09488683ddfc96fc7f375b/users/973d6c1e0a3440919b0567dcf623f2da/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:01.362517 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fece6b-9678-4bed-b27e-8b5ec5d104e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e295334d09488683ddfc96fc7f375b, user_id=973d6c1e0a3440919b0567dcf623f2da, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:01.365782 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fece6b-9678-4bed-b27e-8b5ec5d104e6 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:01.377748 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1465/2908] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:18:01 2022] PUT /identity/v3/projects/40e295334d09488683ddfc96fc7f375b/users/973d6c1e0a3440919b0567dcf623f2da/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 27 05:18:01.382015 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac96b7a-667a-48e8-9203-51e00992120e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:01.392090 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac96b7a-667a-48e8-9203-51e00992120e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:01.448717 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfe618-3ed8-474f-ba57-1114386a30b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:01.449462 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfe618-3ed8-474f-ba57-1114386a30b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:01.449742 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfe618-3ed8-474f-ba57-1114386a30b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:01.450016 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfe618-3ed8-474f-ba57-1114386a30b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:01.450737 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfe618-3ed8-474f-ba57-1114386a30b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:01.452322 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfe618-3ed8-474f-ba57-1114386a30b9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:01.462803 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1444/2909] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Sep 27 05:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 27 05:18:01.466934 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fece6b-9678-4bed-b27e-8b5ec5d104e6 admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:01.477364 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fece6b-9678-4bed-b27e-8b5ec5d104e6 admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:01.481868 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892a97b-881e-4739-9728-2eea4fcd19fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:01.482712 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892a97b-881e-4739-9728-2eea4fcd19fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:01.482983 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892a97b-881e-4739-9728-2eea4fcd19fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:01.483265 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892a97b-881e-4739-9728-2eea4fcd19fb admin admin] PATH_INFO: `/v3/projects/40e295334d09488683ddfc96fc7f375b/users/973d6c1e0a3440919b0567dcf623f2da/roles/8f26dfbf7a9b44e79ee1fc909b0a058d` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:01.485212 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892a97b-881e-4739-9728-2eea4fcd19fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e295334d09488683ddfc96fc7f375b, user_id=973d6c1e0a3440919b0567dcf623f2da, role_id=8f26dfbf7a9b44e79ee1fc909b0a058d)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:01.487851 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892a97b-881e-4739-9728-2eea4fcd19fb admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:01.497977 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1466/2910] 10.222.0.27 () {60 vars in 1483 bytes} [Tue Sep 27 05:18:01 2022] PUT /identity/v3/projects/40e295334d09488683ddfc96fc7f375b/users/973d6c1e0a3440919b0567dcf623f2da/roles/8f26dfbf7a9b44e79ee1fc909b0a058d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:18:01.509759 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15e95b-431d-4abc-ba4d-c1f8ab6a3705 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:01.510049 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15e95b-431d-4abc-ba4d-c1f8ab6a3705 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:01.510344 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15e95b-431d-4abc-ba4d-c1f8ab6a3705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:01.536921 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8e15e95b-431d-4abc-ba4d-c1f8ab6a3705 None None] MFA Rules not processed for user `973d6c1e0a3440919b0567dcf623f2da`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:18:01.538113 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8e15e95b-431d-4abc-ba4d-c1f8ab6a3705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:01.603190 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1445/2911] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:18:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 27 05:18:01.614455 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892a97b-881e-4739-9728-2eea4fcd19fb admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:01.616146 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-4892a97b-881e-4739-9728-2eea4fcd19fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:01.671841 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892a97b-881e-4739-9728-2eea4fcd19fb admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:01.675490 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef567e01-9634-4ca0-88c6-5aa69f90268d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba2cc8ae41b435d830e58327893f527', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:01.676203 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef567e01-9634-4ca0-88c6-5aa69f90268d service cinder] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:01.676484 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef567e01-9634-4ca0-88c6-5aa69f90268d service cinder] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:01.676758 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef567e01-9634-4ca0-88c6-5aa69f90268d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:01.731324 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef567e01-9634-4ca0-88c6-5aa69f90268d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:01.732684 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef567e01-9634-4ca0-88c6-5aa69f90268d service cinder] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:01.741692 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1467/2912] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:18:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:18:04.435795 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15e95b-431d-4abc-ba4d-c1f8ab6a3705 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:04.495708 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15e95b-431d-4abc-ba4d-c1f8ab6a3705 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:04.500191 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1967aa-a958-4ba1-a0dd-18a0d2d99e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:04.501113 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1967aa-a958-4ba1-a0dd-18a0d2d99e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:04.501401 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1967aa-a958-4ba1-a0dd-18a0d2d99e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:04.501671 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1967aa-a958-4ba1-a0dd-18a0d2d99e2b admin admin] PATH_INFO: `/v3/users/51091d0b10e44c4fbca06fdd8141b451` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:04.502848 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1967aa-a958-4ba1-a0dd-18a0d2d99e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=51091d0b10e44c4fbca06fdd8141b451)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:04.505329 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1967aa-a958-4ba1-a0dd-18a0d2d99e2b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:04.549235 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ff1967aa-a958-4ba1-a0dd-18a0d2d99e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51091d0b10e44c4fbca06fdd8141b451'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:04.549869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ff1967aa-a958-4ba1-a0dd-18a0d2d99e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51091d0b10e44c4fbca06fdd8141b451'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:04.550533 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ff1967aa-a958-4ba1-a0dd-18a0d2d99e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51091d0b10e44c4fbca06fdd8141b451'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:04.557509 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ff1967aa-a958-4ba1-a0dd-18a0d2d99e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51091d0b10e44c4fbca06fdd8141b451'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:04.569337 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ff1967aa-a958-4ba1-a0dd-18a0d2d99e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51091d0b10e44c4fbca06fdd8141b451'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:04.581174 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1446/2913] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:18:04 2022] DELETE /identity/v3/users/51091d0b10e44c4fbca06fdd8141b451 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:18:04.586389 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f826a-968c-4b77-b934-f8512d4eb582 None None] REQUEST_METHOD: `POST` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:04.586888 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f826a-968c-4b77-b934-f8512d4eb582 None None] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:04.586988 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f826a-968c-4b77-b934-f8512d4eb582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:04.603845 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.auth.core [None req-ad5f826a-968c-4b77-b934-f8512d4eb582 None None] MFA Rules not processed for user `5a0a331b12764488a1a2fd987b375820`. Rule list: `[]` (Enabled: `True`). {{(pid=80022) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 27 05:18:04.605061 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ad5f826a-968c-4b77-b934-f8512d4eb582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:04.663753 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1468/2914] 10.222.0.27 () {58 vars in 958 bytes} [Tue Sep 27 05:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 27 05:18:04.673369 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1967aa-a958-4ba1-a0dd-18a0d2d99e2b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:04.674758 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ff1967aa-a958-4ba1-a0dd-18a0d2d99e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:04.731455 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1967aa-a958-4ba1-a0dd-18a0d2d99e2b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:04.735069 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dc567-cc2b-432b-9ebc-4ff17e9996a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:04.735706 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dc567-cc2b-432b-9ebc-4ff17e9996a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:04.735983 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dc567-cc2b-432b-9ebc-4ff17e9996a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:04.736255 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dc567-cc2b-432b-9ebc-4ff17e9996a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:04.748847 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dc567-cc2b-432b-9ebc-4ff17e9996a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:04.750289 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dc567-cc2b-432b-9ebc-4ff17e9996a9 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:04.759637 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1447/2915] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:18:05.015814 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f826a-968c-4b77-b934-f8512d4eb582 None None] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:05.017504 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-ad5f826a-968c-4b77-b934-f8512d4eb582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:05.032325 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f826a-968c-4b77-b934-f8512d4eb582 None None] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:05.041131 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccc234-4817-4cf1-86cb-f54c2a30d70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:05.042910 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccc234-4817-4cf1-86cb-f54c2a30d70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:05.043342 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccc234-4817-4cf1-86cb-f54c2a30d70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:05.043780 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccc234-4817-4cf1-86cb-f54c2a30d70b admin admin] PATH_INFO: `/v3/projects/422937c6150247d89813e73e85b2312c` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:05.045639 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ccc234-4817-4cf1-86cb-f54c2a30d70b admin admin] RBAC: Authorizing `identity:delete_project(project_id=422937c6150247d89813e73e85b2312c)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:05.047592 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ccc234-4817-4cf1-86cb-f54c2a30d70b admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:05.092962 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-11ccc234-4817-4cf1-86cb-f54c2a30d70b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422937c6150247d89813e73e85b2312c', 'request_id': 'req-11ccc234-4817-4cf1-86cb-f54c2a30d70b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:05.099966 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-11ccc234-4817-4cf1-86cb-f54c2a30d70b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422937c6150247d89813e73e85b2312c', 'request_id': 'req-11ccc234-4817-4cf1-86cb-f54c2a30d70b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:05.107197 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-11ccc234-4817-4cf1-86cb-f54c2a30d70b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422937c6150247d89813e73e85b2312c', 'request_id': 'req-11ccc234-4817-4cf1-86cb-f54c2a30d70b'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:05.117426 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-11ccc234-4817-4cf1-86cb-f54c2a30d70b admin admin] The token cache is being invalidate because project 422937c6150247d89813e73e85b2312c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:18:05.117712 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-11ccc234-4817-4cf1-86cb-f54c2a30d70b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:05.118337 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-11ccc234-4817-4cf1-86cb-f54c2a30d70b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:05.119921 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1469/2916] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:18:05 2022] DELETE /identity/v3/projects/422937c6150247d89813e73e85b2312c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:18:05.123864 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dc567-cc2b-432b-9ebc-4ff17e9996a9 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:05.133408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dc567-cc2b-432b-9ebc-4ff17e9996a9 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:05.189349 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93688606-f170-4b8b-893d-78e084fbb010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:05.190219 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93688606-f170-4b8b-893d-78e084fbb010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:05.190502 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93688606-f170-4b8b-893d-78e084fbb010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:05.190779 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93688606-f170-4b8b-893d-78e084fbb010 admin admin] PATH_INFO: `/v3/users/973d6c1e0a3440919b0567dcf623f2da` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:05.192915 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93688606-f170-4b8b-893d-78e084fbb010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=973d6c1e0a3440919b0567dcf623f2da)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:05.194794 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93688606-f170-4b8b-893d-78e084fbb010 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:05.238680 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-93688606-f170-4b8b-893d-78e084fbb010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973d6c1e0a3440919b0567dcf623f2da'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:05.239322 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-93688606-f170-4b8b-893d-78e084fbb010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973d6c1e0a3440919b0567dcf623f2da'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:05.239927 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-93688606-f170-4b8b-893d-78e084fbb010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973d6c1e0a3440919b0567dcf623f2da'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:05.247058 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-93688606-f170-4b8b-893d-78e084fbb010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973d6c1e0a3440919b0567dcf623f2da'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:05.258983 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-93688606-f170-4b8b-893d-78e084fbb010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973d6c1e0a3440919b0567dcf623f2da'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:05.271638 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1448/2917] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:18:05 2022] DELETE /identity/v3/users/973d6c1e0a3440919b0567dcf623f2da => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:18:05.536323 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccc234-4817-4cf1-86cb-f54c2a30d70b admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:05.537991 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-11ccc234-4817-4cf1-86cb-f54c2a30d70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:05.552169 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccc234-4817-4cf1-86cb-f54c2a30d70b admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:05.608305 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae800ea-3dbe-4dc1-864e-365a033b59ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:05.609199 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae800ea-3dbe-4dc1-864e-365a033b59ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:05.609480 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae800ea-3dbe-4dc1-864e-365a033b59ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:05.609755 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae800ea-3dbe-4dc1-864e-365a033b59ca admin admin] PATH_INFO: `/v3/projects/40e295334d09488683ddfc96fc7f375b` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:05.610928 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae800ea-3dbe-4dc1-864e-365a033b59ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e295334d09488683ddfc96fc7f375b)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:05.613405 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae800ea-3dbe-4dc1-864e-365a033b59ca admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:05.660674 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7ae800ea-3dbe-4dc1-864e-365a033b59ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e295334d09488683ddfc96fc7f375b', 'request_id': 'req-7ae800ea-3dbe-4dc1-864e-365a033b59ca'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:05.666569 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7ae800ea-3dbe-4dc1-864e-365a033b59ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e295334d09488683ddfc96fc7f375b', 'request_id': 'req-7ae800ea-3dbe-4dc1-864e-365a033b59ca'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:05.673594 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7ae800ea-3dbe-4dc1-864e-365a033b59ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e295334d09488683ddfc96fc7f375b', 'request_id': 'req-7ae800ea-3dbe-4dc1-864e-365a033b59ca'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:05.683999 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7ae800ea-3dbe-4dc1-864e-365a033b59ca admin admin] The token cache is being invalidate because project 40e295334d09488683ddfc96fc7f375b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:18:05.684281 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7ae800ea-3dbe-4dc1-864e-365a033b59ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:05.685000 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-7ae800ea-3dbe-4dc1-864e-365a033b59ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:18:05.686535 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1470/2918] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:18:05 2022] DELETE /identity/v3/projects/40e295334d09488683ddfc96fc7f375b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:18:55.132090 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93688606-f170-4b8b-893d-78e084fbb010 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:55.133444 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-93688606-f170-4b8b-893d-78e084fbb010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:55.268397 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93688606-f170-4b8b-893d-78e084fbb010 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:55.325064 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2960113-2ecf-462c-a4a6-5db9e952257b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8489647547d544a681131dad99e058bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:55.325707 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2960113-2ecf-462c-a4a6-5db9e952257b service placement] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:55.325985 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2960113-2ecf-462c-a4a6-5db9e952257b service placement] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:55.326259 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2960113-2ecf-462c-a4a6-5db9e952257b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:55.328013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a2960113-2ecf-462c-a4a6-5db9e952257b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:55.339437 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2960113-2ecf-462c-a4a6-5db9e952257b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:55.341035 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2960113-2ecf-462c-a4a6-5db9e952257b service placement] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:55.351242 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1449/2919] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:18:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:18:58.713790 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae800ea-3dbe-4dc1-864e-365a033b59ca admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:58.715222 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-7ae800ea-3dbe-4dc1-864e-365a033b59ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:58.799719 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae800ea-3dbe-4dc1-864e-365a033b59ca admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:58.804293 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9c130-8874-469e-8afa-b18a94721759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:58.804686 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9c130-8874-469e-8afa-b18a94721759 service neutron] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:58.805010 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9c130-8874-469e-8afa-b18a94721759 service neutron] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:58.805288 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9c130-8874-469e-8afa-b18a94721759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:58.807082 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-51e9c130-8874-469e-8afa-b18a94721759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:58.816710 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9c130-8874-469e-8afa-b18a94721759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:58.818176 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9c130-8874-469e-8afa-b18a94721759 service neutron] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:58.826738 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1471/2920] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:18:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:18:58.915408 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2960113-2ecf-462c-a4a6-5db9e952257b service placement] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:58.924742 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2960113-2ecf-462c-a4a6-5db9e952257b service placement] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:58.928308 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383706c-25e4-4ba1-a0c3-5f239a8e2003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '639126e5b13345cda6490073ec57f4c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:58.929476 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383706c-25e4-4ba1-a0c3-5f239a8e2003 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:58.929752 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383706c-25e4-4ba1-a0c3-5f239a8e2003 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:58.930025 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383706c-25e4-4ba1-a0c3-5f239a8e2003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:58.931797 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c383706c-25e4-4ba1-a0c3-5f239a8e2003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:58.999429 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383706c-25e4-4ba1-a0c3-5f239a8e2003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:59.000909 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383706c-25e4-4ba1-a0c3-5f239a8e2003 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:59.011626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1450/2921] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:18:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:18:59.071043 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9c130-8874-469e-8afa-b18a94721759 service neutron] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:18:59.072412 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-51e9c130-8874-469e-8afa-b18a94721759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:59.087678 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9c130-8874-469e-8afa-b18a94721759 service neutron] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:18:59.092709 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5f76b-5dff-4c4b-a8ec-e6737c4a75a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8489647547d544a681131dad99e058bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:18:59.093425 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5f76b-5dff-4c4b-a8ec-e6737c4a75a9 service placement] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:18:59.093705 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5f76b-5dff-4c4b-a8ec-e6737c4a75a9 service placement] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:18:59.093982 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5f76b-5dff-4c4b-a8ec-e6737c4a75a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:18:59.095697 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0ba5f76b-5dff-4c4b-a8ec-e6737c4a75a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:18:59.106997 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5f76b-5dff-4c4b-a8ec-e6737c4a75a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:18:59.108559 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5f76b-5dff-4c4b-a8ec-e6737c4a75a9 service placement] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:18:59.118373 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1472/2922] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:18:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:19:02.317132 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383706c-25e4-4ba1-a0c3-5f239a8e2003 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:19:02.318677 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c383706c-25e4-4ba1-a0c3-5f239a8e2003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:19:02.336339 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383706c-25e4-4ba1-a0c3-5f239a8e2003 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:19:02.341869 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e6f07-7c37-4b2f-b604-9020471ff717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faac84ed9d37420c811bbf6ac7df0b35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:19:02.342442 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e6f07-7c37-4b2f-b604-9020471ff717 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:19:02.342652 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e6f07-7c37-4b2f-b604-9020471ff717 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:19:02.342923 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e6f07-7c37-4b2f-b604-9020471ff717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:19:02.345410 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9a1e6f07-7c37-4b2f-b604-9020471ff717 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:19:02.358976 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e6f07-7c37-4b2f-b604-9020471ff717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:19:02.361019 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e6f07-7c37-4b2f-b604-9020471ff717 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:19:02.376937 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1451/2923] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:19:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 27 05:20:28.176721 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5f76b-5dff-4c4b-a8ec-e6737c4a75a9 service placement] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:20:28.191444 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5f76b-5dff-4c4b-a8ec-e6737c4a75a9 service placement] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:20:28.202421 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63951341-79ff-41f2-94dd-a7fdd42e1edc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8489647547d544a681131dad99e058bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:20:28.203104 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63951341-79ff-41f2-94dd-a7fdd42e1edc service placement] REQUEST_METHOD: `GET` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:20:28.203384 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63951341-79ff-41f2-94dd-a7fdd42e1edc service placement] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:20:28.203922 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63951341-79ff-41f2-94dd-a7fdd42e1edc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:20:28.205989 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-63951341-79ff-41f2-94dd-a7fdd42e1edc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:20:28.220843 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63951341-79ff-41f2-94dd-a7fdd42e1edc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:20:28.222552 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63951341-79ff-41f2-94dd-a7fdd42e1edc service placement] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:20:28.234842 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1473/2924] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:20:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 27 05:20:31.326831 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e6f07-7c37-4b2f-b604-9020471ff717 service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:20:31.328393 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9a1e6f07-7c37-4b2f-b604-9020471ff717 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:20:31.425582 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e6f07-7c37-4b2f-b604-9020471ff717 service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:20:31.430102 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef88da-1073-498e-a79b-3b53596775a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:20:31.431626 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef88da-1073-498e-a79b-3b53596775a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:20:31.431899 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef88da-1073-498e-a79b-3b53596775a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:20:31.432169 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef88da-1073-498e-a79b-3b53596775a4 admin admin] PATH_INFO: `/v3/users/b4894c9e9f914351a69aed7e00761e08` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:20:31.433376 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef88da-1073-498e-a79b-3b53596775a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4894c9e9f914351a69aed7e00761e08)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:20:31.435288 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef88da-1073-498e-a79b-3b53596775a4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:20:31.479650 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-faef88da-1073-498e-a79b-3b53596775a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4894c9e9f914351a69aed7e00761e08'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:31.480232 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-faef88da-1073-498e-a79b-3b53596775a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4894c9e9f914351a69aed7e00761e08'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:31.480881 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-faef88da-1073-498e-a79b-3b53596775a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4894c9e9f914351a69aed7e00761e08'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:31.489001 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-faef88da-1073-498e-a79b-3b53596775a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4894c9e9f914351a69aed7e00761e08'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:31.501191 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-faef88da-1073-498e-a79b-3b53596775a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4894c9e9f914351a69aed7e00761e08'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:31.513541 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1452/2925] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:20:31 2022] DELETE /identity/v3/users/b4894c9e9f914351a69aed7e00761e08 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:20:31.681330 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63951341-79ff-41f2-94dd-a7fdd42e1edc service placement] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:20:31.693658 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63951341-79ff-41f2-94dd-a7fdd42e1edc service placement] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:20:31.748892 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:20:31.749751 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:20:31.750031 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:20:31.750306 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead admin admin] PATH_INFO: `/v3/projects/89e5839579a747caaa9b2e0712499dca` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:20:31.751473 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e5839579a747caaa9b2e0712499dca)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:20:31.753414 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:20:31.799217 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e5839579a747caaa9b2e0712499dca', 'request_id': 'req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:31.805126 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e5839579a747caaa9b2e0712499dca', 'request_id': 'req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:31.813072 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e5839579a747caaa9b2e0712499dca', 'request_id': 'req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:31.823144 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead admin admin] The token cache is being invalidate because project 89e5839579a747caaa9b2e0712499dca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:20:31.823423 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:31.824028 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:31.825620 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1474/2926] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:20:31 2022] DELETE /identity/v3/projects/89e5839579a747caaa9b2e0712499dca => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:20:31.829693 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef88da-1073-498e-a79b-3b53596775a4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:20:31.831177 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-faef88da-1073-498e-a79b-3b53596775a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:20:31.846441 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef88da-1073-498e-a79b-3b53596775a4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:20:31.906877 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0826ca-b7d5-4f0a-a804-25c67ad5dcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:20:31.907866 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0826ca-b7d5-4f0a-a804-25c67ad5dcf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:20:31.908140 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0826ca-b7d5-4f0a-a804-25c67ad5dcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:20:31.908414 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0826ca-b7d5-4f0a-a804-25c67ad5dcf2 admin admin] PATH_INFO: `/v3/users/9dfc0729cb374370b17e98d9696f491b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:20:31.909624 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0826ca-b7d5-4f0a-a804-25c67ad5dcf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dfc0729cb374370b17e98d9696f491b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:20:31.911935 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0826ca-b7d5-4f0a-a804-25c67ad5dcf2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:20:31.958556 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9b0826ca-b7d5-4f0a-a804-25c67ad5dcf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dfc0729cb374370b17e98d9696f491b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:31.959228 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9b0826ca-b7d5-4f0a-a804-25c67ad5dcf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dfc0729cb374370b17e98d9696f491b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:31.959813 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9b0826ca-b7d5-4f0a-a804-25c67ad5dcf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dfc0729cb374370b17e98d9696f491b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:31.967336 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9b0826ca-b7d5-4f0a-a804-25c67ad5dcf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dfc0729cb374370b17e98d9696f491b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:31.979808 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9b0826ca-b7d5-4f0a-a804-25c67ad5dcf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dfc0729cb374370b17e98d9696f491b'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:31.991492 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1453/2927] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Sep 27 05:20:31 2022] DELETE /identity/v3/users/9dfc0729cb374370b17e98d9696f491b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:20:32.157515 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead admin admin] Authenticating user token {{(pid=80022) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:20:32.159120 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.fernet_utils [None req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80022) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:20:32.172645 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce461ef-c13a-4f25-ab55-1ffd6c113ead admin admin] Validating token access rules against request {{(pid=80022) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:20:32.228113 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b044bc6-6668-46c0-8961-4dd5af704d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0a331b12764488a1a2fd987b375820', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c063435f154b48b086fd2d4eed2a41ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80022) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:20:32.228925 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b044bc6-6668-46c0-8961-4dd5af704d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:20:32.229203 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b044bc6-6668-46c0-8961-4dd5af704d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:20:32.229475 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b044bc6-6668-46c0-8961-4dd5af704d29 admin admin] PATH_INFO: `/v3/projects/fcf9a652487149e697216ccac9464a91` {{(pid=80022) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:20:32.230642 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b044bc6-6668-46c0-8961-4dd5af704d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf9a652487149e697216ccac9464a91)` {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:20:32.232545 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b044bc6-6668-46c0-8961-4dd5af704d29 admin admin] RBAC: Authorization granted {{(pid=80022) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:20:32.277395 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1b044bc6-6668-46c0-8961-4dd5af704d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf9a652487149e697216ccac9464a91', 'request_id': 'req-1b044bc6-6668-46c0-8961-4dd5af704d29'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:32.283659 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1b044bc6-6668-46c0-8961-4dd5af704d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf9a652487149e697216ccac9464a91', 'request_id': 'req-1b044bc6-6668-46c0-8961-4dd5af704d29'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:32.291762 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1b044bc6-6668-46c0-8961-4dd5af704d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf9a652487149e697216ccac9464a91', 'request_id': 'req-1b044bc6-6668-46c0-8961-4dd5af704d29'} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:32.301557 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1b044bc6-6668-46c0-8961-4dd5af704d29 admin admin] The token cache is being invalidate because project fcf9a652487149e697216ccac9464a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80022) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 27 05:20:32.301843 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1b044bc6-6668-46c0-8961-4dd5af704d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:32.302469 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: DEBUG keystone.notifications [None req-1b044bc6-6668-46c0-8961-4dd5af704d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80022) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 27 05:20:32.303980 dv-cinder-858463-2-iscsi devstack@keystone.service[80022]: [pid: 80022|app: 0|req: 1475/2928] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Sep 27 05:20:32 2022] DELETE /identity/v3/projects/fcf9a652487149e697216ccac9464a91 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 27 05:24:56.106689 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0826ca-b7d5-4f0a-a804-25c67ad5dcf2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 27 05:24:56.108084 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9b0826ca-b7d5-4f0a-a804-25c67ad5dcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:24:56.176013 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0826ca-b7d5-4f0a-a804-25c67ad5dcf2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 27 05:24:56.232071 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699ce40-df55-49b1-ab18-203826ee9585 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8489647547d544a681131dad99e058bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '470fa8cf5f4a443faea9cfc628ff6003', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 27 05:24:56.232634 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699ce40-df55-49b1-ab18-203826ee9585 service placement] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 27 05:24:56.232946 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699ce40-df55-49b1-ab18-203826ee9585 service placement] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 27 05:24:56.233220 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699ce40-df55-49b1-ab18-203826ee9585 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 27 05:24:56.234996 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a699ce40-df55-49b1-ab18-203826ee9585 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 27 05:24:56.246589 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699ce40-df55-49b1-ab18-203826ee9585 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 27 05:24:56.248159 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699ce40-df55-49b1-ab18-203826ee9585 service placement] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 27 05:24:56.257910 dv-cinder-858463-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1454/2929] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Sep 27 05:24:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)